Senior DataOps Engineer - MainApp infrastructure

We are a team to design, develop, maintain, and improve software for various ventures projects, i.e., projects that are adjacent to our core businesses and are bootstrapped fast with a lean team. You will be actively involved in the design of various components behind scalable applications, from frontend UI to backend infrastructure. Responsibilities: Manage the daily operations of Hadoop, Spark, Flink, Clickhouse, and other big data platforms to ensure system stability and data security; Operate, monitor, and optimize big data pipelines and ETL processes; Design and implement automated data quality checks and validation procedures; Collaborate with data engineers, data scientists, and other stakeholders to understand data requirements and ensure data availability and accessibility; Develop and maintain infrastructure-as-code (IaC) for data platforms; Automate and streamline data operations tasks; Troubleshoot and resolve data platform issues; Participate in on-call rotations to support data platform operations. Qualifications: Bachelor's degree in computer science or a related field; 5+ years of experience in data engineering or data operations; Strong experience with Hadoop, Spark, and other big data technologies; Experience with ETL tools and data pipeline management; Experience with monitoring and alerting tools; Experience with infrastructure-as-code tools (e.g., Terraform, Ansible); Strong scripting skills (e.g., Python, Shell); Excellent problem-solving and communication skills; Ability to work independently and as part of a team. Bonus Points: Experience with Flink, Clickhouse, or other real-time data processing technologies; Experience with cloud platforms (e.g., AWS, GCP, Azure); Experience with containerization and orchestration tools (e.g., Docker, Kubernetes); Experience with CI/CD pipelines.