Lead Data Engineer

About the Company: Everest DX – We are a Digital Platform Services company, headquartered in Stamford. Our Platform/Solution includes Orchestration, Intelligent operations with BOTs', AI-powered analytics for Enterprise IT. Our vision is to enable Digital Transformation for enterprises to deliver seamless customer experience, business efficiency and actionable insights through an integrated set of futuristic digital technologies. Digital Transformation Services - Specialized in Design, Build, Deploy, Manage and Optimize the entire lifecycle of Digital Platforms for Enterprises. We are looking for a highly skilled and experienced Lead Data Engineer who will be responsible for leading our data engineering team to design, build, deploy and manage large-scale data platforms for our clients. The ideal candidate should have strong experience in designing, building, deploying and managing big data platforms using Hadoop, Spark, Hive, Pig, Presto, SQL, NoSQL databases, Data Warehousing, ETL, Data Science, Machine Learning, Cloud Computing (AWS, Azure, Google Cloud), Big Data Analytics, Data Visualization, and Agile Methodologies. The candidate should also have experience in working with large-scale data sets, designing scalable architectures, and ensuring high availability and performance of the data platforms. In addition, the candidate should be able to work effectively with cross-functional teams, including data scientists, data analysts, and business stakeholders to deliver high-quality solutions that meet our clients' needs. The Lead Data Engineer will also be responsible for mentoring junior engineers, providing technical guidance, and ensuring compliance with company standards and best practices.