Senior Data Engineer

Job Title: Senior Data Analytics Engineer Location: Bangalore Experience: 5 years I. Job Summary: The Senior Data Analytics Engineer will develop strategies for and help design, build, and maintain the entire data layer for the analytics stack from top to bottom. This role involves close collaboration with various teams across data engineering, analytics, and visualization to deliver robust Business Intelligence solutions. The engineer will define and apply software engineering best practices such as Agile methodologies, version control systems like Git, and continuous integration/continuous deployment (CI/CD) pipelines. II. Key Responsibilities: • Design, develop, test, deploy, and maintain large-scale data processing architectures using technologies such as Apache Spark, Hadoop Distributed File System (HDFS), Hive, Pig, and MapReduce. • Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. • Develop and maintain ETL processes for extracting, transforming, and loading data from various sources into a centralized repository. • Work closely with data scientists and analysts to understand their data requirements and provide them with the necessary data products. • Stay up-to-date with industry trends and emerging technologies in big data and analytics. III. Requirements: • 5+ years of experience in data engineering, preferably with a focus on big data and analytics. • Strong understanding of software engineering principles, including design patterns, scalability, and performance. • Experience with distributed computing frameworks such as Apache Spark, Hadoop Distributed File System (HDFS), Hive, Pig, and MapReduce. • Familiarity with data visualization tools like Tableau, Power BI, or QlikView. • Strong analytical and problem-solving skills, with the ability to work independently and collaboratively. • Excellent communication and interpersonal skills. IV. Benefits: • Opportunity to work on cutting-edge big data and analytics projects. • Collaborative and dynamic work environment. • Professional growth opportunities through training and mentorship. • Competitive compensation package.