Data Engineer

About Brillio: Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their capacity to seamlessly integrate cutting-edge digital and design thinking skills with an unwavering dedication to client satisfaction. Brillio takes pride in being a trusted partner for clients seeking to leverage the power of data engineering to drive business outcomes. As a Data Engineer at Brillio, you will be part of a high-performing team that is passionate about delivering innovative solutions that drive real value for our clients. If you are excited about the prospect of working with cutting-edge technologies and collaborating with talented professionals who share your passion for innovation, then we encourage you to apply for this exciting opportunity. Responsibilities: * Design, develop, test, and deploy large-scale data engineering solutions using various tools and technologies such as Apache Spark, Hadoop, AWS Glue, and Amazon S3. * Collaborate with cross-functional teams to identify business requirements and design scalable, efficient, and secure data pipelines that meet the needs of our clients. * Develop and maintain complex data processing workflows using languages like Python, Scala, or SQL. * Work closely with data scientists and analysts to develop data-driven solutions that drive business outcomes. * Participate in code reviews and ensure adherence to coding standards and best practices. * Troubleshoot and resolve issues related to data engineering pipelines and workflows. * Stay up-to-date with the latest trends, technologies, and methodologies in data engineering and apply this knowledge to continuously improve our solutions. Requirements: * Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field. * 3+ years of experience in data engineering, with a focus on designing, developing, and deploying large-scale data pipelines using various tools and technologies. * Strong understanding of data processing workflows, data modeling, and data governance principles. * Experience working with cloud-based data platforms such as AWS or Azure. * Proficiency in programming languages like Python, Scala, or SQL. * Strong analytical and problem-solving skills, with the ability to troubleshoot complex issues related to data engineering pipelines. * Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams. * Experience working in an Agile environment and familiarity with Agile methodologies such as Scrum or Kanban. What We Offer: * Competitive salary and benefits package. * Opportunities for professional growth and development through training, mentorship, and career advancement opportunities. * Collaborative and dynamic work environment that values innovation, creativity, and continuous learning. * Access to cutting-edge technologies and tools to stay ahead of the curve in the industry. * Recognition and rewards for outstanding performance and contributions to the organization.