Big Data Engineer

Descripción del empleo As part of the Data Engineer team, you will be responsible for design, development and operations of large-scale data systems operating at petabytes scale. You will be focusing on real-time data pipelines, streaming analytics, distributed big data and machine learning infrastructure. You will interact with the engineers, product managers, BI developers and architects to provide scalable robust technical solutions. Experience in agile models Design, develop, implement and maintain large-scale data processing systems using Hadoop, Spark, Hive, Pig, Scala, Java, Python, R, SQL, NoSQL databases, distributed computing frameworks, cloud-based infrastructure, big data analytics tools, machine learning algorithms, data visualization tools, and other related technologies. You will be responsible for ensuring the scalability, reliability, security, and performance of these systems. You will also collaborate with cross-functional teams to identify business needs and develop technical solutions that meet those needs. This role requires strong analytical skills, attention to detail, excellent communication skills, ability to work in a fast-paced environment, and willingness to learn new technologies and adapt to changing requirements.