Backend Spark Developer

Miejsce pracy: Warszawa Technologies we use Expected Spark SQL Git GitHub Scala Optional Python Bash Airflow Control-M Microsoft Azure AWS Databricks S3 Kubernetes Docker EMR Operating system Linux About the project The position of Backend Spark Developer involves developing, testing, and deploying technical and functional specifications provided by Solution Designers, Business Architects, and Business Analysts. The role ensures correct operability and compliance with internal processes and standards. Key responsibilities: • Developing, testing, and deploying data processing pipelines using Apache Spark SQL, Scala, Python, and other technologies as required. • Collaborating with cross-functional teams to design, develop, test, and deploy data processing solutions that meet business requirements. • Ensuring the correct operability of developed solutions in production environments. • Participating in code reviews and ensuring adherence to coding standards and best practices. • Staying up-to-date with new technologies and trends in the field of big data and analytics. • Providing technical guidance and support to other team members as needed. • Developing and maintaining documentation for developed solutions. The ideal candidate will have: • Strong experience in developing, testing, and deploying data processing pipelines using Apache Spark SQL, Scala, Python, and other technologies as required. • Experience with cloud-based platforms such as Microsoft Azure, AWS, or Google Cloud Platform. • Knowledge of Linux operating systems and ability to work in a Linux environment. • Familiarity with containerization technologies such as Docker. • Strong analytical and problem-solving skills. • Excellent communication and collaboration skills. • Bachelor's degree in Computer Science, Information Technology, or related field. • 3+ years of experience in software development, preferably in the field of big data and analytics. What we offer: • Competitive salary and benefits package. • Opportunity to work on challenging projects with a talented team. • Professional development opportunities. • Flexible working hours and remote work options. • Access to cutting-edge technologies and tools.