Python PySpark Engineer @ Spyrosoft

Requirements: Excellent knowledge of PySpark / Python Great knowledge of ETL/ELT processes Experience with working with data lake systems (preferably Palantir Foundry ) for data ingestions Practice with creating documentation on the Confluence platform Ability to use ticketing systems such as JIRA and/or Azure DevOps Familiarity with Snowflake infrastructure as an advance Ability to work in an agile BI team (DevOps) and to share skills and experience Fluency in English The project is expected to involve working closely with data engineers, analysts, and other stakeholders to design, develop, and implement data pipelines using PySpark. This role will be responsible for designing, developing, and implementing data pipelines using PySpark, as well as collaborating with the team to ensure that all deliverables meet the required standards. The ideal candidate should have a strong understanding of ETL/ELT processes and experience working with data lake systems.