Ploy Asia PTE LTD
10 months ago
AWS Pyspark Developer
Sign up to save this job, get alerts, and apply with an optimized CV.
Company information
- Company
- Ploy Asia PTE LTD
- Location
- Singapore Singapore
- Posted
- 10 months ago
Job description
AWS Pyspark Developer
What's on Offer:
- Industry: Consulting
- Location: Singapore
- 12 months contract role (with the possibility of extension)
- Competitive Compensation
Job Description:
- Design, develop, and maintain data pipelines and ETL processes using PySpark on distributed systems.
- Implement scalable solutions on AWS cloud services (e.g., S3, EMR, Lambda).
- Optimize data workflows for performance and reliability.
- Collaborate with data engineers, analysts, and business stakeholders to deliver high-quality
solutions.
- Ensure data security and compliance with organizational standards.
Job Requirements:
- AWS: Hands-on experience with core AWS services for data engineering.
- Python: Strong programming skills for data processing and automation.
- PySpark: Expertise in distributed data processing and Spark framework.
- SQL: Proficiency in writing complex queries and optimizing performance
Good to Have:
- Databricks: Experience with Databricks platform for big data analytics.
- Knowledge of CI/CD pipelines and DevOps practices.
- Familiarity with data lake and data warehouse concepts.
Required skills
Interested in this position?
Create your free account and tailor your CV to match this job.