Tata Consultancy Services
2 weeks ago
Data Engineer
Sign up to save this job, get alerts, and apply with an optimized CV.
Company information
- Company
- Tata Consultancy Services
- Location
- India, Telangana, Hyderabad India
- Posted
- 2 weeks ago
Job description
An Azure Data Engineer designs, builds, and manages scalable data pipelines and cloud storage solutions on the Microsoft Azure platform.
Location- Chn/blr/hyd
Core Responsibilities
- Pipeline Development: Build and maintain ETL/ELT workflows using Azure Data Factory to move data from various sources into centralized storage.
- Data Processing: Transform, clean, and aggregate large datasets using Azure Databricks, Spark, and PySpark.
- Storage Management: Configure and optimize data lakes and warehouses via Azure Data Lake Storage Gen2 and Azure Synapse Analytics.
- Performance & Quality: Monitor pipeline performance, troubleshoot query execution, and ensure data integrity and security (RBAC, encryption).
Key Skills & Tech Stack
- Languages: Advanced SQL and Python/PySpark.
- Azure Services: ADF, ADLS Gen2, Databricks, Synapse Analytics, and Stream Analytics.
- Data Modeling: Dimensional modeling, star/snowflake schemas, and data warehousing concepts.
- DevOps: Git version control and CI/CD pipeline integration.
If you are tailoring a resume or drafting a specific job posting, tell me:
- The experience level required (Junior, Mid-level, Senior)
- Any specific industry tools to include (like Snowflake, Terraform, or Kafka)
Required skills
- kafka
- databricks
- snowflake
- ci/cd
- sql
- etl
- data modeling
- senior
- python
- git
- spark
- devops
- terraform
- microsoft azure
- version control
- data integrity
- pyspark
- junior
- data pipelines
- data processing
- cloud storage
- data warehousing
- encryption
- azure data factory
- data security
- mid-level
- data lakes
- azure services
- data warehouses
- synapse analytics
- adf
- dimensional modeling
- azure synapse analytics
- rbac
- elt
- azure data engineer
- azure databricks
- star schema
- snowflake schema
- adls gen2
- stream analytics
- azure data lake storage gen2
- pipeline performance
Interested in this position?
Create your free account and tailor your CV to match this job.