Nilasu Consulting Services Pvt Ltd
1 year ago
Databricks Snowflake Kafka Consultant
Sign up to save this job, get alerts, and apply with an optimized CV.
Company information
- Company
- Nilasu Consulting Services Pvt Ltd
- Location
- India, Karnataka, Bangalore India
- Posted
- 1 year ago
Job description
DataBricks/Kafka/Snowflake- Primary SkillsWork on Datalake project. Will create data pipelines and deploy in production. Work on Datalake project. Will create data pipelines and deploy in production.Technical: Databricks, ADF, Kafka and Snowflake. Github ,Airflow can be trained, snowpipe is optional .Healthcare Experience is required .
• 5+ years of experience in leading data migration efforts, transferring data from legacy systems to new platforms while ensuring data integrity and accuracy.• Collaborate with cross-functional teams including data analysts, software engineers, and stakeholders to analyze data requirements and develop effective and comprehensive migration strategies, API configurations, and backend architecture.• Implement data mapping, transformation, and validation procedures to ensure smooth data transition.• Expertise in ETL processes to extract, transform, and load data from diverse sources into our data warehouse and other systems.• Implement data quality checks, data profiling, and data cleansing techniques to maintain high data accuracy and consistency.• Work closely with the data governance team to adhere to data privacy and compliance policies.• Experience with cloud-based data solutions (e.g., AWS, Azure, Google Cloud).• Knowledge of database management systems (e.g., SQL Server, PostgreSQL, DynamoDB, MongoDB etc).• Understanding of data analytics and visualization tools (e.g., Tableau, Power BI).• Advanced knowledge of complex relational database design, implementation, administration.• Should be able to design & build scalable real-time reliable data processing pipelines using Apache Kafka.• Should have strong knowledge of APIs and microservices to support data connectivity and seamless integration across various applications and platforms "
• 5+ years of experience in leading data migration efforts, transferring data from legacy systems to new platforms while ensuring data integrity and accuracy.• Collaborate with cross-functional teams including data analysts, software engineers, and stakeholders to analyze data requirements and develop effective and comprehensive migration strategies, API configurations, and backend architecture.• Implement data mapping, transformation, and validation procedures to ensure smooth data transition.• Expertise in ETL processes to extract, transform, and load data from diverse sources into our data warehouse and other systems.• Implement data quality checks, data profiling, and data cleansing techniques to maintain high data accuracy and consistency.• Work closely with the data governance team to adhere to data privacy and compliance policies.• Experience with cloud-based data solutions (e.g., AWS, Azure, Google Cloud).• Knowledge of database management systems (e.g., SQL Server, PostgreSQL, DynamoDB, MongoDB etc).• Understanding of data analytics and visualization tools (e.g., Tableau, Power BI).• Advanced knowledge of complex relational database design, implementation, administration.• Should be able to design & build scalable real-time reliable data processing pipelines using Apache Kafka.• Should have strong knowledge of APIs and microservices to support data connectivity and seamless integration across various applications and platforms "
Required skills
Interested in this position?
Create your free account and tailor your CV to match this job.