Senior Data Engineer (Web Scraping & APIs)

Position: Senior Data Engineer (Web Scraping & APIs) Please Note: We are seeking candidates with 3 to 4 years of relevant experience who are available to join immediately Work Mode: Work from Office Work Location: Sector 23, Dwarka, Delhi Job Summary We are looking for a highly skilled Senior Data Engineer with expertise in web scraping, advanced Python, SQL, and API integration . The ideal candidate will build robust data extraction pipelines , manage large-scale structured and unstructured data sets, develop scalable APIs, and collaborate with cross-functional teams to drive business insights. Key Responsibilities: • Design, develop, and maintain complex data pipelines using Python, Apache Beam, and other relevant tools • Develop and integrate APIs using Python, Flask, and Django • Extract and process large datasets from various sources (e.g., web scraping, databases) • Collaborate with data scientists and analysts to design and implement data-driven solutions • Work closely with the data engineering team to ensure seamless integration of data pipelines and APIs • Participate in code reviews and contribute to the development of best practices for data engineering • Stay up-to-date with industry trends and emerging technologies in data engineering • Bachelor's or Master's degree in Computer Science, Data Engineering, or related field • 3-4 years of experience in data engineering, web scraping, and API integration • Strong understanding of Python, SQL, and data structures • Experience with Apache Beam, Flask, Django, and other relevant tools • Excellent problem-solving skills, attention to detail, and ability to work independently • Strong communication and collaboration skills • Ability to work in a fast-paced environment and prioritize tasks effectively • Familiarity with cloud-based technologies (e.g., AWS, Google Cloud) is a plus Benefits: • Competitive salary package • Comprehensive health insurance • Flexible working hours • Opportunities for professional growth and development • Collaborative and dynamic work environment