Scraping Tech Lead (Web scraping & Anti-bot)

Infatica.io is a global provider of proxy and DaaS solutions. We're building our own high-load web scraping platform: an API where you can submit any URL and receive clean HTML or structured JSON output, without worrying about proxies, CAPTCHAs, or anti-bot systems. The platform will support both cloud deployment and on-premises deployment in client infrastructure (on-prem, Kubernetes). We are now looking for an experienced Tech Lead for our web scraping development team who will lead the team to design, develop, test, and maintain this high-load platform. As a key member of our engineering team, you will be responsible for: • Leading the development of our web scraping platform, ensuring it meets the required performance, scalability, and reliability standards. • Collaborating with cross-functional teams to identify and prioritize features, and ensure timely delivery of high-quality products. • Mentoring junior team members, providing guidance and support to help them grow professionally. • Staying up-to-date with industry trends, best practices, and emerging technologies in web scraping, anti-bot systems, and related areas. • Developing and maintaining technical documentation, ensuring that it is accurate, comprehensive, and easy to understand. • Participating in code reviews, ensuring that the code is clean, efficient, and follows best practices. • Troubleshooting complex issues, identifying root causes, and implementing effective solutions. • Working closely with our DevOps team to ensure seamless integration of our platform with various infrastructure components. Requirements: • 5+ years of experience in leading web scraping development teams or similar roles. • Strong understanding of web scraping technologies, including but not limited to: HTML, CSS, JavaScript, and related frameworks (e.g., Puppeteer, Playwright). • Experience with anti-bot systems, CAPTCHAs, and other security measures used to prevent automated attacks. • Proficiency in programming languages such as Python, Java, or C++. • Knowledge of cloud platforms like AWS, Azure, Google Cloud, or similar infrastructure-as-a-service providers. • Familiarity with containerization using Docker, Kubernetes, or other container orchestration tools. • Experience with Agile development methodologies and version control systems like Git. • Strong analytical and problem-solving skills, with the ability to debug complex issues. • Excellent communication and collaboration skills, with the ability to work effectively in a distributed team environment. Benefits: • Opportunity to lead a high-load web scraping platform development project from scratch. • Collaborative and dynamic work environment with a global team of experts. • Competitive salary and benefits package. • Professional growth opportunities, including training, mentorship, and career advancement. • Flexible working hours and remote work options. If you're passionate about building scalable and reliable web scraping platforms, and have experience leading development teams, we'd love to hear from you! Please submit your resume, cover letter, and any relevant project examples or code snippets.