(Senior) Test Automation Engineer, AI-Native (d/m/w) - Remote

We are shaping the future of work for over 3,000+ companies in German Mittelstand. Currently, we are building our next product generation completely new (Laravel/Vue.js) and developing parallel new AI products that rethink project work from scratch. For this, we are looking for a Test Automation Engineer who lives AI. Claude, Cursor, and Playwright with AI-Codegen are not experiments but your everyday toolkit. You write tests in hours, which others need days for. You understand that modern quality assurance today comes from the combination of handcrafted test excellence and AI levers. And you know: AI products are tested differently than classical software.

Aufgaben

• Setup and operation of a modern, AI-supported test strategy for our next product generation (Laravel/Vue.js)
• End-to-End test automation with Playwright or similar, including AI-generated test case generation and self-healing tests
• Quality assurance of our AI products: evaluation of LLM outputs, prompt tests, hallucination checks, and behavior tests for agent workflows
• Setup of a test pyramid with developers (Unit, Integration, E2E), close integration in CI/CD
• Ai-supported bug reproduction and root cause analysis, translation of customer tickets into reproducible tests
• Closely working with developers, product managers, and the Co-CEO

Qualifikation

AI-Native Toolset (what you already actively use):

• Test automation with Playwright, Cypress or similar, ideally with AI-Codegen
• Daily Driver like Claude or ChatGPT for test case generation, edge-case analysis, and test code
• Cursor or similar AI-IDEs to quickly understand Vue.js and Laravel code and write corresponding tests
• Ideal experience with LLM evaluation (Promptfoo, Braintrust, LangSmith or self-built Eval pipelines)
• Understanding of MCP, agent workflows, or custom GPTs and how to systematically test them
• You understand the difference: You know when an AI-generated test is enough and when handcrafted test thinking with precise assertions makes the difference
• Experience with CI/CD (GitHub Actions, GitLab CI), Git, and pull-request-based work
• Outstanding understanding of API tests (REST), databases (MySQL/Postgres), and web architectures. Mobile Apps (iOS & Android) is a plus.

Benefits

• Fully equipped with all AI tools you need (Claude Max, Cursor, Playwright, subscription of your choice)
• 30 days' vacation and unlimited employment contracts
• Remote First Company & flexible working hours – work from anywhere in Germany!
• Support with home office setup, free laptop selection & monthly voucher for various benefits or sports memberships & jobrad
• Chances, freedoms, and opportunities to shape a startup connected with the security of an established company over 25 years in Mittelstand

We look forward to your application!

Find Jobs in Germany on Arbeitnow