AI Quality Engineering Intern (m/w/d)

Your Mission

You will help us build a standardized testing environment for our AI solution – so that our system is reliable, understandable, and measurable in doing what it's supposed to do. You will work closely with the engineering and product team together and be guided by the AI Engineering Lead.

Tasks

Your Tasks

• Co-create testing infrastructure – setting up and maintaining our test environment for AI agents (including PyTest and OpenTelemetry)
• Develop model companies – creating realistic example companies in our database (PostgreSQL) that reflect real customer scenarios and enable robust test scenarios
• Quality assurance – systematically uncovering desired and undesired system behavior of our AI agents (LangGraph / LangChain) and RAG-Pipeline (Weaviate) and making it understandable
• Evaluation Suite – defining expected system behavior together with the product team and implementing it in automated tests – including comparisons of different LLM providers and models

Qualification

You bring this

Must-haves:

• Ongoing studies (e.g. AI/ML, Computer Science, Cognitive Sciences, etc.)
• Fundamental programming knowledge – you can read and understand code
• Basic understanding of generative AI (LLMs, Prompting, typical strengths and weaknesses)
• Structured, analytical thinking
• Very good English skills (working language); good German skills a plus

Nice-to-have:

• First experience with Python and/or testing frameworks
• Interest in or experience with RAG systems, prompt engineering, or LLM evaluation

Benefits

What you can expect from us

• Earned ownership – your tests have a direct impact on product quality
• Learning in the team – you will work directly with product and engineering together and be guided by the AI Engineering Lead
• International environment – a team with self-responsibility and an AI-first mindset
• Flexibility – 20 hours per week, freely scheduleable, remote-friendly
• Perspective – the opportunity to link your thesis topic to your work here and the chance to grow with us

Send us your CV and a few sentences on why you're interested in AI testing. Optional: projects or code examples.

Find Jobs in Germany on Arbeitnow