Product-Oriented Project Manager / Product Owner KI-Anwendungen (LLM/RAG) (m/w/d)

• Team culture - regular highlights like summer festival, Christmas party, joint brunch or quarterly with lunch
• Workplace - modern equipped workspaces and break rooms, including free beverage supply
• Flat hierarchies - short communication paths and a company-wide employee app
• Bonus - job bike, occupational pension, wealth-effective benefits, and employee discounts at well-known companies
• Further education - exciting career opportunities and further education opportunities through our AVS Academy – including the modern training tool PLEGRO and our internal talent management program MOVE
• Safety - as a growing company in a future-proof industry, we offer you an unlimited employment contract
• Induction - a careful and personal induction
• Flexible work - two days of home office per week for full-time employees
• Modern workplace - ergonomic and height-adjustable desks
• Vacation - 30 days of holiday leave per year, plus one half-day holiday on Christmas Eve and New Year's Eve

• Product-oriented use case management with departments: use case scoping, clarification of requirements, and moderation of decisions; ensuring transparent, traceable prioritization along measurable benefit criteria
• Definition and maintenance of measurable success criteria, as well as coordination of suitable evaluation/benchmarks (including possibly structured evaluation processes like Human in the Loop, Golden Sets, continuous quality reports)
• Steering the end-to-end production setup of LLM-based applications (assistants, knowledge search, process automation) with a focus on RAG – including coordination of tests, releases, and operational handover
• Continuous product improvement together with the technical role: establishing and using feedback loops, tracking versioning (e.g. prompt/retriever changes) and deriving improvement measures from tracing/observability
• Ensuring operational quality and economy from a product perspective: transparency about regression tests, performance, and cost optimization, as well as monitoring/incident basics in close coordination with internal IT
• Coordination of integration into the company's IT together with IT and security stakeholders: coordination with APIs, authentication/authorization, role and permission concepts, logging/auditing, and interfaces to departmental systems
• Transparent technical consulting of stakeholders: understanding the possibilities and limitations of LLM/RAG solutions (functionality, limits, prompting patterns, tool use, retrieval strategies) for well-founded decisions

• Completed studies (business informatics, KI) or comparable qualification
• Fundamental understanding of LLMs to structure requirements and make decisions transparent
• Technical basic understanding for RAG systems and knowledge pipelines, as well as for retrieval & ranking to understand solution options and risks
• Understanding of production-oriented operations and quality management (LLMOps): evaluation/benchmarks, regression tests, tracing/observability, feedback loops, versioning, and cost/performance awareness – for steering and transparency, not for implementation
• Basic understanding of company IT integration (e.g. APIs, role and permission concepts, logging/auditing, interfaces to departmental systems) for effective coordination
• Communication and moderation skills to clarify requirements, coordinate stakeholders, and document decisions transparently
• Proven experience in leading KI projects
• Very good German and English skills in writing and speaking

• Additional security/compliance experience (PII handling, secrets, access controls) in regulated environments
• Experience with structured evaluation processes (e.g. Human in the Loop, Golden Sets, continuous quality reports)
• Multi-cloud experience or insights into the operation of larger platforms/services across multiple teams
• Experience in project management in the IT infrastructure and operations field with cross-functional coordination of IT stakeholders

Find Jobs in Germany on Arbeitnow