AI DevOps Engineer

Full-time or part-time (32–40 hours/week) | Starting immediately | Nationwide, hybrid or remote

Your RAG pipeline runs in a notebook, but nobody has put it into production? That's exactly what we solve. The UNITY AI Booster Team reliably, securely, and economically brings our clients' LLM and Agentic AI systems to live.

The UNITY AI Booster Team

The UNITY AI Booster Team is UNITY's development unit for the development and implementation of AI solutions in our clients' business processes. We develop solutions with a wide technology spectrum, from Machine Learning Use Cases, LLM Use Cases, or our own agent platforms. Unlike our consultants, we are closer to the code: we work in projects with the consultants and our Procurement X Team, but build and operate the technical platform behind it.

What awaits you

Build and operate infrastructure for productive AI applications – from the dev environment through CI/CD to stable operation at the client's site, and furthermore:

• Bring LLM and Agentic AI systems into operation: inference and model serving endpoints, vector databases, RAG pipelines, MCP servers – scalable, secure, cost-conscious.
• Take responsibility for observability and quality: latencies, token and infrastructure costs, agent tracing, automated eval and regression tests.
• Automate consistently instead of manual work: Infrastructure as Code, GitOps, containerized, reproducible deployments.
• Ensure security and compliance: secrets and access management, guardrails, traceability according to the EU AI Act.
• Advise clients on architecture and operational decisions – as a technical sparring partner*, not as a client manager*.

What you will learn here

• MLOps/LLMOps patterns in real customer operations instead of from a textbook.
• How to build AI systems that can withstand the EU AI Act, instead of repairing it afterwards.
• The leap from PoC to a productive, cost- and latency-conscious platform.

What you bring

• Several years of experience in software development and operation.
• Senior role: several years of practical experience in the design and operation of productive systems
• Solid DevOps foundation: Container/Kubernetes, CI/CD, agile development environment.
• Cloud experience (AWS, Azure, or GCP), deployment as container, API, or serverless.
• Practical experience with Infrastructure as Code (e.g., Terraform, Ansible, Helm, or GitOps).
• Python plus at least one other language (Go, TypeScript/JavaScript, Java, C#, or Shell).
• Basic understanding of LLM systems: RAG architectures, prompting, agent frameworks (e.g., LangChain, LangGraph, AutoGen, CrewAI).
• German C1, English B2 – confident in customer contact, able to lead a workshop occasionally.
• University degree in (Business) Informatics, Data Science, AI, or comparable – or equivalent practical experience as a career changer* e.g., with completed training as an IT System Integrator.

Ideally, you also bring:

• MLOps/LLMOps practice including evaluation of LLM pipelines.
• AI Observability tools (Langfuse, LangSmith, Arize, OpenTelemetry-based).
• Vector databases (Elasticsearch, pgvector, Qdrant or similar) and MCP (Model Context Protocol).
• Model Serving/GPU operation (vLLM, Ray, KServe, Triton), FinOps for AI workloads.
• Own open-source projects or community contributions.
• Willingness for occasional on-call duty (daytime only, compensated).

Who this is not for:

• Those who stop at the PoC and consider production operation someone else's problem.
• Those who want to completely avoid customer contact – you will speak with IT decision-makers at eye level, that's part of it.
• Those who prefer to evaluate tools rather than take responsibility for systems that must not fail at night.

Why the AI Booster Team & About Us

• You are closer to the code than in any consulting role. We are on-site in the project, but our result is running software, not a presentation.
• You will see your systems in action. We don't build on demand for an anonymous backlog, but for clients whose processes we know – and accompany the solution into operation.
• Technology breadth instead of monoculture: Machine Learning, LLM applications, and our own agent platforms – depending on the problem, not according to the standard procedure.
• Remote work is possible with us, not just tolerated: nationwide, hybrid, or fully remote.
• Further benefits: Flexible working models · Sabbaticals · personal coaching, mentoring & UNITYacademy · JobRad, UrbanSports, and much more · realization of your own ideas and entrepreneurial freedom · Realize your Big Five for Life with us**

About Us

UNITY is the management consultancy for innovation and digital transformation. We particularly focus on Artificial Intelligence as a key technology for efficiency and growth. With 380 employees, we are represented at 15 locations worldwide and conduct client projects around the globe.

Our locations where you can work nationwide: Berlin, Braunschweig, Frankfurt a. M., Hamburg, Cologne, Munich, Nuremberg, Paderborn/Büren, or Stuttgart.

* UNITY lives diversity and equal opportunity. Everyone is welcome here regardless of origin, gender, sexual orientation, disability, religion, and age.** The Big5forLife are a coaching impulse from the area of individual vision formation by John Strelecky.

Your personal contact

Apply now with just a few clicks. Find multiple positions interesting? One application is enough: your skills will be checked for all positions.

If you have questions about your application, feel free to contact Markus (Candidate Experience Manager). If you have technical questions, Moritz (Head of AI Development) looks forward to hearing from you.

Find Jobs in Germany on Arbeitnow