AI Solution Architect (m/f/d)

As an IT service provider, we are driving the digitalization of the public sector and creating real added value for millions of people in Germany. We are very good at many things, but not everything yet. That's why we are always looking for new colleagues who want to make a difference with their ideas, skills, and commitment. Do you feel addressed? Then shape your world for the better and become part of our Customer Cluster Environment, Transportation & Energy.

YOUR MISSION

As an AI Solution Architect (m/f/d), you will shape the overall AI/ML architecture for complex enterprise environments in the cloud with a focus on Microsoft Azure. You will combine in-depth knowledge of ML Engineering, RAG architectures, and MLOps to implement AI solutions that are production-ready, scalable, and secure. You will work closely with technical experts, business departments, and decision-makers, contributing significantly to the successful establishment of innovative AI solutions.

Your tasks:

• Design and further development of the overall AI/ML architecture as an enterprise AI platform with a focus on Microsoft Azure

• Technical leadership of ML pipeline projects, especially in the areas of training, deployment, monitoring, and drift detection

• Conceptualization and optimization of RAG architectures, for example regarding chunking, retrieval, guardrails, and context orchestration

• Definition and further development of MLOps strategies including CI/CD for models, experiment tracking, and model registry

• Technical leadership and coordination of interdisciplinary teams of ML/AI Engineers, LLM Engineers, and MLOps Engineers

• Consulting internal and external stakeholders on AI architectures and presenting technical concepts to IT management and business departments

WHAT IS IMPORTANT TO US

• In-depth experience with cloud-based AI/ML solutions, ideally on Microsoft Azure, particularly Azure Machine Learning and Azure OpenAI Service. Knowledge of other cloud and AI services is an advantage.

• Practical experience with MLOps concepts and corresponding tools such as MLflow, Kubeflow, or Azure ML Pipelines.

• Experience in building RAG architectures, prompt engineering, and working with vector databases.

• Knowledge in the integration and orchestration of language models, ideally with frameworks like LangChain or LlamaIndex.

• Experience with CI/CD for ML applications and very good Python skills.

• Practical experience with at least two common machine learning frameworks, such as scikit-learn, PyTorch, or TensorFlow.

• Experience in building enterprise architectures in cloud environments.

• Knowledge in adjacent areas such as data platforms, containerization, container orchestration, Infrastructure as Code, and observability is an advantage, for example with Databricks, Azure Data Factory, Azure Data Lake, Docker, Kubernetes, Terraform, Prometheus, Grafana, or Application Insights.

• Basic understanding of AI Governance, Responsible AI, as well as security and data protection requirements in the enterprise environment.

• Several years of experience with ML/AI architectures or comparable technical tasks in enterprise environments.

• Experience in a technical leadership or architecture role is desirable.

• Azure, AWS, or Google Cloud certifications are a plus.

• Ideally, experience in the energy or utility sector as well as with data-driven use cases.

• Very good German language skills (C2 level) and good English language skills.

YOUR NEW WORKPLACE

• What counts for us? Clearly defined roles, real teamwork, and a common goal. We call this Responsiveness – transparent, appreciative, and goal-oriented.

• Here you are directly involved in change, if you want. – Take part in projects that develop us as a company.

• Flexible working hours and remote work? – That goes without saying.

• Individual hardware budget? – Configure your workstation the way you feel most comfortable.

• Mental Health? – Your mental well-being is important to us. With OpenUp, we support you and offer you free access to professional psychological support at any time.

• Individual further education budget? – Whether it's the next certification or a long-awaited language course – you decide what and when you continue your education.

• Employee PC program? – Lease your next device for purely private use easily through virtual7.

• JobRad or company car? – We help you to be as mobile as you need to be.

Tell me who you are and when you can start. You can also reach me via

Find Jobs in Germany on Arbeitnow