AI Solution Architect (m/f/d)

As an IT service provider, we drive the digitalization of the public sector and create real added value for millions of people in Germany. We are very good at many things, but not yet at everything. That's why we are always looking for new colleagues who want to make a difference with their ideas, skills, and commitment. Do you feel addressed? Then shape your world for the better and become part of our Customer Cluster Environment, Transportation & Energy.

YOUR MISSION

As an AI Solution Architect (m/f/d), you will shape the overall AI/ML architecture for complex enterprise environments in the cloud with a focus on Microsoft Azure. You will combine in-depth knowledge of ML Engineering, RAG architectures, and MLOps to implement AI solutions that are production-ready, scalable, and secure. You will work closely with technical experts, business departments, and decision-makers, contributing significantly to the successful establishment of innovative AI solutions.

Your tasks:

• Design and further development of the overall AI/ML architecture as an Enterprise AI Platform with a focus on Microsoft Azure

• Technical leadership of ML pipeline projects, especially in the areas of training, deployment, monitoring, and drift detection

• Conception and optimization of RAG architectures, for example with regard to chunking, retrieval, guardrails, and context orchestration

• Definition and further development of MLOps strategies, including CI/CD for models, experiment tracking, and model registry

• Technical leadership and coordination of interdisciplinary teams of ML/AI Engineers, LLM Engineers, and MLOps Engineers

• Consulting internal and external stakeholders on AI architectures and presenting technical concepts to IT management and business departments

WHAT IS IMPORTANT TO US

• In-depth experience with cloud-based AI/ML solutions, ideally on Microsoft Azure, especially Azure Machine Learning and Azure OpenAI Service. Knowledge of other cloud and AI services is an advantage.

• Practical experience with MLOps concepts and corresponding tools such as MLflow, Kubeflow, or Azure ML Pipelines.

• Experience in building RAG architectures, prompt engineering, and working with vector databases.

• Knowledge in the integration and orchestration of language models, ideally with frameworks like LangChain or LlamaIndex.

• Experience with CI/CD for ML applications and very good Python skills.

• Practical experience with at least two common machine learning frameworks, such as scikit-learn, PyTorch, or TensorFlow.

• Experience in building enterprise architectures in cloud environments.

• Knowledge in adjacent areas such as data platforms, containerization, container orchestration, Infrastructure as Code, and observability are an advantage, for example with Databricks, Azure Data Factory, Azure Data Lake, Docker, Kubernetes, Terraform, Prometheus, Grafana, or Application Insights.

• Basic understanding of AI Governance, Responsible AI, as well as security and data protection requirements in the enterprise environment.

• Several years of experience with ML/AI architectures or comparable technical tasks in enterprise environments.

• Experience in a technical leadership or architecture role is desirable.

• Azure, AWS, or Google Cloud certifications are a plus.

• Ideally, experience in the energy sector or utility industry as well as with data-driven use cases.

• Very good German skills (C2 level) and good English skills.

YOUR NEW WORKPLACE

• What counts with us? Clearly defined roles, real teamwork, and a common goal. We call it Responsiveness – transparent, appreciative, and goal-oriented.

• Here you are directly involved in change, if you wish. – Take part in projects that develop us as a company.

• Flexible working hours and remote work? – These are a matter of course.

• Individual hardware budget? – Put together your workspace the way you feel most comfortable.

• Mental Health? – Your mental well-being is important to us. With OpenUp, we support you and offer you free access to professional psychological support at any time.

• Individual further education budget? – Whether it's the next certification or a long-awaited language course – you decide what and when you further your education.

• Employee PC program? – Simply lease your next device for purely private use through virtual7.

• JobRad or company car? – We help you to be as mobile as you need to be.

Tell me who you are and when you can start. Also feel free to reach out via

Find more English Speaking Jobs in Germany on Arbeitnow