AI Solution Architect (m/f/d)

As an IT service provider, we are driving the digitalization of the public sector and creating real added value for millions of people in Germany. We do many things very well, but not everything yet. That's why we are always looking for new colleagues who want to make a difference with their ideas, skills, and commitment. Do you feel addressed? Then shape your world for the better and become part of our Customer Cluster Environment, Transportation & Energy.

YOUR MISSION

As an AI Solution Architect (m/f/d), you will shape the overall AI/ML architecture for complex enterprise environments on Azure. You will combine in-depth knowledge of ML Engineering, RAG architectures, and MLOps with a strong understanding of governance, compliance, and technical leadership. In doing so, you will contribute to the implementation of AI solutions that are production-ready, scalable, and compliant.

Your tasks:

• Design and further development of the overall AI/ML architecture on Azure as an enterprise AI platform

• Technical leadership of ML pipeline projects, especially in the areas of training, deployment, monitoring, and drift detection, as well as conception and optimization of RAG architectures, for example with regard to chunking, retrieval, guardrails, and context orchestration

• Definition of MLOps strategies including CI/CD for models, experiment tracking, and model registry

• Technical leadership and coordination of an interdisciplinary team of ML/AI Engineers, LLM Engineers, and MLOps Engineers

• Consulting on AI Governance, Responsible AI, and EU AI Act compliance, as well as stakeholder management through architecture presentations to IT management and business departments

WHAT IS IMPORTANT TO US

• In-depth experience with Azure-based AI/ML solutions, especially with Azure Machine Learning and Azure OpenAI Service; knowledge of other Azure AI Services is an advantage. Furthermore, you bring practical experience with MLOps concepts and corresponding tools, such as MLflow, Kubeflow, or Azure ML Pipelines.

• Experience in building RAG architectures, prompt engineering, and working with vector databases, as well as knowledge in integrating language models via APIs. Experience with orchestration frameworks such as LangChain or LlamaIndex is an advantage.

• Experience with CI/CD for ML applications and solid Python skills. Practical experience with at least two common machine learning frameworks, such as scikit-learn, PyTorch, or TensorFlow.

• Experience in building enterprise architectures in cloud environments. Knowledge in adjacent areas such as data platforms, containerization, container orchestration, Infrastructure as Code, and observability is an advantage, for example with Databricks, Azure Data Factory, Azure Data Lake, Docker, Kubernetes, Terraform, Prometheus, Grafana, or Application Insights.

• Understanding of governance, security, and compliance requirements in regulated environments. Knowledge of relevant standards and regulations such as ISO 27001, NIS2, BSI guidelines, or the EU AI Act, as well as corresponding governance tools, is an advantage.

• Several years of experience with ML/AI architectures or comparable technical tasks in enterprise environments.

• Experience in a technical leadership or architect role is desirable; relevant Azure certifications are a plus.

• Ideally, experience in the energy industry or utility sector, with predictive maintenance, time series analysis, or public procurement procedures such as VgV and EVB-IT.

• Very good German skills (native speaker level) and good English skills

YOUR NEW WORKPLACE

• What counts with us? Clearly defined roles, genuine teamwork, and a common goal. We call it Responsiveness – transparent, appreciative, and goal-oriented.

• Here you are directly involved in change, if you wish. – Participate in projects that develop us as a company.

• Flexible working hours and remote work? – They are a matter of course.

• Individual hardware budget? – Assemble your workstation the way you feel most comfortable.

• Mental Health? – Your mental well-being is important to us. With OpenUp, we support you and offer you free access to professional psychological support at any time.

• Individual training budget? – Whether it's the next certification or a long-awaited language course – you decide what and when you train.

• Employee PC program? – Lease your next device for purely private use easily through virtual7.

• JobRad or company car? – We help you to be as mobile as you need to be.

Tell me who you are and when you can start. You are also welcome to reach out via

Find more English Speaking Jobs in Germany on Arbeitnow