AI Solution Architect (m/w/d)

We are driving the digitalization of the public sector forward and creating real added value for millions of people in Germany. We can do many things well, but not everything yet. That's why we're always looking for new colleagues who want to make a difference with their ideas, skills, and engagement. Do you feel addressed? Then shape your world for the better and become part of our Customer Cluster Environment, Transportation & Energy.

YOUR MISSION

As AI Solution Architect (m/w/d), you will design the overall architecture for complex enterprise environments on Azure. You connect fundamental knowledge in ML engineering, RAG architectures, and MLOps with a strong understanding of governance, compliance, and technical leadership. This way, you contribute to implementing AI solutions that are production-ready, scalable, and compliant.

Your tasks:

• Design and further development of the overall architecture for KI/ML on Azure as an enterprise KI platform

• Technical leadership of ML pipeline projects, particularly in the areas of training, deployment, monitoring, and drift detection, as well as conception and optimization of RAG architectures, for example, regarding chunking, retrieval, guardrails, and context orchestration

• Definition of MLOps strategies including CI/CD for models, experiment tracking, and model registry

• Technical leadership and coordination of an interdisciplinary team consisting of ML/AI engineers, LLM engineers, and MLOps engineers

• Counseling on AI governance, responsible AI, and EU AI Act compliance as well as stakeholder management through architecture presentations to IT leadership and departments

THIS IS WHAT WE CARE ABOUT

• Fundamental experience with Azure-based KI/ML solutions, particularly with Azure Machine Learning and Azure OpenAI Service; knowledge of further Azure AI services is an advantage. Additionally, you bring practical experience with MLOps concepts and corresponding tools, for example, MLflow, Kubeflow, or Azure ML Pipelines.

• Experience in building RAG architectures, prompt engineering, and handling vector data banks as well as knowledge of integrating language models via APIs. Experience with orchestration frameworks like LangChain or LlamaIndex is an advantage.

• Experience with CI/CD for ML applications as well as secure Python skills. Practical experience with at least two popular machine learning frameworks, such as scikit-learn, PyTorch, or TensorFlow.

• Experience in building enterprise architectures in cloud environments. Knowledge of adjacent areas like data platforms, containerization, container orchestration, infrastructure as code, and observability is an advantage, for example, with Databricks, Azure Data Factory, Azure Data Lake, Docker, Kubernetes, Terraform, Prometheus, Grafana, or Application Insights.

• Understanding of governance, security, and compliance requirements in regulated environments. Knowledge of relevant standards and regulations like ISO 27001, NIS2, BSI guidelines, or the EU AI Act as well as corresponding governance tools is an advantage.

• Mult-year experience with ML/AI architectures or comparable technical tasks in enterprise environments.

• Experience in a technical leadership or architecture role is desirable; relevant Azure certifications are a plus.

• Ideal experience in the energy sector or supply industry, with predictive maintenance, time series analysis, or public procurement processes like VgV and EVB-IT.

• Very good German language skills (native speaker level) as well as good English language skills

YOUR NEW WORKPLACE

• What matters to us? Clearly defined roles, genuine teamwork, and a common goal. We call that Responsiveness – transparent, value-based, and goal-oriented.

• You're directly involved in shaping our company's development if you want to be. – Take part in projects that further develop our company.

• Flexible working hours and remote work? – Are self-evident.

• Individual hardware budget? – Assemble your workspace as you like it best.

• Mental health? – Your mental well-being is important to us. With OpenUp, we support you and offer you free access to professional psychological support at any time.

• Individual further education budget? – Whether the next certification or a long-desired language course – you decide what and when you want to further educate yourself.

• Employee PC program? – Lease your next device for private use simply through virtual7.

• JobRad or company car? – We help you be as mobile as you need to be.

Tell me who you are and when you can start. Please also contact

Laura Korth

Senior HR Recruiterin

+49 170 3600221

Contact person: Laura Korth

Type of employment: Permanent employment

Find more English-speaking jobs in Germany on Arbeitnow