DevOps/Platform Expert (AI & Agentic Systems)

Cloudiax is a leading provider of cloud technologies with more than 280 international partners and over 1100 SAP customers in 90 countries. We enable small and medium-sized enterprises worldwide to use applications like SAP Business One and AI solutions on our cloud. As a global market leader, we offer a secure, fast, and reliable cloud platform – Made in Germany.

We have data centers in Germany, Canada, and Singapore, ensuring around-the-clock high-quality service.

To strengthen our team, we are looking for you – engaged, technically strong, and willing to take responsibility. Starting immediately and remote.

Aufgaben

Cloud-Native & Infrastruktur

• Kubernetes: Deep experience in cluster orchestration, GPU scheduling, device plugins, and tenant isolation in data centers.
• Hardware-Abstraktion: Practical experience with Multi-Instance GPU (MIG) for efficient, secure partitioning of physical GPUs across different customer workloads.
• Managed Backends: Secure operation of managed Postgres and scaling of vector databases for performant retrieval architectures.
• Schnittstellen & Security: Knowledge in Keycloak, Kong API Gateway or similar tools for secure access and accurate billing.
• DevOps & CI/CD: Experience with Git, CI/CD pipelines, and infrastructure-as-code for fast, reliable, and documented deployments.

KI-Expertise & Inferenz-Logik

• Inferenz-Optimierung: Experience with KV-caching, batching, quantization, and serving frameworks like vLLM or NVIDIA Triton.
• Modell-Kombination & Kostenmanagement: Knowledge on combining small specialized and large generalist models to optimize costs and latency – Open and Closed Models.
• Qualitätssicherung: Techniques for reducing hallucinations, e.g. Retrieval-Augmented Generation (RAG) and providing valid data contexts at infrastructure level.
• Agenten & Frameworks: Operationalization of LangChain, LangGraph or AutoGen, as well as management of complex deep agents that autonomously execute multiple steps.

Monitoring & Skalierung (AI-Native)

• Observability: Tracing for agent decisions (e.g. OpenTelemetry, LangSmith), making workflows in the data center traceable.
• KI-spezifisches Auto-Scaling: Scaling based on token throughput or model context utilization, not just CPU metrics.

Qualifikation

You don't have to be a prompt engineer, but you understand how AI "works." What's important is that you can quickly grasp new approaches (e.g. inference methods or agent structures) and integrate them into stable, tenantable data center infrastructure.

• Experimentierfreude: Enjoyment of systems that do not always react deterministically.
• Security & Safety: Awareness of AI security (sandboxing, protection against prompt injections) at every system level.

Benefits

100% remote work location with great temporal flexibility

• Attractive annual salary, as well as automatic KPI-based salary increases and attractive year-end bonuses.
• 30+ days of vacation time.
• Fully equipped premium home office workspace.
• Company-(e)bike, occupational health insurance, and other corporate benefits.
• Working in an international environment at one of the world's leading cloud providers in the SAP field.

Have we piqued your interest? Then please feel free to upload your complete application documents (CV, certificates, salary expectations, earliest possible start date).

Find more English-speaking jobs in Germany on Arbeitnow