GPU Infrastructure Specialist

Dear all, We are looking for a GPU Infrastructure Specialist to manage and optimize GPU-based environments for model hosting and high-performance computing workloads. The ideal candidate will have hands-on experience with NVIDIA/ AMD, SambaNova GPU ecosystems, and a strong background in resource management, performance tuning, and observability within large-scale AI/ML environments. Responsibilities Manage, configure, and maintain GPU infrastructure across on-premise and cloud environments. Hand-in-hand with the team, ensure seamless integration of new GPU-based workloads into existing infrastructure. Collaborate with data scientists to optimize model training and deployment processes leveraging GPU acceleration. Develop and implement monitoring and observability tools to track GPU utilization, memory usage, and performance metrics. Troubleshoot and resolve issues related to GPU resource contention, driver updates, and compatibility. Stay up-to-date with the latest advancements in GPU technology and best practices for GPU-based workloads. Requirements Strong understanding of GPU architecture, NVIDIA/ AMD, SambaNova GPU ecosystems, and their respective software stacks. Proficiency in Linux, Windows, and cloud environments (AWS, Azure, Google Cloud). Experience with containerization (Docker) and orchestration (Kubernetes) is a plus. Familiarity with AI/ML frameworks (TensorFlow, PyTorch, etc.) and data science tools (Jupyter Notebooks, etc.) is an asset. Certifications in GPU-related technologies or cloud platforms are highly valued. Benefits Competitive salary and benefits package. Opportunities for professional growth and development within the company. Collaborative and dynamic work environment.