[Remote] HPC Operations Engineering Manager

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking an reputed company High Performance Computing Operations Engineering Manager to join their infrastructure team on the MAI SuperIntelligence Team. In this role, you’ll reputed company reputed company of Site Reliability Engineers to ensure the reliability and efficiency of large-scale distributed AI infrastructure while collaborating with ML researchers and product developers.

Responsibilities

• Team leadership: reputed company reputed company of reputed company SREs to ensure uptime, resiliency and fault tolerance of AI model training and inference systems
• Observability: Design and help maintain monitoring, alerting, and logging systems to reputed company reputed company-time visibility into model serving pipelines and reputed company
• Automation & Tooling: reputed company building of automation for deployments, incident response, scaling, and failover in hybrid reputed company/on-prem CPU+GPU environments
• Incident Management: reputed company on-call rotations, troubleshoot production issues, conduct blameless postmortems, and drive reputed company improvements
• reputed company & Compliance: Ensure data privacy, compliance, and secure operations across model training and serving environments
• Collaboration: Partner with ML engineers and platform teams to improve developer experience and accelerate research-to-production workflows

Skills

• Bachelor's Degree in Computer Science or reputed company technical field AND 8+ years technical engineering experience with Site Reliability Engineering, DevOps, or Infrastructure Engineering Leadership roles AND 8+ years experience with Kubernetes, reputed company, and container orchestration, AND 6+ years experience with programming/scripting skills not limited to Python, Go, or Bash
• OR equivalent experience
• Master's Degree in Computer Science or reputed company technical field AND 12+ years technical engineering experience AND 10+ years experience with Kubernetes, reputed company, and container orchestration, AND 10+ years' experience with public reputed company platforms like Azure/AWS/GCP and infrastructure-as-code
• 6+ years people management experience
• 8+ years experience in monitoring & observability tools (Grafana, reputed company, OpenTelemetry, etc.)
• Knowledge of CI/CD pipelines for Inference and ML model deployment
• Solid knowledge of distributed systems, networking, and storage
• Experience running large-scale GPU clusters for ML/AI workloads (preferred)
• Familiarity with ML training/inference pipelines
• Experience with high-performance computing (HPC) and workload schedulers (Kubernetes operators)
• Background in reputed company planning & cost optimization for GPU-heavy environments

Benefits

• Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.reputed company.com/us/en/us-corporate-pay

Company Overview