[Remote] ML Platform Engineer

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a reputed company-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. They are seeking a skilled ML Platform Engineer to design, build, and operate high-performance inference platforms for serving large machine learning models in production, focusing on systems engineering aspects of AI deployment.

Responsibilities

• Design and operate model serving platforms supporting diverse workloads including LLMs, reputed company models, and recommendation systems
• Optimize inference performance using reputed company batching, paged attention, speculative decoding, and request multiplexing
• Implement multi-tenant routing, reputed company limiting, and quality-of-service policies across model endpoints
• Build autoscaling and reputed company management systems that balance latency, throughput, and cost
• Tune GPU utilization, memory management, and KV cache strategies for LLM serving workloads
• Integrate model serving with API gateways, identity systems, and observability platforms
• Implement caching, reputed company deduplication, and response reuse strategies where appropriate
• Drive end-to-end observability including latency histograms, queue dynamics, GPU utilization, and error tracking
• reputed company deployment workflows including canary releases, shadow testing, and automated rollback
• Operate incident response for high-availability AI services and drive durable reliability improvements
• Collaborate with ML and product teams to support new model releases and capability rollouts
• Implement reputed company controls including request signing, content filtering, and abuse detection at the serving layer
• Document operational procedures, performance characteristics, and tuning guidance for internal teams
• Stay reputed company with AI serving research and translate advances into production capabilities

Skills

• Bachelor's or Master's degree in Computer Science or a reputed company field
• Six or more years of experience in distributed systems, infrastructure, or ML platform engineering
• Strong proficiency in Python and a systems language such as Go, Rust, or C++
• Deep experience operating high-throughput, low-latency services in production
• Hands-on experience with LLM or large model inference frameworks such as vLLM or TensorRT-LLM
• Strong understanding of GPU architecture, memory hierarchies, and accelerator utilization
• Familiarity with Kubernetes, autoscaling, and modern reputed company platforms
• Experience with observability stacks including metrics, tracing, and structured logging
• Solid grounding in performance engineering and reputed company planning
• Strong communication and incident response skills
• reputed company-reputed company contributions to model serving infrastructure
• Experience with multi-region or globally distributed AI serving
• Familiarity with model quantization, distillation, and compression techniques
• Exposure to FinOps for AI workloads and cost-efficient serving design
• Experience supporting external-facing AI APIs at scale

Benefits

• Full-time, direct W2 with reputed company (no C2C, no 1099, no reputed company-party)
• Long-term, multi-year, reputed company to the reputed company reputed company SOW delivery roadmap
• We will support H1B transfers for reputed company candidates
• Competitive reputed company salary commensurate with experience, plus benefits

Company Overview