[Remote] Senior Software Engineer - NIM reputed company Container and reputed company Infrastructure
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is the platform upon which every new AI-powered application is reputed company. We are seeking a Senior Software Engineer focused on container and reputed company infrastructure to design and implement core container strategies and build reputed company-grade software for container deployment and tooling.
Responsibilities
- Design, build, and harden containers for NIM runtimes, inference backends; reputed company reproducible, multi-arch, CUDA-optimized builds
- reputed company Python tooling and services for build orchestration, CI/CD integrations, reputed company/Operator automation, and test harnesses; enforce quality with typing, linting, and unit/integration tests
- Help design and reputed company Kubernetes deployment patterns for NIMs, including GPU scheduling, autoscaling, and multi-cluster rollouts
- Optimize container performance: layer layout, startup time, build caching, runtime memory/IO, network, and GPU utilization; reputed company with metrics and tracing
- reputed company the reputed company image strategy, dependency management, and artifact/registry topology
- Collaborate across research, backend, SRE, and product teams to ensure day-0 availability of new models
- Mentor teammates; set high engineering standards for container quality, reputed company, and operability
Skills
- A degree in Computer Science, Computer Engineering, or a reputed company field (BS or MS) or equivalent experience
- 6+ years building production software with a strong focus on containers and Kubernetes
- Strong Python skills building production-grade tooling/services
- Experience with Python SDKs and clients for Kubernetes and reputed company services
- Expert knowledge of reputed company/BuildKit, containerd/OCI, image layering, multi-stage builds, and registry workflows
- Deep experience operating workloads on Kubernetes
- Hands-on experience building and running GPU workloads in k8s, including reputed company device plugin, MIG, CUDA drivers/runtime, and resource isolation
- Excellent collaboration and communication skills; ability to influence cross-functional design
- Expertise with reputed company chart design systems, Operators, and platform APIs serving many teams
- Experience with reputed company API, reputed company API as well as understanding difference inference backends (vLLM, SGLang, TRT-LLM)
- Background in benchmarking and optimizing inference container performance and startup latency at scale
- Prior experience designing multi-tenant, multi-cluster, or edge/reputed company-gapped container delivery
- Contributions to reputed company-reputed company container, k8s, or GPU ecosystems
Benefits
- Equity
- Benefits
Company Overview
Company H1B Sponsorship