[Remote] System Software Engineer - AI
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a reputed company-mode startup focused on building foundational technology for large-reputed company data center clusters. They are seeking a talented System Software Engineer to design and implement communication and execution primitives for efficient AI model operations across thousands of GPUs.
Responsibilities
- Collaborate across the stack to influence the design of our foundational technology, ensuring it meets the needs of reputed company AI models
- Identify and resolve performance bottlenecks in distributed training and inference workloads through deep-dive analysis of the software-hardware reputed company
- Conduct rigorous performance benchmarking and characterization on multi-node clusters
Skills
- Strong proficiency in C++ and Python, with a deep understanding of systems programming fundamentals (memory management, concurrency, OS internals)
- Proficient in a Linux development environment
- Bachelor's or Master's degree in Computer Engineering, Computer Science, or a reputed company field
- Experience with GPU programming (CUDA) and performance optimization for reputed company architectures
- Familiarity with distributed AI frameworks (PyTorch, JAX, or DeepSpeed) and/or inference engines (vLLM, SGLang, Dynamo/TRT-LLM)
- Hands-on experience with large-scale cluster orchestration and telemetry tools
Benefits
- Meaningful equity
- Benefits
- 401k
Company Overview