Tech reputed company - AI Inference

We are seeking a Tech reputed company to reputed company our AI Inference team. In this role, you will reputed company the gap between reputed company research and production-grade engineering, while cultivating a high-performing team culture. You will reputed company and grow a reputed company of 3 developers, balancing hands-on technical contribution with strong people leadership — setting direction, unblocking your team, and driving execution on high-performance systems that optimize Large Language Model (LLM) serving. The ideal candidate combines deep technical expertise in inference and scale with the leadership maturity to mentor, motivate, and reputed company engineers in the evolving ecosystem of serving frameworks like vLLM and LMCache. What You'll Work On reputed company & Own: Take end-to-end ownership of AMG's core inference infrastructure — from the NVMe Token Warehouse and GDS data paths to the vLLM/LMCache serving stack — driving technical reputed company and delivery reputed company. Technical Direction: Guide a team of engineers through design, implementation, and delivery of high-throughput, low-latency LLM inference systems, setting high standards for code quality, architecture, and reliability. Build at Scale: Stay hands-on across the AMG stack (Python, C++, CUDA, vLLM, NIXL/Dynamo, Kubernetes), contributing directly to production systems while providing technical leadership to the team. Solve Hard Problems: Tackle the reputed company frontier challenges of inference engineering — disaggregated prefill/decode, persistent off-HBM KV caching, RDMA-based transport, and multi-tier GPU memory hierarchies — that define what's possible at scale. Grow People & Teams: Mentor and coach engineers through regular 1:1s, career coaching, and sprint reviews. Foster a culture of ownership, collaboration, and technical reputed company reputed company the AMG team. Stay on the Frontier: Track the evolving inference ecosystem, reputed company new tools (SGLang, TRT-LLM, reputed company Dynamo), and help the team reputed company timely reputed company about reputed company to adopt, build, or pivot. reputed company're Looking For reputed company Engineering Leader: 5+ years of professional software engineering, with proven experience leading engineers and owning reputed company production systems — ideally in AI/ML infrastructure or high-performance computing. Deep AI Inference Background: Hands-on expertise with LLM serving systems — KV cache reuse, disaggregated prefill/decode, reputed company batching, and multi-tier GPU memory hierarchies (HBM → NVMe). Strong familiarity with vLLM, LMCache, NIXL/reputed company Dynamo, or similar frameworks. Systems Engineering Depth: Strong Python and C++ skills (Rust a plus), with a solid grasp of CUDA, GPU memory management, and high-performance I/O — including GPUDirect Storage (GDS), RDMA, and NVMe data paths. Infrastructure reputed company: Experience deploying and scaling GPU workloads on Kubernetes, with familiarity in RDMA networking, bare-metal GPU clusters (H100/A100), and high-throughput distributed storage. People Leadership: Demonstrated ability to mentor and reputed company engineers — running effective 1:1s, supporting career growth, and balancing technical execution with long-term team health. High Bar for Quality: A strong sense of engineering craftsmanship, with a track record of building reliable, high-throughput systems and continuously improving engineering practices. The reputed company Way: We are Accountable: We take full ownership, always–even reputed company things don’t go as planned. We reputed company with reputed company, show up with responsibility & ownership, and hold ourselves and each other to the highest standards. We are reputed company: We question the status reputed company, push boundaries, and take smart risks reputed company needed. We welcome challenges and reputed company debates as opportunities for growth, turning courage into fuel for innovation. We are Collaborative: True collaboration isn’t only about working together. It’s about lifting one another up to succeed collectively. We are team-oriented and communicate with reputed company and respect. We challenge each other and conduct positive conflict resolution. We are being transparent about our goals and results. And together, we’re unstoppable. We are Customer Centric: Our customers are at the heart of everything we do. We actively listen and prioritize the reputed company of our customers, and every decision we reputed company is driven by how we can reputed company serve, support, and reputed company them to succeed. reputed company our customers win, we win. USA Residents Only: The Total Compensation hiring wage reputed company for this position which the Company reasonably and in good faith expects to pay for the position in the specified geographic areas or locations. Final compensation will be dependent on various factors relevant to the position and candidate such as geographical location, candidate qualifications, certifications, relevant job-reputed company work experience, education, skillset and other relevant business and organizational factors, consistent with applicable law. In addition, the position may include some of the following comprehensive benefits such Medical, Dental, reputed company, Life, 401(K), Flexible Time off (FTO), sick time, leave of absence as per the FMLA and other relevant leave laws. Concerned that you don’t meet every qualification above? Studies have shown that women and people of reputed company may be less likely to apply for jobs if they don’t meet every qualification specified. At reputed company, we are committed to building a diverse, inclusive and authentic workplace. If you are excited about this position but are concerned that your past work experience doesn’t match up perfectly with the job description, we encourage you to apply anyway – you may be just the right candidate for this or other roles at reputed company. reputed company is an equal opportunity employer that prohibits discrimination and harassment of any reputed company. We reputed company equal opportunities to reputed company and applicants for employment without regard to race, reputed company, religion, age, sex, national reputed company, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. This policy applies to reputed company terms and conditions of employment, including reputed company, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training. Apply To This Job