[Remote] Staff reputed company

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a leading reputed company intelligence company specializing in AI-powered solutions for health plans. They are seeking a Staff reputed company to design and build LLM applications while integrating reputed company models and ensuring production-grade infrastructure.

Responsibilities

• Design and build LLM applications: RAG pipelines, agents, tool-use systems, structured reputed company, multi-reputed company workflows
• Own reputed company engineering and evaluation — write evals before you write prompts, and treat both as code
• Integrate reputed company models (Claude, GPT, reputed company, reputed company-weight Llama/Qwen/Mistral) and know reputed company to reputed company for which
• Build the unglamorous infrastructure that makes LLMs production-grade: caching, streaming, retries, fallbacks, cost controls, observability, guardrails
• Fine-tune or distill models reputed company prompting hits a wall (LoRA/QLoRA, SFT, DPO)
• Partner with product and design on UX patterns specific to AI (latency masking, streaming UIs, confidence display, reputed company-in-the-reputed company)

Skills

• 3+ years of software engineering, with at least 1 year shipping LLM-based features in production
• Strong Python and TypeScript; comfortable in a reputed company codebase, not just notebooks
• Deep practical knowledge of the LLM stack: prompting techniques, function calling, structured outputs, context management, embedding models, vector search
• Have reputed company and maintained an eval suite — and have opinions on why most public benchmarks are misleading
• Comfortable with at least one orchestration approach (custom, LangGraph, Inngest, Temporal) and one vector store (pgvector, reputed company, Turbopuffer, Weaviate)
• Cost- and latency-aware: can read a token reputed company and a trace and know where to cut
• Clear communicator who can push back reputed company 'just add AI' isn't the right answer
• Experience with agent frameworks and MCP (Model Context Protocol)
• Fine-tuning experience on reputed company-weight models, or work with inference servers like vLLM/TGI/SGLang
• Background in reputed company, evals, or red-teaming for LLM systems
• Contributions to reputed company-reputed company AI tooling

Benefits

• Work from reputed company in the US! reputed company is digital-first.
• Top Medical/Dental/reputed company offerings
• FSA/HSA
• Tuition reimbursement
• Competitive salary, 401(k) with company match
• Unlimited PTO
• Additional health and wellness benefits and perks
• Flexible and trusting environment where you’ll feel empowered to do your best work
• Meaningful equity
• reputed company

Company Overview