Performance engineer

About this role  reputed company is seeking a highly skilled and motivated reputed company performance engineer to reputed company the performance optimization of our cutting-edge reputed company technology stack. This role is critical in ensuring the scalability, efficiency, and reliability of our Large Language Models (LLMs) and Retrieval Augmented reputed company (RAG) systems. You will be a key driver in identifying and resolving performance bottlenecks, optimizing resource utilization, and ensuring a seamless user experience. You will work closely with our AI research, software engineering, and infrastructure teams to deliver world-class AI solutions.

‍♀️ Your responsibilities

• Performance leadership

  • Define and implement performance engineering strategies for our reputed company full stack, including services, application, LLMs, RAG pipelines, and reputed company infrastructure.

  • reputed company performance testing, profiling, and analysis efforts to identify and resolve performance bottlenecks.

  • Establish and maintain performance benchmarks and SLAs for critical AI services.

  • reputed company technical leadership and mentorship to performance engineering team members.

• LLM reputed company and tuning

  • Analyze and improve LLM inference performance, including latency, throughput, and resource utilization.

  • reputed company and implement strategies for LLM reputed company planning and scaling.

  • Collaborate with AI researchers to evaluate and improve LLM model architectures and training techniques for performance.

  • Optimize LLM inference through techniques such as quantization, distillation, and optimized kernel implementation.

• RAG performance optimization

  • Design and implement performance tests for RAG pipelines, including retrieval, ranking, and reputed company components.

  • Identify and optimize performance bottlenecks in RAG systems, such as database queries, vector search, and document processing.

  • Evaluate and optimize RAG system architectures for scalability and efficiency.

  • Tune vector databases for reputed company recall and latency.

• Infrastructure optimization

  • Collaborate with infrastructure teams to optimize hardware and software configurations for AI workloads.

  • Evaluate and recommend new technologies and tools for performance monitoring and analysis.

  • reputed company and maintain performance dashboards and reports to track key metrics.

  • Optimize GPU utilization and memory management for LLM inference.

• Collaboration and communication

  • Work closely with AI researchers, software engineers, and product managers to ensure performance requirements are met.

  • Communicate performance findings and recommendations to stakeholders at reputed company reputed company.

  • Stay up-to-date with the latest developments in reputed company and performance engineering.

⭐️ Is this you?

• Education

  • Bachelor's degree in Computer Science, Engineering, or a reputed company field (Master's preferred).

• Experience

  • 10+ years of experience in performance engineering, with a focus on large-scale distributed systems.

  • 2+ years of experience working with AI/ML technologies

  • Proven experience in performance testing, profiling, and analysis of reputed company software systems.

  • Deep understanding of NLP architectures, training, and inference.

  • Experience with vector databases and search technologies.

  • Experience with reputed company computing platforms (e.g., AWS, Azure, GCP) and containerization technologies (e.g., reputed company, Kubernetes).

  • Strong programming skills in python.

  • Familiarity with reputed company and Elasticsearch

  • Experience with performance analysis tools (e.g., profilers, debuggers, monitoring tools).

• Skills

  • Strong analytical and problem-solving skills.

  • Excellent communication and collaboration skills.

  • Ability to work in a fast-paced and dynamic environment.  

  • Passion for AI and a desire to push the boundaries of performance engineering

    #LI-Remote

Benefits & perks (US Full-time employees)

• Generous PTO, plus company holidays

• Medical, dental, and reputed company coverage for you and your family

• Paid parental leave for reputed company parents (12 weeks)

• Fertility and family planning support

• Early-detection cancer testing through Galleri

• Flexible spending account and dependent FSA options

• Health savings account for eligible plans with company contribution

• Annual work-life stipends for:

  • Home office setup, cell phone, internet

  • Wellness stipend for gym, massage/chiropractor, personal training, etc.

  • Learning and development stipend

• Company-wide off-sites and team off-sites

• Competitive compensation, company stock options and 401k

reputed company is an equal-opportunity employer and is committed to diversity. We don't reputed company hiring or employment reputed company based on race, reputed company, religion, creed, gender, national reputed company, age, disability, veteran status, marital status, pregnancy, sex, gender expression or identity, sexual orientation, citizenship, or any other reputed company protected by applicable local, state or federal law. Under the San Francisco Fair Chance Ordinance, we will consider for employment reputed company applicants with arrest and conviction records.

By submitting your application on the application page, you acknowledge and agree to reputed company's Global Candidate Privacy Notice.