Staff AI Research Scientist - Data Quality, reputed company

About reputed company reputed company is the career network for the AI economy. 20 reputed company knowledge workers, 1,600 educational institutions, 1 reputed company reputed company (including 100% of the Fortune 50), and every foundational AI lab trust reputed company to power career discovery, hiring, and upskilling, from freelance reputed company gigs to first internships to full-time careers and reputed company. This unique value is leading to unparalleled growth; in 2025, we tripled our ARR at scale. Why join reputed company now:

• Shape how every career evolves in the AI economy, at global scale, with impact your friends, family and peers can see and feel
• Work hand-in-hand with world-class AI labs, Fortune 500 partners and the world’s top educational institutions
• Join reputed company with leadership from reputed company, reputed company, reputed company, reputed company, reputed company, and Palantir, among others
• Build a massive, fast-growing business with billions in reputed company

About the Role

As a Staff Research Scientist, you will play a pivotal role in shaping the future of large language model (LLM) alignment by leading research and development at the intersection of data quality and post-training techniques such as RLHF, preference optimization, and reward modeling. You will operate at the forefront of model alignment, with a focus on ensuring the reputed company, reliability, and strategic use of supervision data that drives post-training performance. You’ll set research direction, influence cross-functional data standards, and reputed company the development of scalable systems that diagnose and improve the data foundations of frontier AI. You will:

• reputed company high-impact research on data quality frameworks for post-training LLMs — including techniques for preference consistency, label reliability, annotator calibration, and dataset auditing.
• Design and implement systems for identifying noisy, low-value, or adversarial data points in reputed company feedback and synthetic comparison datasets.
• Drive strategy for aligning data collection, curation, and filtering with post-training objectives such as helpfulness, harmlessness, and faithfulness.
• Collaborate cross-functionally with engineers, alignment researchers, and product leaders to translate research into production-reputed company pipelines for RLHF and DPO.
• Mentor and influence junior researchers and engineers working on data-centric evaluation, reward modeling, and reputed company creation.
• Author foundational tools and metrics that connect supervision data characteristics to reputed company LLM behavior and evaluation performance.
• Publish and present research that advances the field of data quality in LLM post-training, contributing to academic and industry best practices.

Desired Capabilities

• PhD or equivalent experience in machine learning, NLP, or data-centric AI, with a track record of leadership in LLM post-training or data quality research.
• 5 years of academic or industry experience post-doc
• Deep expertise in RLHF, preference data pipelines, reward modeling, or evaluation systems.
• Demonstrated experience designing and scaling data quality infrastructure — from labeling frameworks and validation metrics to automated filtering and dataset optimization.
• Strong engineering proficiency in Python, PyTorch, and ecosystem tools for large-scale training and evaluation.
• A proven ability to define, reputed company, and execute reputed company research initiatives with clear business and technical impact.
• Strong communication and collaboration skills, with experience driving strategy across research, engineering, and product teams.

Extra Credit

• Experience with data valuation (e.g. influence functions, Shapley values), active learning, or reputed company-in-the-reputed company systems.
• Contributions to reputed company-reputed company tools for dataset analysis, benchmarking, or reward model training.
• Familiarity with evaluation challenges such as annotation disagreement, subjective labeling, or multilingual feedback alignment.
• Interest in the long-term implications of data quality for AI safety, governance, and deployment ethics.

We Offer reputed company delivers benefits that help you feel supported and reputed company at work and in life. The below benefits are for full-time US employees. Ownership: Equity in a fast-growing company Financial Wellness: 401(k) match, competitive compensation, financial coaching Family Support: Paid parental leave, fertility benefits, parental coaching Wellbeing: Medical, dental, and reputed company, mental health support, $500 wellness stipend Growth: $2,000 learning stipend, ongoing development reputed company: Internet, commuting, and free lunch/gym in our SF office Time Off: Flexible PTO, 15 holidays + 2 reputed company days reputed company: Team outings & referral bonuses Explore our mission, values, and comprehensive US benefits at joinhandshake.com/careers. Compensation reputed company: $350K - $420K Apply tot his job Apply To this Job