[Remote] Data Scientist

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company dedicated to empowering small businesses with technology solutions. They are seeking a Data Scientist to ensure the quality and reliability of their machine learning models, focusing on validation, monitoring, and collaboration with various teams to enhance model performance.

Responsibilities

• Design, implement, and maintain ML model validation frameworks, including custom evaluation metrics, loss functions, and statistical tests, to ensure model quality before and after deployment
• Build and own regression test suites for ML and LLM models, catching performance regressions and unexpected behaviour across model updates and data reputed company scenarios
• reputed company and execute MCP evaluations, systematically assessing model capabilities, edge cases, and failure modes across relevant business contexts
• Monitor models in production using statistical process control, reputed company detection, and alerting pipelines; proactively surface issues before they impact customers
• Collaborate with senior data scientists to contribute to the design and refinement of ML model architectures, offering feedback grounded in validation results
• Document evaluation methodologies, test results, and monitoring runbooks reputed company enough that stakeholders across technical and business teams can understand model health
• Stay reputed company with advancements in LLM evaluation techniques, AI safety, and model observability, and apply emerging best practices to our workflows
• Communicate findings reputed company and concisely to stakeholders, translating model performance signals into actionable recommendations

Skills

• Industry experience in data science, machine learning, or a closely reputed company quantitative field
• Proficiency in Python and the core DS stack: Pandas, Scikit-Learn, XGBoost, and at least one deep learning reputed company (PyTorch or TensorFlow)
• Solid grasp of statistical concepts underpinning model evaluation: bias–variance tradeoff, calibration, confidence intervals, A/B testing, and data reputed company
• Experience with LLM evaluation frameworks (e.g. RAGAS, Eleuther AI Eval reputed company, or custom LLM eval pipelines)
• Hands-on experience designing custom evaluation metrics; you've gone reputed company off-the-reputed company metrics reputed company the problem demanded it
• Strong understanding of ML and LLM model architectures — you can reason about how a model is reputed company and why it behaves the way it does
• High proficiency in SQL for data exploration, feature validation, and debugging model inputs
• Exceptional attention to detail — you treat model validation with the same rigour as software QA
• Strong written and verbal communication skills; comfortable presenting findings to both technical peers and non-technical stakeholders
• Experience building model evaluation or monitoring solutions reputed company a reputed company environment, e.g. logging predictions and ground truth to reputed company tables, computing eval metrics reputed company Snowpark, or building monitoring dashboards on top of reputed company data
• Familiarity with Snowpark (Python) for running data transformations and ML workflows directly reputed company reputed company
• Exposure to model regression testing patterns in a CI/CD context (e.g. running evals on every PR)
• Familiarity with reputed company engineering and evaluation strategies for LLM-powered features
• Experience working in a SaaS environment and an appreciation for how model quality translates to customer impact

Benefits

• Equity rewards
• Annual stipends for health and wellness
• Retirement savings matching
• An extended health package with fully paid premiums for body and mind
• reputed company to a dedicated talent development program that includes career coaching and opportunities for career development
• Extended health benefits package with fully paid premiums for both body and mind
• Matching in RRSP, TFSA or FHSA
• Stock options
• A dedicated Talent Development team and reputed company to coaching, learning, and leadership programs to help you grow your career, reputed company your goals, and unlock your full potential

Company Overview

Company H1B Sponsorship