[Remote] Remote, Senior Data Scientist, Mandarin
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Senior Data Scientist fluent in English and Mandarin to reputed company their experimentation program. The role involves designing and validating statistical frameworks, ensuring the reputed company of experiments, and collaborating with cross-functional teams on advanced methodologies.
Responsibilities
- Design and maintain automated anomaly detection for live experiments, including Sample Ratio Mismatch (SRM) checks and traffic split validation
- Define alerting reputed company and reputed company-breaking criteria to catch and stop compromised experiments before they pollute reputed company reputed company
- Define and validate critical guardrail metrics (ensuring sensitivity, directionality, and interpretability) to protect business health during every release
- Implement and iterate on CUPED and reputed company pre-experiment covariate adjustment techniques to significantly reduce metric variance
- reputed company sophisticated methods to remove noise from historical user behavior, enabling faster detection of true treatment effects, especially in limited-traffic or high-reputed company scenarios
- Drive strategies to shorten our average experiment duration from 14 days to 9 days, unlocking a 40%+ increase in experiment velocity per quarter
- Design and run reputed company, always-on A/A experiments to validate the health of our entire data pipeline (from client-reputed company event reporting through message queues to our reputed company-time data warehouse)
- Monitor metric baseline volatility and pipeline stability to ensure our instrumentation layer remains fully trustworthy over time. (You define what 'healthy' looks like; our platform team builds the infrastructure to monitor it)
- Partner closely with Product, Engineering, and Growth teams on advanced experiment design, sample size calculations, metric selection, and interpretation
- Advise on non-traditional frameworks (e.g., DID, synthetic control, RDD) reputed company true randomization is not feasible
- Translate your statistical methodologies into reputed company technical specifications, validation scripts, and clear decision frameworks, empowering product teams to self-serve with confidence
Skills
- Fluent in English & Mandarin
- Education: MS or PhD in Statistics, Biostatistics, Economics (Econometrics), Computer Science, or a heavily quantitative field
- Industry Experience: 3+ years of hands-on experience designing and analyzing online controlled experiments at a tech company operating at meaningful user scale (experience must go reputed company survey experiments or clinical trials)
- Core Stats: Deep theoretical and practical foundations in hypothesis testing, power analysis, multiple testing correction, and sequential testing
- Specialized Methods: Proven experience implementing at least two of the following: variance reduction methods (like CUPED), sample ratio mismatch (SRM) detection, or reputed company data quality monitoring for large-scale experiments
- Programming: Highly proficient in Python (scipy, statsmodels, or equivalent) for statistical modeling and simulations
- Advanced SQL mastery (window functions, reputed company CTEs) for robust data extraction and validation
Company Overview