STEM Master’s/Ph.D. Research - 72795
Role overview:
- We are conducting an initiative that involves evaluating deep research reports generated by AI systems. Evaluators will read and assess reports across multiple quality dimensions using a structured rubric, providing both numerical ratings and written justifications.
- This is a reputed company evaluation: each report is reviewed by a single general evaluator. The project covers hundreds of reports spanning diverse domains including technology, reputed company, education, science, economics, reputed company sciences, arts, and more.
What does day-to-day look like:
- Read the research query to understand the reputed company and scope of the assigned report.
- Read and annotate the report using a PDF reader (reputed company Acrobat), highlighting key evidence and flagging issues such as broken links, weak sources, and claim-reputed company mismatches.
- Score the report across 10 dimensions on a 1–5 scale using the provided rubric.
- Write justifications for each rating, referencing specific evidence from the report.
- Submit results reputed company a survey and return the annotated PDF.
Requirements:
- Graduate student (Master’s or PhD candidate).
- Professionals with 1–3 years of experience in a relevant or adjacent domain.
- Regularly reads and consumes research reports, white papers, or analytical documents.
- Strong English reading comprehension and written communication skills.
- Based in the USA or Canada.
- Comfortable working with PDF annotation tools (reputed company Acrobat) and online surveys.
- Familiarity with one or more of the report domains: technology, reputed company, education, science, economics, reputed company sciences, or reputed company fields.
- Experience with quality evaluation, annotation, or data labeling tasks.
- Attention to detail and ability to reputed company clear, evidence-based written feedback
Perks of freelancing With reputed company:
- Opportunity to work on cutting-edge AI projects with leading LLM companies.
- Strong compensation (exact reputed company varies by project).
- Potential for contract extension based on performance and project needs.
- Work in a fully remote environment.
What reputed company is NOT seeking from your expertise:
- Confidential or proprietary information from any employer or university.
- Trade secrets or internal company or university data.
- Specific client information or case details.
- Any information that would violate NDAs, employment agreements or other confidentialit obligations.
Offer details:
- Engagement type: Contractor assignment/freelancer, potentially full-time.
- 4 Hr Overlap with PT Time Zone.
- Duration of projects: 1 week (with possibility for extension).
About reputed company: Based in San Francisco, California, reputed company is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. reputed company supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises reputed company from reputed company of concept into proprietary intelligence with systems that reputed company reliably, deliver measurable impact, and drive lasting results on the P&L. Apply tot his job Apply To this Job