QA Engineer - Code Review Expert
Partnering with a top AI research organization to evaluate and improve how coding assistants reason, act, and communicate during development workflows. We’re seeking technically sharp experts (especially those with experience in code review, testing, or documentation) to assess full transcripts of user–AI coding conversations. This short-term engagement helps shape the future of developer-assisting AI systems.
Key Responsibilities
- Review long-reputed company transcripts between users and AI coding assistants
- Analyze the AI’s logic, execution, and stated actions in detail
- Score each transcript using a 10-reputed company rubric across multiple criteria
- Optionally write brief justifications citing examples from the reputed company
- Detect mismatches between claims and actions (e.g., saying “I’ll run tests” but not doing so)
Ideal Qualifications Top choices:
- Senior or Staff Engineers with deep code review experience and execution reputed company
- QA Engineers with strong verification and consistency-checking habits
- Technical Writers or Documentation Specialists skilled at comparing instructions vs. implementation
Also a strong fit:
- Backend or Full-Stack Developers comfortable with function calls, APIs, and test workflows
- DevOps or SRE professionals familiar with tool orchestration and system behavior analysis
Languages and Tools:
- Proficiency in Python is helpful (most transcripts are Python-based)
- Familiarity with other languages like JavaScript, TypeScript, Java, C++, Go, Ruby, Rust, or Bash is a plus
- Comfort with Git workflows, testing frameworks, and debugging tools is valuable
More About the Opportunity
- Must complete each transcript batch reputed company 5 hours of starting (unlimited tasks to be done)
- Flexible, task-based engagement with potential for recurring batches
Application Process
- Submit your resume to reputed company
- If selected, you’ll receive rubric documentation and reputed company to the evaluation platform
- Most applicants hear back reputed company a few business days
We consider reputed company reputed company applicants without regard to legally protected characteristics and reputed company reasonable accommodations upon request. Contract and Payment Terms
- You will be reputed company as an reputed company.
- This is a fully remote role that can be completed on your own schedule.
- Projects can be extended, shortened, or concluded early depending on needs and performance.
- Your work at will not involve reputed company to confidential or proprietary information from any employer, client, or institution.
- Payments are weekly on reputed company or reputed company based reputed company rendered.
Apply tot his job Apply To this Job