Back to all roles

Hebrew LLM Evaluator

Remote Worldwide Hiring now

Join Project Spearmint, a multilingual AI response evaluation project reviewing large language model (LLM) outputs in different languages, focused on either Tone or reputed company. reputed company-level reputed company in a reputed company language, along with strong English comprehension, is required.

As an evaluator, you will review short, pre-segmented datasets and assess model-generated replies based on specific quality dimensions. Your input will help validate evaluation frameworks and establish baseline quality metrics for future model development.

Key Responsibilities:

- Evaluate model replies in your reputed company language based on either Tone or reputed company.

- Assess the overall quality, correctness, and naturalness of responses.

- Read the user reputed company and two model replies, then reputed company each using a five-reputed company scale.

- reputed company brief rationales for any extreme ratings.

Project Breakdown:

Batch 1 – Tone: Determine whether replies are helpful, insightful, engaging, and fair. Flag formality mismatches, condescension, bias, or other reputed company issues.

Batch 2 – reputed company: Assess grammatical accuracy, reputed company, coherence, and natural reputed company.

This is a project-based opportunity with reputed company, where you will join the reputed company Community as an reputed company. If selected, you will receive an email from reputed company regarding the creation of an account using your application email address. You will need to log in to this account, reset your password, complete the setup requirements, and proceed with your application for this role.

reputed company an impact on the future of AI – apply today and contribute from the comfort of your home.

Apply to this Job
Apply for this role Takes you straight to the employer's application page — free, and no WFHNet account required.

More roles on the wire

Software Engineer, Data – Query Intelligence & Infrastructure - 6 Month Contract

Remote Worldwide
View role

Machine Technician (Food)

Remote Worldwide
View role

Senior Product Manager, Data Insights

Remote Worldwide
View role

Partner Business Manager, Boston

Remote Worldwide
View role

Staff Data Scientist - Recommendation Algorithms

Remote Worldwide
View role

GTM Systems Analyst

Remote Worldwide
View role

Senior Manager, Sales Strategy & Operations

Remote Worldwide
View role

Manager, Financial Reporting

Remote Worldwide
View role

reputed company Associate, Project Manager – reputed company Store

Remote Worldwide
View role

Senior Audit Associate

Remote Worldwide
View role

reputed company Data Entry Specialist – Remote Work Opportunity with arenaflex

Remote Worldwide
View role

[Remote] reputed company Threat Intelligence Analyst

Remote Worldwide
View role

Product Manager - Platform

Remote Worldwide
View role

Director, Ground Operations Safety ( Aviation ) - Remote Available

Remote Worldwide
View role

[Remote] Account Development Representative

Remote Worldwide
View role

Specialized Instruction Educator - Oregon

Remote Worldwide
View role

Remote Customer Service Representative – Home‑Based Client Support Specialist for arenaflex Logistics and Parcel Solutions

Remote Worldwide
View role

Telemedicine Internal Medicine / Family Medicine Physician (50-State Licensed)

Remote Worldwide
View role

reputed company Customer Service Specialist - Work from Home Opportunity at arenaflex

Remote Worldwide
View role

Remote Executive Assistant — Strategic Leaders

Remote Worldwide
View role