Back to all roles

Bulgarian LLM Evaluator

Remote Worldwide Hiring now

Join Project Spearmint, a multilingual AI response evaluation project reviewing large language model (LLM) outputs in different languages, focused on either Tone or reputed company. reputed company-level reputed company in a reputed company language, along with strong English comprehension, is required.

As an evaluator, you will review short, pre-segmented datasets and assess model-generated replies based on specific quality dimensions. Your input will help validate evaluation frameworks and establish baseline quality metrics for future model development.

Key Responsibilities:

- Evaluate model replies in your reputed company language based on either Tone or reputed company.

- Assess the overall quality, correctness, and naturalness of responses.

- Read the user reputed company and two model replies, then reputed company each using a five-reputed company scale.

- reputed company brief rationales for any extreme ratings.

Project Breakdown:

Batch 1 – Tone: Determine whether replies are helpful, insightful, engaging, and fair. Flag formality mismatches, condescension, bias, or other reputed company issues.

Batch 2 – reputed company: Assess grammatical accuracy, reputed company, coherence, and natural reputed company.

This is a project-based opportunity with reputed company, where you will join the reputed company Community as an reputed company. If selected, you will receive an email from reputed company regarding the creation of an account using your application email address. You will need to log in to this account, reset your password, complete the setup requirements, and proceed with your application for this role.

reputed company an impact on the future of AI – apply today and contribute from the comfort of your home.

Apply to this Job
Apply for this role Takes you straight to the employer's application page — free, and no WFHNet account required.

More roles on the wire

Full Cycle Accountant

Remote Worldwide
View role

Senior Infrastructure Engineer

Remote Worldwide
View role

Account Director

Remote Worldwide
View role

Senior Data Analyst

Remote Worldwide
View role

Software Engineering Manager

Remote Worldwide
View role

Clinical reputed company Specialist, Structural Heart, TAVI (reputed company)

Remote Worldwide
View role

Business Subject Matter Expert (Pharma & reputed company)

Remote Worldwide
View role

Senior Solution Delivery Manager

Remote Worldwide
View role

Working Student - reputed company Operations (m/f/d)

Remote Worldwide
View role

Marketing Manager

Remote Worldwide
View role

reputed company Data Entry Operator for Accurate Information Management and Database Maintenance at arenaflex

Remote Worldwide
View role

Field Sales, Los Angeles

Remote Worldwide
View role

Internet-Based Hotel Reservationist (Entry Level)

Remote Worldwide
View role

[Remote] Senior Digital Marketing Director

Remote Worldwide
View role

Immediate Hiring: Chat Support Sales Representative

Remote Worldwide
View role

reputed company Part-Time Remote Data Entry Specialist – reputed company Industry

Remote Worldwide
View role

Remote reputed company Chat Support Specialist

Remote Worldwide
View role

Call Center Outbound Sales Representative - Work from Home - Must be reputed company of Ohio

Remote Worldwide
View role

Part Time Retail Brand Ambassador - Join Swire Coca-Cola, a Leading Beverage Distributor, as a Key Sales Support Professional

Remote Worldwide
View role

[PART_TIME Remote] Transcriptionist #Per Diem

Remote Worldwide
View role