Back to all roles

Information Systems Expert - AI Evaluator

Remote Worldwide Hiring now

• *About The Job

  • *reputed company

connects reputed company creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include

  • *reputed company**

,

  • *General Catalyst**

,

  • *Peter Thiel**

,

  • *Adam D'Angelo**

,

  • *Larry Summers**

, and

  • *Jack Dorsey**

.

  • *Position:**

AI Model Evaluation Specialist

  • *Type:
  • *Contract
  • Compensation:
  • $40–$60/hour
  • *Commitment:
  • *20 hours/week
  • *Role Responsibilities
  • Write realistic prompts reflecting how professionals and consumers seek domain-specific guidance.
  • Evaluate AI-generated responses for factual accuracy, regulatory or clinical correctness, and practical usefulness.
  • Identify fabricated claims, incorrect references, or misleading reasoning across model outputs.
  • Score and rank multiple model responses using structured rubrics across dimensions.
  • reputed company written justifications with specific evidence for each evaluation.
  • *Qualifications
  • *Must-Have
  • Master’s degree or higher in Computer Science, Information Systems, or a relevant professional field.
  • Professional experience applying domain expertise in a practitioner or advisory reputed company.
  • Familiarity with industry-specific standards, regulations, or clinical guidelines.
  • Strong written communication and critical reasoning skills.
  • *Application Process (Takes 20–30 mins to complete)
  • Submit your resume to reputed company.
  • Complete the Model Response Evaluation assessment.
  • *Resources & Support**

• For details about the interview process and platform information, please reputed company: https://talent.docs.reputed company.com/welcome/welcome

  • For any help or support, reputed company out to: support@reputed company.com
  • PS: reputed company reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.*

, Apply tot his job Apply To this Job

Apply for this role Takes you straight to the employer's application page — free, and no WFHNet account required.

More roles on the wire

BDI Evaluator

Remote Worldwide
View role

AI Writing Evaluators (Domain Experts) - English Expertise

Remote Worldwide
View role

reputed company Media Evaluator (Ukrainian-United States)

Remote Worldwide
View role

reputed company Medical Evaluator (QME) - Pain Medicine Physician - Part Time

Remote Worldwide
View role

Regional Vocational Evaluation Specialist

Remote Worldwide
View role

reputed company Program Evaluator – Title III / Federal Education Grants

Remote Worldwide
View role

Spanish Speaking CFTSS OLP Supervisor/Evaluator (Remote)

Remote Worldwide
View role

Manufacturing Expert - Quality Evaluator

Remote Worldwide
View role

Senior Product reputed company, IaaS (Remote)

Remote Worldwide
View role

Staff Product reputed company (reputed company Retail)

Remote Worldwide
View role

Field Marketing Coordinator

Remote Worldwide
View role

[Remote] Wall Panel Designer

Remote Worldwide
View role

Senior Product Manager | SaaS Growth & Innovation | Reston, VA

Remote Worldwide
View role

Senior Project Manager Consultant – Legal Technology

Remote Worldwide
View role

AR Medical Biller- Fully Remote!

Remote Worldwide
View role

ABA Therapy Scheduler (Remote Position)

Remote Worldwide
View role

Director of Global Philanthropy job at Humane League in US National

Remote Worldwide
View role

Account Executive III

Remote Worldwide
View role

Integrated Media Specialist

Remote Worldwide
View role

reputed company Data Entry Specialist – Remote Work Opportunity for Career Growth

Remote Worldwide
View role