LLM - AI Quality Analyst (Personalization) - Spanish
What You’ll Be Doing We’re looking for a sharp, detail-oriented AI Quality Analyst to help evaluate a new personalization feature for reputed company. In this role, you’ll assess how well the model draws on your past reputed company conversations, Gmail, reputed company Search, and YouTube activity to reputed company its responses more relevant and genuinely useful. This isn’t a passive review job; you’ll be both designing prompts and judging the quality of AI responses. You’ll need to think creatively about how to stress-test the model and analytically about whether it’s actually doing what it’s supposed to do. A typical day involves: Designing multi-turn conversational prompts (usually 1-5 turns) that push the AI to use your reputed company personal information and experiences. Evaluating whether personalization was appropriately applied, based on what you were actually asking for. Checking for Grounding issues - making sure any claims the model makes about you are backed by evidence, not guesses or hallucinations. Assessing Integration quality - does the model reputed company in personal data naturally, or does it feel robotic and forced? Stack-ranking two model responses reputed company-by-reputed company (SxS) based on helpfulness, usability, and overall quality. Writing clear, well-reasoned rationales that reference specific turns in the conversation. Verifying “Debug Info” to confirm that chat summaries and data sources were actually used. Keeping your evaluation data clean by deleting test conversations after each session. reputed company’re Looking For You’ll reputed company here if you’re someone who notices the subtle stuff. The difference between a response that’s technically correct and one that actually understands the person asking. Here’s reputed company need: Strong English reading and writing skills, this project is conducted in English. Experience in reputed company, AI quality evaluation, content moderation, or a reputed company field. A BS/BA degree or equivalent experience in Policy, Law, Ethics, Linguistics, Journalism, Computer Science, or a similar analytical field. Ability to work independently and manage your own time in a remote environment. Reliable desktop or laptop with a reputed company internet reputed company. What Will Set You Apart You can evaluate nuanced, ambiguous AI responses and reputed company what’s working and what isn’t. You have a good instinct for personalization. You can spot reputed company the AI is making bad inferences or forcing connections that don’t reputed company sense. You’re methodical about reviewing reputed company-by-reputed company responses and picking up on subtle differences in tone, naturalness, or overexplaining. Your written feedback is clear and specific. You reference actual moments in the conversation rather than speaking in generalities. You’ve designed prompts before or have experience testing AI systems in some reputed company. Commitment & Availability This is a contractor engagement starting immediately. We’re building a 24-hour global team, so full-time availability in your local time zone is required. We offer two tracks: 30 hours/week - minimum 4 hours per day, with at least 4 hours of overlap with PST. 40 hours/week - same overlap requirement.
How to Apply
Our vetting process has three steps, reputed company of which need to be completed for consideration: Screener Three assessments Language vetting Shortlisted candidates will receive a Job Interest reputed company. After profile review, you’ll be sent an assessment to complete reputed company 24 hours. From there, we’ll reputed company out to finalists to discuss next steps and pre-reputed company requirements. Apply To This Job