Quality Evaluator – Fluent English (Mexico)
Anyone AI · Remote · Mexico - Fully Remote ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Fully remote (Mexico)
- Part-time contractor
- Fluent English required
- AI evaluation focus
Anyone AI seeks English-fluent experts to evaluate and compare outputs from advanced AI models. You will assess response quality to help improve the reliability and accuracy of frontier AI systems.
What you'll do
- Interact with AI models across various prompts and topics
- Compare multiple AI-generated responses side by side
- Assess accuracy, clarity, and instruction-following
- Follow detailed rating guidelines and workflows
- Write clear explanations for evaluation decisions
- Apply evaluation criteria consistently
What you'll need
- Fluency in English with strong writing skills
- Extensive hands-on experience using LLMs
- Strong analytical judgment and attention to detail
- Ability to follow complex instructions carefully
- Comfort switching between AI tools and workflows
Nice to have
- Experience in AI response evaluation or data annotation
- Background in editing, research, or fact-checking
- Familiarity with evaluation rubrics
How you'll work
- Remote position based in Mexico
- Independent contractor status
- Part-time commitment
- Contract duration up to 3 months