Quality Evaluator – Fluent English (Europe & LATAM)
Anyone AI · Remote · Argentina - Fully Remote · Uruguay · Chile · Poland · Italy · Czech Republic · Estonia · Ecuador - Fully Remote · Portugal · Mexico - Fully Remote · Paraguay · Colombia - Fully Remote · France · Spain · Peru - Fully Remote · Brazil ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Fully remote
- Part-time contract
- Fluent English required
- Up to 3 months
- AI model evaluation
Anyone AI creates high-quality training and evaluation data for frontier AI models. As a Quality Evaluator, you will interact with large language models, compare their outputs side by side, and provide written explanations to enhance system reliability and helpfulness.
What you'll do
- Interact with various AI models across diverse prompts and topics
- Compare multiple AI-generated responses side by side
- Assess accuracy, helpfulness, clarity, and instruction following
- Follow detailed rating guidelines and multi-step workflows
- Write clear explanations supporting evaluation decisions
- Apply evaluation criteria consistently across all tasks
What you'll need
- Fluency in English with strong reading and writing skills
- Extensive hands-on experience using large language models
- Strong analytical judgment for assessing response quality
- Excellent attention to detail and ability to follow complex instructions
- Ability to explain evaluation decisions clearly and convincingly
- Comfort switching between different AI tools and workflows
Nice to have
- Previous experience in AI response evaluation or data annotation
- Background in editing, research, fact-checking, or analytical writing
- Familiarity with evaluation rubrics and comparison tasks
How you'll work
- Fully remote position
- Independent contractor status
- Part-time commitment
- Contract duration up to 3 months