Quality Evaluator – Fluent English (Argentina)
Anyone AI · Remote · Argentina - Fully Remote ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Fully remote
- Part-time contract
- Fluent English required
- Up to 3 months
Anyone AI seeks English-fluent experts to evaluate and compare responses from advanced AI models. As an independent contractor, you will assess accuracy, helpfulness, and clarity to help shape the future of frontier AI systems.
What you'll do
- Interact with AI models across various prompts and topics
- Compare multiple AI-generated responses side by side
- Assess accuracy, helpfulness, and instruction following
- Follow detailed rating guidelines and evaluation workflows
- Write clear explanations supporting evaluation decisions
- Apply evaluation criteria consistently across tasks
What you'll need
- Fluency in English with strong writing skills
- Extensive hands-on experience using LLMs
- Strong analytical judgment for response quality
- Excellent attention to detail
- Ability to follow complex instructions carefully
- Comfort switching between AI tools and workflows
Nice to have
- Experience in AI response evaluation or data annotation
- Background in editing, research, or fact-checking
- Familiarity with evaluation rubrics
- Experience with side-by-side comparison tasks
How you'll work
- Remote work location
- Independent contractor status
- Part-time commitment
- Contract duration up to 3 months