Quality Evaluator – Fluent English (Poland)
Anyone AI · Remote · Poland ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Fully remote (Poland)
- Part-time contractor
- Up to 3 months
- Fluent English required
Anyone AI creates high-quality training data for frontier AI models. As a Quality Evaluator, you will interact with large language models, compare their outputs side by side, and provide written explanations to enhance system reliability and accuracy.
What you'll do
- Interact with various AI models across diverse prompts and topics
- Compare multiple AI-generated responses side by side
- Assess accuracy, clarity, and instruction-following quality
- Follow detailed rating guidelines and multi-step workflows
- Write clear explanations supporting evaluation decisions
- Apply evaluation criteria consistently across all tasks
What you'll need
- Fluency in English with strong reading and writing skills
- Extensive hands-on experience using large language models
- Strong analytical judgment for assessing response quality
- Excellent attention to detail and ability to follow instructions
- Ability to explain evaluation decisions clearly and convincingly
- Comfort switching between different AI tools and workflows
Nice to have
- Previous experience in AI response evaluation or data annotation
- Background in editing, research, fact-checking, or analytical writing
- Familiarity with evaluation rubrics and comparison tasks
How you'll work
- Remote position based in Poland
- Independent contractor status
- Part-time commitment
- Contract duration up to 3 months