AI Coding Evaluator
Anyone AI · Remote · Argentina - Fully Remote · Uruguay · Chile · Poland · Italy · Czech Republic · Estonia · Ecuador - Fully Remote · Portugal · Mexico - Fully Remote · Paraguay · Colombia - Fully Remote · France · Spain · Peru - Fully Remote · Brazil · Germany ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Fully remote
- Part-time contractor
- Up to 3 months
- JSON + Coding
- Multilingual
Join Anyone AI as an AI Coding Evaluator to help improve the reliability of frontier AI models. You will assess the technical accuracy, language quality, and usefulness of AI outputs, focusing on clarity and adherence to guidelines. This position involves reviewing both customer service interactions and technical content.
What you'll do
- Review AI-generated customer service responses and technical content
- Evaluate outputs for clarity, helpfulness, and natural language quality
- Assess technical correctness using your coding knowledge
- Read, validate, and troubleshoot JSON for structural issues
- Check formatting accuracy against project guidelines
- Provide clear, well-reasoned feedback on evaluations
What you'll need
- Fluency in one supported language variety
- Solid understanding of JSON syntax and validation
- Coding knowledge sufficient to identify technical errors
- Strong judgment for evaluating customer service responses
- Excellent attention to detail and written communication skills
- Ability to follow detailed evaluation guidelines consistently
Nice to have
- Experience in AI evaluation or quality assurance
- Background in technical support or software development
- Experience working with APIs and structured data
- Background in technical writing
Stack
- JSON
How you'll work
- Fully remote location
- Independent contractor status
- Part-time engagement
- Project duration up to 3 months