Multilingual Audio Evaluator
Anyone AI · Remote · Argentina - Fully Remote · Italy · Portugal · France · Spain · Netherlands · Brazil · Germany ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Fully remote (Global)
- Independent contractor
- 2–3 month project
- C1/C2 language fluency
- JSON troubleshooting
Join Anyone AI to help improve the quality and reliability of frontier AI models. You will evaluate how conversational agents perform across various languages by participating in real-time interactions and analyzing technical logs.
What you'll do
- Conduct live, real-time roleplay scenarios with conversational AI agents
- Capture session recordings, IDs, and technical console logs
- Label conversation transcripts following specific project guidelines
- Score interactions using structured evaluation rubrics
- Provide written explanations to support your evaluation scores
- Read, validate, and troubleshoot JSON for structural issues
- Prepare and confirm necessary tools before each live session
What you'll need
- C1 or C2 spoken fluency in at least one target language
- Ability to pass a speaking and listening proficiency assessment
- Strong skills in reading, validating, and troubleshooting JSON
- Comfortable using digital tools to collect recordings and logs
- High attention to detail and consistent guideline adherence
- Clear written communication and sound judgment skills
Nice to have
- Experience in AI evaluation, audio annotation, or transcript labeling
- Background in technical support, QA, or software development
- Familiarity with conversational AI, APIs, and structured data
Stack
- JSON
- APIs
- Conversational AI
How you'll work
- Remote work available globally subject to project restrictions
- Independent contractor engagement type
- Project duration of two to three months
- Commitment level to be confirmed