South Asian Software Engineers: Coding Tasks for AI Evaluation
Terac · Remote · India ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- South Asia based
- $35 per hour
- Remote study
- Software Engineers
Join a research study focused on improving the effectiveness of coding evaluation harnesses for AI agents. You will assess the realism, structure, and difficulty of proposed programming challenges to ensure they reflect real-world engineering scenarios.
What you'll do
- Review proposed coding tasks and environments for realism
- Provide technical feedback on evaluation harness structure
- Assess the difficulty level of programming challenges
- Suggest improvements to make test suites more robust
- Walk through your approach to verifying code challenges
What you'll need
- Professional software engineer based in South Asia
- Experience building or reviewing realistic programming tasks
- Familiarity with coding evaluation harnesses
- Background in test automation is preferred
- Comfortable discussing technical workflows in interviews
How you'll work
- Fully remote participation
- AI-moderated session format
- Hourly compensation model
What you get
- $35 per hour compensation
- Paid interview process