Staff Software Engineer (AI Evals)
… · Remote · Remote · Miami ·
COMPENSATION
Salary available to subscribersListed on the employer's job board (Ashby)
- Staff/Principal level
- Contract role
- •••/hour
- Fully remote
- AI evaluation focus
This position focuses on assessing the quality of interactions with modern coding agents. You will evaluate whether AI outputs reflect strong engineering judgment, useful reasoning, and appropriate tone. The goal is to define what great looks like when developers interact with tools like Cursor.
What you'll do
- Evaluate AI-generated coding interactions end-to-end for quality
- Judge if outputs are useful, correct, and aligned with expert thinking
- Assess the quality of explanations and reasoning beyond syntax
Loading…