Senior Member of Technical Staff, Agents
Clera · Remote · Palo Alto ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Senior level role
- On-site (Palo Alto)
- Python + SQL
- AI evaluation systems
- No visa sponsorship
You will join a small team developing autonomous AI capabilities designed to handle delegated tasks with minimal oversight. The work focuses on creating agent capabilities, defining quality metrics, and building evaluation systems to ensure reliability before features reach users.
What you'll do
- Build agents that complete delegated work end to end with minimal oversight
- Define and measure agent quality to assess task completion accuracy
- Develop new capabilities for existing executive tools and evaluate readiness
- Investigate production failures and ship fixes to prevent recurrence
- Build detection systems for known failure patterns and unexpected issues
- Improve agent recovery mechanisms when tools or websites fail
- Create repeatable evaluation workflows to measure the impact of changes
What you'll need
- At least 3 years in data science or ML roles building evaluation systems
- Production-quality Python and SQL skills for analysis and pipelines
- Experience designing evaluation frameworks with measurable success criteria
- Track record of relevant impact and sustained experience in similar roles
- Degree from a strong engineering program
- Experience with applied AI or machine learning systems
- Collaborative approach to solving ambiguous problems
Stack
- Python
- SQL
- Django
- React
- TypeScript
- harness engineering
- Braintrust
- Raindrop
How you'll work
- On-site in Palo Alto, California
- Work in the office four days per week
What you get
- Base salary between $200,000 and $300,000 annually