Senior Software Development Engineer in Test (SDET), QA - AI Systems
… · Remote · Toronto - Canada ·
COMPENSATION
Salary available to subscribersListed on the employer's job board (Ashby)
- Senior / Staff level
- Fully remote
- Python + LLM testing
- AI agent quality
- Heavy industry focus
You will own quality for Nexxa’s AI agents, which operate autonomously in manufacturing and logistics. The work involves writing production-grade code for test frameworks and simulation environments while also performing hands-on manual testing to validate complex agent behaviors.
Collaborating with ML and backend engineers, you will define quality metrics for high-stakes industrial settings. You will build the systems that measure performance continuously and ensure agents act safely and correctly when automation alone is insufficient.
What you'll do
- Design and maintain test frameworks and evaluation harnesses for LLM-based agents
- Build automated pipelines and CI/CD quality gates for model and prompt changes
- Develop simulators and sandbox environments for safe, scalable agent testing
Loading…