Staff Software Development Engineer in Test (SDET)
Assured · Remote · Remote ·
COMPENSATION
$150k – $190k
Listed on the employer's job board (Ashby)
- Staff level position
- Fully remote role
- TypeScript + Playwright
- AI evaluation focus
- Equity included
You will join a product engineering pod to create reliable automation for traditional software and AI-driven claims processing tools. Your work focuses on building scalable test frameworks, integrating them into CI/CD pipelines, and developing new methods to evaluate nondeterministic AI behaviors.
What you'll do
- Build evaluation frameworks for LLM and agentic applications using statistical QA
- Develop scalable TypeScript frameworks for UI, API, and integration testing
- Integrate stable test suites into CI/CD pipelines for fast feedback
- Investigate test failures to distinguish product defects from automation issues
- Partner with engineering and data science to define quality expectations
What you'll need
- Strong fundamentals in TypeScript and JavaScript ecosystems
- Experience as an SDET or QA Automation Engineer with heavy coding focus
- Proficiency with modern tools like Playwright, Jest, and Axios
- Experience with CI/CD platforms such as GitLab CI or CircleCI
- Ability to communicate clearly across engineering and product teams
Nice to have
- Interest in automated statistical QA and LLM-as-a-judge techniques
- Experience with evaluation tools like Langfuse, Braintrust, or Arize
- Background in testing nondeterministic or AI-driven systems
Stack
- TypeScript
- JavaScript
- Playwright
- Jest
- Axios
- GitLab CI/CD
- CircleCI
- Langfuse
- Braintrust
- Arize
How you'll work
- Fully remote work environment
- Regular team events and offsites
What you get
- Competitive salary and equity packages
- Platinum medical, dental, and vision coverage
- Free life insurance with disability coverage
- Unlimited paid time off and holidays
- Maternity and paternity leave
- 3% 401(k) company contribution
- Lunch stipend twice weekly and phone allowance
- Health FSAs and HSAs available