QA Engineer, Voice AI Agents
Arbiter AI · Remote · Remote, US ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Remote or NYC/Boca Raton
- Voice AI & Healthcare
- SQL & API debugging
- $180k-$200k base salary
- Equity package included
Join Arbiter as a QA Engineer focused on their AI-powered care orchestration platform. You will investigate live campaign issues, trace failures through logs and transcripts, and collaborate with engineering teams to resolve platform bugs. The role combines hands-on debugging with the development of structured QA frameworks and automation tools.
What you'll do
- Investigate live campaign issues like dropped calls and incorrect agent responses
- Trace root causes using call recordings, transcripts, logs, and configuration data
- Write clear, reproducible bug reports with severity and impact details
- Triage incoming issues to distinguish between agent behavior and platform bugs
- Run pre-launch QA on new campaigns, testing scripts and escalation paths
- Monitor live campaigns against quality standards to flag emerging trends
- Build and maintain QA frameworks including test cases and regression suites
- Automate repetitive checks such as transcript analysis and config validation
What you'll need
- 3 to 5 years in QA, support engineering, or technical operations
- Strong debugging instinct with ability to find root causes
- Comfortable reading logs and querying data with SQL
- Experience working with APIs and JSON or YAML configurations
- Proven ability to write trusted test plans and bug reports
- Clear written communication and precise documentation habits
- Good judgment for prioritizing multiple live issues
Nice to have
- Experience with voice AI, conversational AI, or IVR platforms
- Scripting ability in Python for automating checks
- Exposure to LLM evaluation or prompt testing
- Healthcare experience with knowledge of HIPAA and PHI
- Familiarity with observability or call analytics tools
Stack
- SQL
- APIs
- JSON
- YAML
- Python
How you'll work
- Remote or onsite in New York City or Boca Raton
- Fast-paced collaborative environment
What you get
- Competitive salary and meaningful equity package
- Generous paid time off
- Comprehensive health, vision, and dental insurance
- Life and disability insurance coverage
- Simple IRA matching
- Professional development budget for courses and conferences
- Wellness programs for physical and mental health