Head of Trust & Safety
MagicSchool AI · Remote · Remote ·
COMPENSATION
$200k – $260k
Listed on the employer's job board (Ashby)
- Fully remote
- Head of Trust & Safety
- LLM safety focus
- Build initial team
- Equity package
As the Head of Trust & Safety, you will own the safety of AI outputs for teachers and students, covering policy, red-teaming, and incident response. You will align with district requirements and state guidance while integrating safety evaluations into product infrastructure.
You will partner with Legal on privacy regulations like COPPA and FERPA, ensuring operational compliance. The role includes building and leading a small team to scale the function through 2027, making safety a velocity enabler rather than friction.
What you'll do
- Own AI output safety including policy, guardrails, and red-teaming
- Manage trust posture with districts via documentation and RFP responses
- Integrate safety evaluations into product infrastructure and scoping
- Handle student-facing safety issues like self-harm and crisis escalation
- Lead end-to-end safety incident processes and postmortems
- Partner with Legal on COPPA, FERPA, and emerging AI regulations
- Build and lead a small Trust & Safety team scaling through 2027
What you'll need
- Owned trust & safety for consumer or youth products at scale
- Hands-on experience with LLM evals, classifiers, and guardrails
- Ability to interpret eval results and implement necessary changes
- Track record of making safety an infrastructure enabler, not friction
- Strong writing skills for docs, explainers, and incident comms
- Comfortable making judgment calls under ambiguity and owning them
- Experience handling live incidents involving minors or vulnerable users
Nice to have
- Experience in K-12 or youth platforms like Roblox or Discord
- Familiarity with state AI-in-education frameworks
- Prior work with child-safety NGOs or standards bodies
- Data/ML fluency to partner on classifiers and eval pipelines
- Comfortable representing safety externally at conferences or press
Stack
- OpenAI
- Anthropic
- Google Vertex AI
- Datadog
- TypeScript
- Next.js
- Supabase
- Linear
- Notion
How you'll work
- Fully remote work environment
- Flexible working hours
- Global team collaboration
What you get
- Unlimited time off policy
- Employer-paid health insurance options
- Low premium dental and vision coverage
- Generous stock options vested over 4 years
- 401k match program
- Monthly wellness stipend