Sr. Staff Machine Learning Systems Engineer
Hims & Hers · Remote · US Remote ·
COMPENSATION
$240k – $265k
Listed on the employer's job board (Ashby)
- Sr. Staff Level
- Fully Remote (US)
- Python + ML Infrastructure
- Healthcare Industry
- Equity Compensation
Join Hims & Hers as a Senior Staff Engineer to define how advanced AI models are evaluated for safety and efficacy in a regulated healthcare environment. You will own the end-to-end evaluation ecosystem, from data ingestion and dataset versioning to statistical regression gates and red-team testing.
This leadership position requires navigating ambiguous, cross-functional challenges to establish standards for model trustworthiness. You will design scalable pipelines and evaluation methodologies that enable clinical and product teams to make data-driven decisions while ensuring patient safety.
What you'll do
- Set technical direction for evaluation systems, including metric design and statistical methodology
- Design and scale data pipelines for ingestion, transformation, and dataset versioning
- Lead multi-team initiatives to replace manual reviews with automated, statistically sound gates
- Develop adversarial and red-team evaluation suites to identify safety risks before release
- Resolve complex technical disagreements across engineering, product, and AI leadership
- Mentor engineers and raise the technical and statistical bar for surrounding teams
- Create reusable standards and methodologies for evaluating new AI services
What you'll need
- 10+ years of experience in ML infrastructure, data engineering, or evaluation systems
- Deep expertise in designing LLM judges, scorers, and calibration workflows
- Strong background in statistical regression testing and significance analysis
- Proven ability to build high-throughput data ingestion and transformation systems
- Experience leading multi-team projects and resolving technical conflicts
- Proficiency in Python and strong statistical fluency for production decision frameworks
- Excellent communication skills for adapting technical ideas to diverse audiences
Nice to have
- Experience with Databricks, MLflow, or Unity Catalog
- Background in building reporting tools for non-technical stakeholders
- Prior work in regulated industries such as healthcare or fintech
- Track record of influencing company-wide technical approaches through talks or docs
Stack
- Python
- Databricks
- MLflow
- Unity Catalog
How you'll work
- Fully remote work approach
- Flexible schedule
- Quarterly mental health days
- Unlimited PTO policy
What you get
- Competitive salary and equity compensation
- Comprehensive medical, dental, and vision insurance
- 401k benefits with employer matching contribution
- Employee Stock Purchase Program (ESPP)
- Parental leave support
- Offsite team retreats