Staff, MLOps Engineer
Sequen AI · Remote · United States ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Staff level role
- Fully remote (US)
- Python + PyTorch
- Low-latency focus
- Equity included
You will design and operate robust systems for model deployment, distributed inference, and real-time telemetry. Your work ensures seamless model serving and evaluation at enterprise scale with sub-10ms latency.
This foundational infrastructure role partners with ML research scientists to translate experimental breakthroughs into resilient production topologies. You will optimize trade-offs between execution latency, throughput, and cloud costs.
What you'll do
- Design systems for low-latency model deployment and distributed inference
- Optimize trade-offs between latency, GPU/CPU throughput, and cloud costs
- Build infrastructure for automated model versioning and canary releases
- Architect monitoring for model performance and data distribution drift
- Engineer evaluation pipelines to prevent training-serving skew
- Eliminate performance bottlenecks in serving layers and tooling
- Partner with researchers to productionize experimental models
What you'll need
- 4–8+ years in MLOps, ML Engineering, or distributed infrastructure
- Experience deploying ultra-low-latency models under heavy workloads
- Production-grade proficiency with Python and PyTorch
- Comfort with AWS, GCP, or Azure and container orchestration
- Experience designing scalable data pipelines and model registries
- Strong understanding of ML lifecycle and distributed systems
Nice to have
- Production experience with Rust for systems engineering
- Exposure to serving LLMs or generative models like vLLM
- Familiarity with feature stores and experiment tracking tools
- Background in early-stage or hypergrowth startup environments
Stack
- Python
- PyTorch
- AWS
- GCP
- Azure
- Docker
- Kubernetes
- MLflow
- Rust
- vLLM
- Triton
How you'll work
- Remote within the United States
- Based in New York or San Francisco preferred
What you get
- Base salary range $220k–$280k
- Performance bonus and meaningful equity
- Full premium medical, dental, and vision coverage
- Unlimited paid time off