Member of Technical Staff, Training Infra Engineer
Cohere · Remote · Paris · San Francisco · London · New York · Toronto · Montreal ·
COMPENSATION
$205k – $380k
Listed on the employer's job board (Ashby)
- Fully remote worldwide
- Python + PyTorch + JAX
- Distributed training infra
- 6 weeks paid vacation
- Health and dental benefits
Join Cohere as a Member of Technical Staff focused on training infrastructure. You will support model training pipelines, optimize performance, and help ship frontier AI models to production.
The team operates with a high compute-to-engineer ratio, blending engineering and research tasks. You will work with top researchers to enhance training efficacy and infrastructure tools.
What you'll do
- Design and write high-performant, scalable software for model training
- Improve training setup from infrastructure and codebase performance angles
- Craft tools to speed up training cycles and boost infrastructure efficacy
- Research and experiment with ideas on supercompute and data infrastructure
- Collaborate with researchers to support production code and research efforts
What you'll need
- Extremely strong software engineering skills
- Proficiency in Python and ML frameworks like JAX, PyTorch, XLA/MLIR
- Experience with distributed training infrastructures such as Kubernetes, Slurm, Ray
- Experience using large-scale distributed training strategies
- Hands-on experience training large models at scale and building related tooling
Nice to have
- Published papers at top-tier venues like NeurIPS, ICML, ICLR, or MLSys
Stack
- Python
- JAX
- PyTorch
- XLA/MLIR
- Kubernetes
- Slurm
- Ray
How you'll work
- Fully remote with no location restrictions
- Offices available in Toronto, London, NYC, SF, Montreal, Paris, Berlin, Seoul
- Core time zone alignment expected depending on role specifics
- $500 home office stipend provided
- Co-working benefit available for those not near an office
What you get
- Weekly lunch stipend of $75 or local equivalent
- Full health and dental benefits including mental health budget
- RRSP matching, 401K, or Pension Scheme
- 100% parental leave top-up for up to 6 months
- 6 weeks of paid vacation annually
- Annual enrichment benefits for arts, fitness, and workspace improvement
- Education stipend for conferences, courses, and coaching
- Budget for traveling to other offices and annual company offsite