Staff Research Engineer, Model Efficiency
Cohere · Remote · New York · San Francisco · Toronto · Montreal ·
COMPENSATION
$205k – $380k
Listed on the employer's job board (Ashby)
- Staff level research role
- Fully remote friendly
- EST or PST preferred
- PhD in ML required
- Top-tier publications
Join the Model Efficiency team at Cohere to tackle inference bottlenecks in large language models. You will develop and deploy techniques that enhance speed and resource usage across the model execution stack without compromising quality.
The team explores breakthroughs in MoE routing, decoding improvements, and GPU acceleration. This position suits researchers who want to ship practical optimizations for enterprise AI systems.
What you'll do
- Develop techniques to improve model speed and efficiency in production
- Prototype and deploy optimizations for LLM inference
- Work on model architecture and MoE routing optimization
- Improve decoding and inference-time algorithms
- Collaborate on software and hardware co-design for GPUs
What you'll need
- PhD in Machine Learning or a related field
- Deep understanding of LLM architecture and inference constraints
- Experience with techniques that enhance model efficiency
- Strong software engineering skills
- Publications at top-tier venues like ICLR, ACL, or NeurIPS
- Ability to thrive in fast-paced, high-ambiguity environments
- Passion for mentoring other team members
Stack
- Large Language Models
- GPU acceleration
- MoE routing
- Model execution stack
How you'll work
- Fully remote or office-based options available
- Preferred time zones are EST and PST
- No minimum in-office attendance requirement
- Global company with offices in major tech hubs
What you get
- Weekly lunch stipend in local currency
- Full health, dental, and mental health benefits
- Retirement savings matching (RRSP, 401K, Pension)
- 100% parental leave top-up for six months
- Six weeks of paid vacation annually
- Annual enrichment budget for wellness and learning
- $500 home office setup stipend
- Co-working benefit for those not near an office