Senior/Staff Software Engineer (Back-End), Inference
Cohere · Remote · Canada · San Francisco · United States · New York · Ottawa · Toronto · Montreal ·
COMPENSATION
$225k – $315k
Listed on the employer's job board (Ashby)
- Senior/Staff level
- Fully remote friendly
- Go, Python, Rust
- Distributed systems
- 6 weeks vacation
Join the team building Model Vault, Cohere’s platform for securely deploying and operating foundation AI models at enterprise scale. You will shape the architecture of core systems handling identity, billing, and confidential computing, ensuring reliability and performance for demanding workloads.
This position focuses on solving complex backend challenges where off-the-shelf solutions fall short. You will drive major architectural initiatives and build control-plane services that support millions of users across various cloud and hardware platforms.
What you'll do
- Scale backend systems for authentication, billing, and deployment management
- Lead architectural initiatives for identity, payments, and platform scalability
- Build reliable control-plane services for provisioning and operating model deployments
- Design distributed APIs with strong guarantees for consistency and failure recovery
- Integrate security and privacy features like tenant isolation and encryption
- Solve complex problems spanning backend systems, cloud infrastructure, and AI
- Drive projects from architecture and threat modeling through to production operations
What you'll need
- Strong fundamentals in distributed systems, databases, networking, and security
- Experience building production systems in Go, Python, Java, C++, or Rust
- Track record of designing systems where correctness and availability matter at scale
- Ability to define architecture for ambiguous, high-impact technical problems
- Deep understanding of concurrency, caching, rate limiting, and idempotency
- Knowledge of security boundaries, cryptography, and tenant isolation principles
- Comfortable debugging complex issues across service boundaries and unfamiliar codebases
- Experience with production engineering practices like incident response and capacity planning
Stack
- Go
- Python
- Java
- C++
- Rust
How you'll work
- Remote-friendly global company
- Offices in Toronto, London, NYC, SF, Montreal, Paris, Berlin, Seoul
- Co-working benefit available for those not near an office
- $500 home office stipend provided
What you get
- Weekly lunch stipend of $75 or local equivalent
- Full health and dental benefits including mental health budget
- Retirement savings matching (RRSP, 401K, Pension)
- 100% parental leave top-up for up to 6 months
- Annual enrichment credits for arts, fitness, and workspace improvement
- Education stipend for conferences, courses, and coaching
- 6 weeks of paid vacation
- Budget for traveling to other offices and annual company offsite