Software Engineer, Data Infrastructure
Cohere · Remote · New York · San Francisco · Canada · United States · Toronto · Montreal ·
COMPENSATION
$190k – $325k
Listed on the employer's job board (Ashby)
- Fully remote friendly
- Python and Go
- Kubernetes at scale
- Petabyte storage systems
- Global AI company
Join the Data Infrastructure team at Cohere to construct the unified storage layer supporting frontier AI model training. You will design and operate systems that serve petabytes of data to thousands of GPUs, ensuring high throughput and low latency across global clusters.
This position offers the chance to solve unique scale challenges from the ground up. You will collaborate with researchers and infrastructure teams to optimize data movement, focusing on minimizing GPU idle time and accelerating time-to-insight.
What you'll do
- Design and build distributed storage systems for model training and evaluation
- Operate storage infrastructure on Kubernetes clusters at petabyte scale
- Collaborate with researchers to define throughput and latency requirements
- Solve networking and I/O challenges for moving large datasets across regions
- Optimize system performance to reduce GPU idle time and improve efficiency
What you'll need
- Strong fundamentals in storage replication, consistency, and caching
- Proficiency in Python or Go with willingness to learn the other
- Experience running stateful systems on Kubernetes including CSI drivers
- Hands-on work with cloud object storage like S3 and POSIX filesystems
- Ability to manage data lifecycle and ensure system durability
Nice to have
- Experience with parallel filesystems such as Weka, VAST, or Lustre
- Familiarity with data-loading patterns for large-scale model training
- Interest in understanding AI model training trajectories and eval data
- Knowledge of checkpointing strategies in distributed computing environments
Stack
- Python
- Go
- Kubernetes
- S3
- POSIX
- Weka
- VAST
- Lustre
How you'll work
- Remote-friendly with offices in major global cities
- Co-working benefit available for those not near an office
- $500 home office stipend for workspace setup
- Budget provided for traveling to other company offices
What you get
- Weekly lunch stipend equivalent to $75 or £75
- Full health and dental benefits including mental health budget
- Retirement savings matching via RRSP, 401K, or Pension Scheme
- 100% parental leave top-up for up to six months
- Six weeks of paid vacation totaling 30 working days
- Annual enrichment credits for arts, fitness, and wellness
- Education stipend for conferences, courses, and coaching
- Annual company offsite event for all employees