Director of Infrastructure Engineering
Runpod · Remote · Remote - USA ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Director level role
- Fully remote team
- AI infrastructure focus
- HPC & Networking
- No visa sponsorship
You will lead the engineering teams responsible for Site Reliability Engineering, networking, and storage at Runpod. Your focus is ensuring the platform remains highly available and performant for millions of developers training and running large-scale AI models.
This leadership role involves defining technical direction, establishing rigorous SRE practices, and managing managers across distributed teams. You will partner with product and go-to-market leaders to support enterprise customers and scale infrastructure to meet massive GPU computing demands.
What you'll do
- Lead multiple engineering teams covering SRE, networking, and storage systems
- Establish rigorous SRE practices including SLA definitions and incident response
- Oversee design and scaling of global network backbone and HPC clusters
- Drive implementation of InfiniBand and RoCE for multi-node GPU training
- Direct architecture and performance tuning of distributed storage engines
- Hire and mentor engineering managers and senior individual contributors
- Partner with product teams to forecast capacity and shape technical roadmaps
- Improve infrastructure reliability metrics such as MTTR and deployment frequency
What you'll need
- 7+ years leading software, infrastructure, SRE, or networking teams
- Experience managing managers and multiple squads in high-availability environments
- 8+ years building and operating large-scale distributed or bare-metal systems
- Deep familiarity with InfiniBand, RoCE, spine-leaf architectures, and BGP
- Experience with high-performance distributed storage like Ceph, Lustre, or Weka
- Strong foundation in Terraform, Ansible, Kubernetes, and observability stacks
- Proven ability to build culture and accountability in remote-first teams
- Clear communication skills and calm leadership during operational incidents
Nice to have
- Experience architecting infrastructure for massive GPU clusters and AI workloads
- Understanding of hardware architectures, NVLink, and datacenter topology
- Track record of scaling infrastructure teams in hyper-growth startups
- Open-source contributions in infrastructure, networking, or Kubernetes communities
Stack
- InfiniBand
- RoCE
- Ceph
- Lustre
- Weka
- NVMe-oF
- Terraform
- Ansible
- Kubernetes
How you'll work
- Fully remote work environment
- Slack used for internal communication
- Must be eligible to work in the United States
- No employment visa sponsorship available
What you get
- Base salary range between $225,000 and $325,000
- Meaningful equity and stock options for all employees
- Generous medical, dental, and vision insurance plans
- Flexible paid time off policy
- $1,200 stipend for home office and equipment