AI Infrastructure Engineer

vCluster Labs · Remote · Remote · United States ·
Fully remoteFull-timeMiddle3–5 years
COMPENSATION
$140k – $165k
0 applicants so far

Listed on the employer's job board (Ashby)

  • Fully remote
  • Kubernetes + GPU
  • Bare metal focus
  • Pre-sales technical
  • Venture-backed

As an AI Infrastructure Specialist, you will engage with customers during critical pre-sale proof of value stages, guiding them from bare metal setup to production-ready deployments. You will configure GPU nodes, troubleshoot networking and storage, and collaborate with engineering to refine the product roadmap based on field feedback.

This role focuses on enabling AI Cloud providers to offer managed Kubernetes on their own hardware. You will document architectures and transfer knowledge to customer teams, ensuring they can operate independently while scaling the company's deployment motion.

What you'll do

  • Lead end-to-end technical deployments for GPU neocloud customers
  • Configure and troubleshoot bare metal GPU node infrastructure
  • Set up CNI, GPU Operator, distributed storage, and RDMA
  • Validate Kubernetes and vCluster environments for production
  • Train customer teams to ensure operational self-sufficiency
  • Document reusable playbooks and deployment architectures
  • Provide feedback to Engineering and Product on infrastructure challenges
  • Support sales with deep technical work during proof of value

What you'll need

  • 5+ years of experience deploying Kubernetes in production
  • Experience with bare metal or high-complexity environments
  • Practical knowledge of NVIDIA GPU Operators and CUDA tooling
  • Deep understanding of CNI plugins and overlay networks
  • Experience with persistent volumes and CSI drivers
  • Familiarity with distributed storage like Ceph, Rook, or Weka
  • Comfort working in ambiguous, fast-moving environments

Nice to have

  • Scripting skills in Bash, Python, or Go
  • CKA certification or experience writing Kubernetes Operators
  • Experience with inference serving and LLM deployment tooling
  • Background in building documentation for shared knowledge bases

Stack

  • Kubernetes
  • vCluster
  • NVIDIA GPU Operator
  • CUDA
  • CNI
  • RDMA
  • InfiniBand
  • Ceph
  • Rook
  • Weka
  • Longhorn
  • Bash
  • Python
  • Go

How you'll work

  • Remote-first culture with global team distribution
  • Flexible working schedule focused on results
  • HQ in San Francisco but not required for role

What you get

  • Competitive compensation package including equity
  • Health, dental, vision, and life insurance
  • Coverage for eligible dependents varies by country
  • Flexible schedule for appointments and personal needs