Research Staff, Voice AI Foundations
Deepgram · Remote · USA - Remote · San Francisco, CA · Ann Arbor, Michigan ·
COMPENSATION
$150k – $250k
Listed on the employer's job board (Ashby)
- Fully remote
- Research Staff level
- Voice AI focus
- AI-first culture
- Global team
Join Deepgram's research team to develop new paradigms for audio AI, specifically focusing on Latent Space Models. You will work on solving fundamental challenges in data scarcity, computational cost, and model scalability for voice interactions. The team aims to build robust, contextualized voice AI that supports universal human interaction through innovative architectural and algorithmic approaches.
What you'll do
- Build next-generation neural audio codecs for extreme compression and high fidelity
- Pioneer steerable generative models for diverse speech synthesis scenarios
- Develop embedding systems to factorize codec latent space into interpretable dimensions
- Leverage latent recombination to generate synthetic audio data at massive scales
- Train multimodal speech-to-speech systems for empathic and task-oriented responses
- Design model architectures and training schemes optimized for hardware efficiency
What you'll need
- Strong foundation in statistical learning theory and self-supervised learning
- Deep expertise in foundation model architectures and multimodal scaling
- Ability to bridge theory and practice with efficient implementations
- Experience building data pipelines for massive dataset curation
- Track record of designing controlled experiments to validate innovations
- Knowledge of hardware constraints and optimization for real-world deployment
- History of open-source contributions or relevant research publications
Stack
- Python
- PyTorch
- Triton
- TPU
- Neural Audio Codecs
- Latent Space Models
How you'll work
- Fully remote position
- AI-first mindset required for daily workflows
- Fast-paced environment with rapid adaptation to change
- Expectation to actively use and build AI tools