Research Engineer - Web Crawlers
ElevenLabs · Remote · United Kingdom · United States · Poland · Bulgaria ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Fully remote (Global)
- Web Crawling & Scraping
- Distributed Systems
- AI Training Data
- No Degree Required
Join the research team at ElevenLabs to own the crawling systems that source high-quality data from the open web. You will build and operate distributed crawlers that discover, fetch, and extract content across billions of pages efficiently. Your work directly impacts the quality of frontier AI models by ensuring reliable access to world-class training data.
What you'll do
- Build and operate distributed web crawlers for billions of pages
- Solve challenges in content extraction from messy HTML structures
- Implement deduplication strategies at massive web scale
- Manage freshness, recrawl strategies, and rate-limit handling
- Design pipelines for audio, video, and multilingual content
- Create tooling for researchers to monitor and explore crawled data
What you'll need
- Experience building and scaling web crawlers or scraping systems
- Background supporting machine learning training data collection
- Strong skills in distributed systems at scale
- Proficiency with Kubernetes or queue-based architectures
- Ability to evaluate data quality, coverage, and compliance
- Capability to build tooling for measuring data metrics
Stack
- Kubernetes
- Web Crawlers
- Distributed Systems
How you'll work
- Fully remote with global eligibility
- Optional office access in London, New York, San Francisco, Warsaw
- High-velocity environment with lean autonomous teams
- Minimal bureaucracy and focus on impact over titles
What you get
- Annual discretionary stipend for professional development
- Annual discretionary stipend for social travel with colleagues
- Yearly company offsite in locations like Croatia or Italy
- Monthly co-working stipend for those away from main hubs
- Opportunity to define the trajectory of AI technology