Senior Anti-Bot / Scraping Engineer
Adthena · Remote · London I UK Remote ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Senior level role
- Fully remote (UK)
- Python + Playwright
- Anti-bot expertise
- Stock options included
You will design and operate large-scale scraping infrastructure targeting Google and other protected platforms. This position combines data engineering, reverse engineering, and systems reliability to deliver trustworthy competitive insights.
The team values pragmatic problem-solving in hostile technical environments. You will work with browser automation and hybrid approaches to handle dynamic rendering and frequent markup changes.
What you'll do
- Design Python scraping systems for highly defended websites like Google
- Build scrapers for JavaScript-heavy pages using browser automation
- Adapt continuously to changes in page structure and anti-automation mechanisms
- Engineer extraction pipelines prioritizing data accuracy and observability
- Implement proxy and fingerprinting strategies to maximize stability
- Monitor scrape health and debug production issues rapidly
- Optimize performance, cost, and latency across infrastructure
- Document logic and runbooks for long-term maintainability
What you'll need
- Strong professional experience with Python, Go, Rust, or JavaScript
- Deep hands-on experience scraping Google or similarly protected platforms
- Solid understanding of HTTP, TLS, cookies, and browser networking
- Experience with Playwright, Selenium, Puppeteer, or similar tools
- Strong knowledge of HTML parsing and DOM traversal techniques
- Experience handling rate limiting, CAPTCHA, and bot detection systems
- Comfortable with asynchronous and concurrent scraping architectures
- Experience running scrapers at scale in cloud environments
- Knowledge of headless browser fingerprinting and evasion techniques
Nice to have
- Familiarity with Docker and Kubernetes
- Experience with distributed task systems and job queues
- Background in data quality monitoring and anomaly detection
- Experience with search or advertising intelligence data
Stack
- Python
- GoLang
- Rust
- JavaScript
- Playwright
- Selenium
- Puppeteer
- Docker
- Kubernetes
How you'll work
- Fully remote within the UK
- Flexible work hours with autonomy
- Trust-based vacation policy
- Reports to Head of Engineering
What you get
- Stock options for all employees
- $200 home office stipend
- $70 swag welcome credit
- Paid birthday day off
- Up to 6 months paid maternity leave
- 2 months paid paternity leave
- Quarterly paid volunteer days
- Regular socials and company offsites
- Bespoke career development plans
Hiring process
- Two stage interview process
- Start date is ASAP