Senior Data Engineer
Darkroom · Remote · Pakistan · India · Brazil ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Senior Data Engineer
- Fully remote (EST hours)
- Python + SQL
- BigQuery + GCP
- SOC 2 compliant
You will own the data layer that powers Shadow’s AI coordination platform, ensuring marketing data from platforms like Meta and Shopify lands cleanly and reliably. This hands-on engineering role involves designing normalization pipelines, managing multi-tenant scale, and maintaining strict data security for thousands of users.
What you'll do
- Build ingestion layers for third-party marketing APIs including auth and sync handling
- Design normalization pipelines mapping platform-specific data to shared schemas
- Ensure data reliability through observability, accuracy checks, and freshness monitoring
- Engineer multi-tenant systems for performance, cost-efficiency, and data isolation
- Collaborate with AI teams to expose clean data for agent retrieval and reasoning
What you'll need
- Experience building enterprise data pipelines serving 1,000+ users or equivalent volume
- Strong proficiency in SQL and Python with modern data warehouse experience
- Deep knowledge of ETL/ELT patterns, incremental sync, and analytics data modeling
- Proven track record maintaining integrations against third-party APIs with OAuth
- Experience operating within SOC 2-compliant systems with enterprise-grade security
Nice to have
- Background in martech, adtech, or ecommerce data domains
- Familiarity with GCP, BigQuery, PostgreSQL, and dbt or Airflow
- Experience with pipeline observability in AI or LLM contexts
- Comfort supporting data feeds for AI agents and retrieval systems
Stack
- Python
- SQL
- BigQuery
- GCP
- PostgreSQL
- dbt
- Airflow
How you'll work
- Fully remote position
- Core hours 9 AM to 5 PM EST
- Hub locations include Brazil and Spain
What you get
- Unlimited PTO plus local holidays
- Flexible parental leave
- Remote-first culture with growth opportunities