Databricks Architect | US
Cuesta Partners · Remote · Remote US ·
COMPENSATION
$145k – $188k
Listed on the employer's job board (Ashby)
- Fully remote (US)
- Databricks + PySpark
- AWS / Azure
- Client-facing role
- Senior level
Join Cuesta Partners as a Databricks Architect to drive the delivery of scalable data platforms in a client-facing consulting environment. You will partner directly with business leaders to translate requirements into technical architectures, overseeing end-to-end implementations on cloud infrastructure.
The position requires deep expertise in Databricks ecosystems, including pipeline construction and governance. You will provide technical guidance to engineering teams and serve as the primary technical contact for key accounts.
What you'll do
- Design scalable Databricks solutions for enterprise clients
- Lead cloud data platform implementations on AWS or Azure
- Build production pipelines using Spark and Databricks Workflows
- Translate business needs into technical architectures for stakeholders
- Provide technical leadership and mentorship to data teams
- Implement CI/CD and infrastructure-as-code for Databricks resources
- Drive collaborative development via Git workflows and code reviews
- Serve as primary technical contact for C-level executives
What you'll need
- 6+ years in Data Engineering or Cloud Architecture
- 3+ years of hands-on experience with Databricks
- Strong proficiency in PySpark, Spark SQL, Python, and SQL
- Deep experience with Delta Lake and Unity Catalog
- Proven track record in consulting or professional services
- Knowledge of data lake formats like Delta, Iceberg, and Parquet
- Experience managing governance and access control via Unity Catalog
- Familiarity with medallion architecture patterns
- Hands-on experience with Git, pull requests, and code reviews
- CI/CD and IaC skills using Terraform or GitHub Actions
- Experience with MLflow for tracking and deployment
- Background in client-facing or cross-functional environments
Nice to have
- Databricks certifications in Data Engineering or Machine Learning
- Experience with agentic AI workflows and Agentbricks
- Familiarity with LangChain and Claude agentic workflows
Stack
- Databricks
- PySpark
- Spark SQL
- Python
- SQL
- Delta Lake
- Unity Catalog
- Delta Live Tables
- AWS
- Azure
- Terraform
- GitHub Actions
- MLflow
- LangChain
How you'll work
- Flexible working location within the US
- Focus on personal-life harmony
What you get
- Competitive base salary plus 20-25% target bonus
- 401k retirement plan
- Healthcare benefits
- Paid time off
- Opportunities for continuous learning and exposure
- Influence on company strategy and direction