Remote Spark jobs

Join Kraken’s Finance Data Engineering and Analytics team to build trusted financial data products. You will work at the intersection of data engineering and accounting, creating automated workflows for reconciliations and reporting. Your work will reduce manual effort in the financial close process by leveraging automation and AI-assisted tools. You will collaborate with Finance and Engineering stakeholders to ensure data reliability and traceability.

• Senior level role
• Finance data focus
• SQL + Python
• Crypto industry

Join the Finance Data Engineering and Analytics team at Kraken to build trusted financial data products. You will work at the intersection of data engineering and accounting, creating automated pipelines and models to streamline the financial close process. The role involves partnering with Finance and Engineering teams to transform complex financial data into reliable insights. You will use automation and AI-assisted tools to reduce manual work, improve reporting accuracy, and support decision-making across the organization.

• Senior level role
• Finance data focus
• SQL + Python
• Crypto industry

Horizontal is looking for a Principal Data Engineer to lead the modernization of its enterprise data platform. You will reverse-engineer complex existing solutions and migrate validated workloads from Azure Synapse Analytics to a Databricks lakehouse environment. The team focuses on maintaining business-critical data accuracy during transition, strengthening governance frameworks, and eliminating technical debt through robust re-engineering practices.

• Principal level role
• Azure to Databricks migration
• Fully remote
• 7+ years experience

You will develop and maintain scalable data pipelines while designing data lake and warehouse architectures. The role involves collaborating with analysts and stakeholders to model datasets and enable self-service analytics capabilities.

• AWS and Azure experience
• Apache Spark framework
• Data pipeline development
• 2+ years IT experience

This contract role targets an early-career engineer who integrates AI tools into their daily workflow. You will build and maintain data pipelines alongside senior engineers, using AI for scaffolding and debugging while ensuring rigorous validation of all output.

• Junior level (1-2 years)
• Contract assignment
• Python + Spark + AWS
• AI-first workflow

CACI is seeking a Senior Foundry Developer to join the Agile Solution Factory team supporting Palantir's Army Vantage. You will design and deploy advanced data integration and analytics solutions while ensuring interoperability with DoW platforms like ADVANA. The position requires building complex multi-page Workshop applications, managing ontology structures, and developing robust data pipelines. You will collaborate with stakeholders in an Agile Scrum environment to deliver high-impact technical solutions.

• Senior level role
• Fully remote (US)
• Secret clearance required
• Palantir Foundry

Join LanceDB to expand the reach of Lance and LanceDB within the data infrastructure ecosystem. You will work at the intersection of high-performance computing and big data, contributing to scale, performance, and usability improvements for an AI-native platform used by companies like Netflix and Midjourney.

• Senior level role
• Rust + Big Data
• Open-source focus
• High-performance systems

Join Horizon3 to design and own the data platform supporting business-critical pipelines for account provisioning and product analytics. You will expand infrastructure across multiple regions with a special focus on Federal workloads, evaluating lakehouse platforms and defining data contracts.

• Senior Data Engineer
• US Citizenship required
• TS Clearance eligible
• AWS + Databricks

Join Quora's small, collaborative ML team to build AI-powered systems that detect harmful content and automate moderation decisions. You will work on the main Quora product, leveraging large language models to improve safety and quality for hundreds of millions of users. This position is open to new graduates who can start full-time in early 2027. You will collaborate with experienced engineers to take ownership of projects from development through production deployment.

• Fully remote (US/Canada)
• New Grad Role
• LLM & Agent Focus
• Python & PyTorch

You will serve as the technical link between clients and the engineering team, translating data challenges into scalable architectures. Working with DataPilot and DataMates technology, you will help enterprises automate data operations using agentic AI within modern workflows.

• Databricks expert
• 6+ years experience
• AI + Lakehouse focus
• Early GTM team member

You will design, build, and maintain robust data processing pipelines for extraction, transformation, and loading. The role requires developing scalable solutions that enhance data flow and enable faster analysis for end-users across the organization.

• Senior level position
• Python, SQL, Spark
• AWS or Azure cloud
• Financial services focus

Join the team empowering Walmart's US stores and eCommerce through technological innovation. You will develop data science tools that enhance financial planning and strategic decision-making by utilizing state-of-the-art Generative AI systems. The role requires building large-scale applications that summarize complex financial data, providing concise insights to decision-makers. You will collaborate closely with finance teams and product stakeholders to productionize these solutions.

• Fully remote (EU)
• Generative AI & LLMs
• Python + Spark
• Senior level

Join the Navigation team at Mapbox to build recommendation systems for the routing cost engine. You will lead technical execution for a group of approximately 80 engineers, focusing on distributed systems and geospatial data. The team powers navigation for consumer, automotive, and logistics sectors, working with partners like BMW and Toyota. Your work will directly impact in-vehicle experiences and map accuracy through advanced machine learning models.

• Senior ML Engineer
• Python + Spark
• AWS Cloud
• On-call rotation

Join Talan, an international consulting group focused on innovation and business transformation. As a Backend Developer, you will collaborate with a multidisciplinary team to deliver high-quality, business-critical data solutions using modern technologies.

• Fully remote (EU)
• Apache Spark + Scala
• PL/SQL experience
• Agile environment

Join Plexus Tech as a Multi-Tenant Platform Administrator, where you will oversee the operation and support of data platform environments across development, pre-production, and production stages. You will manage technical components for data ingestion, processing, and visualization, ensuring high availability and performance. The team relies on your expertise to monitor infrastructure, handle incidents, and implement automations using Python or Bash. You will play a key role in maintaining security standards, managing backups, and supporting the evolution of platforms used by public administration bodies.

• 5+ years platform admin
• Kubernetes & Big Data
• Python & Bash automation
• Cloudera operations

Join Plexus Tech as a Multi-Tenant Platform Administrator, where you will handle the administration, operation, and technical support of data platform environments. You will work across development, pre-production, and production stages, managing components for data ingestion, processing, and visualization. Your focus will be on maintaining infrastructure stability through continuous monitoring, incident management, and automated operational tasks. You will ensure high availability, manage backups, and support compliance with security and privacy standards while optimizing resource usage across Kubernetes clusters and Big Data tools.

• Fully remote (EU)
• 5+ years experience
• Kubernetes & Hadoop
• Python & Bash automation

Join the FDL - Ecomm team to develop scalable software solutions for SAP posting and eCommerce data reporting. You will blend traditional data engineering with advanced AI capabilities, including generative AI, to enhance development efficiency and support business goals. The team emphasizes technical excellence, continuous improvement, and a product-driven approach to deliver high-quality outcomes.

• Senior level role
• Python + GCP focus
• AI & Data Engineering
• Retail domain experience

Join a small engineering team at Clipbook to develop features for over 200 clients, including major consultancies and government agencies. You will own feature development end-to-end, making key architectural decisions while shipping code quickly to real users. The company processes news, audio, and video data at scale using AI. You will work alongside engineers from top tech firms to build robust APIs and services that power the product.

• Fully remote (Europe)
• Senior level role
• Python + TypeScript
• AI/ML integration

Join Clipbook as a founding engineer to help reinvent how leaders engage with global information. You will work on a platform that processes news, audio, and video data in real time to surface actionable insights. You will collaborate with a small engineering team to develop features that ship quickly to over 200 clients, including major consulting firms and government agencies. The role offers significant ownership over technical decisions and system architecture.

• Founding Senior Engineer
• Fully remote (UK/EU)
• AI/ML & Backend focus
• Python + TypeScript

You will design and validate statistical algorithms and machine learning models to help employers understand healthcare costs and risks. This position focuses on total-cost-of-care forecasting and evaluating health program impacts using rigorous causal inference methods. Working with actuaries, consultants, and engineering teams, you will move models from development into governed, monitored production environments. You will also mentor junior scientists and ensure methodological rigor across analytics deliverables.

• 7+ years experience
• US Health Data focus
• Python and R required
• MLOps and Governance

Join the Customer Portfolio Enablement team to enhance the experience for Marqeta’s clients. You will develop systems that allow customers to test integrations and migrate existing data at scale. The work involves creating resilient software solutions that support seamless onboarding and continuous platform usage.

• Senior Backend Engineer
• Fully remote (Canada)
• Java Spring Boot
• AWS Cloud

You will design and maintain high-performing Power BI dashboards and semantic models. The role involves writing optimized SQL queries and troubleshooting data pipelines across cloud platforms to support business insights.

• 2-5 years experience
• Power BI + DAX
• Strong SQL skills
• Microsoft Fabric

You will lead the development of the data platform that powers Lyric's AI agents and products. The core challenge is building a robust semantic layer, including entity models and knowledge graphs, that allows reliable querying by automated systems. This is a principal individual contributor role where you will define technical direction, write production code, and ensure system correctness and reliability across a multi-tenant environment.

• Principal IC role
• Hybrid India / Remote EU
• Data platform ownership
• Semantic layer focus

BestX is looking for a Senior Data Architect to lead the design of its next-generation cloud-native data platform. You will leverage Databricks, Snowflake, and modern engineering practices to support multi-asset Transaction Cost Analysis, analytics, and reporting capabilities. The role combines strategic architecture with hands-on engineering, requiring you to evaluate emerging technologies, prototype solutions, and implement scalable production systems. You will work closely with quantitative researchers and product teams to translate business needs into technical reality.

• Senior Data Architect
• Databricks + Snowflake
• AWS Cloud Environment
• Financial Services Focus

Join the Strategic Intelligence & Technology organization at Chartis to drive healthcare transformation through data. You will bridge consulting teams and technical resources by preparing client data, conducting exploratory analysis, and building reusable analytics assets. This role focuses on the Revenue Cycle Transformation practice, enabling data-driven strategies for providers and payers.

• Fully remote (US)
• Healthcare analytics
• SQL + Power BI/Tableau
• Epic Clarity required

You will design and build scalable backend applications and microservices using Python. The role emphasizes developing robust services, APIs, and data processing systems that support enterprise analytics and complex business problems. Key responsibilities include leveraging emerging technologies like LLMs and GenAI, handling structured and unstructured data, and ensuring solutions meet enterprise architecture and scalability standards.

• Hybrid work setup
• 5-7 years experience
• Python + Microservices
• LLM & GenAI focus

Join the Data Engineering & Architecture team as a Lead Data Engineer. You will design and improve pipelines and infrastructure, ensuring data flows reliably from ingestion to delivery. The role combines technical execution with stakeholder collaboration to make data accessible and trustworthy for the entire organization.

• Lead Data Engineer
• Fully remote (EU)
• 8+ years experience
• GCP + Terraform

You will provide comprehensive administration for the Azure Data Lake platform, focusing on Azure Databricks, ADLS, and Data Factory. The role involves managing user provisioning, security policies, and system performance while ensuring strict compliance with change control standards.

• Senior level role
• Azure Databricks focus
• Python & PowerShell
• No visa sponsorship

You will provide comprehensive administration and operational support for the Azure Data Lake platform. The role involves managing Azure Databricks, Azure Data Lake Storage, and Azure Data Factory to ensure system efficiency and security. Key responsibilities include overseeing user provisioning, managing cluster health, and automating tasks using Python and PowerShell. You will also handle code deployments and troubleshoot complex pipeline integrations across various enterprise tools.

• Senior level role
• Azure Databricks focus
• Python & PowerShell
• US work auth required

You will provide comprehensive administration and operational support for the Azure Data Lake platform. The role centers on managing Azure Databricks, Azure Data Lake Storage, and Azure Data Factory to ensure system efficiency and security. Key responsibilities include overseeing user provisioning, managing cluster health, and automating tasks using Python and PowerShell. You will also handle code deployments and troubleshoot complex pipeline integrations across various enterprise tools.

• Senior level role
• Azure Databricks focus
• Python & PowerShell
• No visa sponsorship

As a Data Solutions Architect at SunnyData, you will serve as a trusted advisor to customers, guiding their data engineering and architecture strategies with a focus on Databricks solutions. You will split your time equally between hands-on technical execution, such as designing and deploying end-to-end data pipelines, and presales support, where you partner with sales teams to demonstrate technical value to prospective clients.

• Databricks partner
• 7+ years experience
• Presales & Delivery
• Financial Services

As a Principal Solutions Architect at SunnyData, you will split your time evenly between hands-on technical delivery and presales support. You will serve as a trusted advisor to clients, guiding their data engineering strategies and building robust solutions on the Databricks platform. You will partner with sales teams to demonstrate technical value while managing multiple customer accounts. The role requires leading architecture discovery sessions, ensuring solution quality, and mentoring internal project teams to deliver innovative AI and ML applications.

• Principal level role
• Fully remote (US)
• Databricks partner
• Financial Services focus

Join Monte Carlo to build the core backend services and distributed systems for their agent trust platform. You will take ambiguous problem statements from prototype to deployed product, ensuring reliability for enterprise AI systems.

• Senior level
• Python + React
• Distributed systems
• 0-to-1 ownership

Join SunnyData to help customers build solid data foundations through scalable architectures and robust engineering pipelines. You will work directly with internal teams and clients to design, build, and operationalize complex data solutions that support Artificial Intelligence and Business Intelligence goals.

• Senior Data Engineer
• 5+ years experience
• Spark, Kafka, SQL
• AWS, Azure, GCP

As a Designated Support Engineer, you will act as a trusted advisor to Snowflake's priority customers, bridging complex business challenges with technical solutions. You will lead efforts to transform support into a proactive service, handling everything from query optimization and cost analysis to disaster recovery planning. The role requires an AI-first mindset, using intelligent tools to accelerate triage and resolution while maintaining high-quality human oversight. You will collaborate with internal engineering and product teams to improve the platform based on direct customer feedback and real-world usage patterns.

• Staff level role
• 7+ years experience
• Advanced SQL expertise
• AI-native workflow

Join the global Support Engineering team at ClickHouse to provide technical assistance to users across APJ, APAC, and EMEA. You will handle support tickets, assist with pre- and post-sales activities, and contribute to community knowledge through documentation and webinars. This customer-facing role requires close partnership with Go To Market, Engineering, and Product Management teams. You will help define user-required functionality and mentor colleagues while maintaining high service standards.

• Senior level role
• Remote (Singapore only)
• ClickHouse expertise
• Global customer support

You will serve as the technical lead for the data governance platform, translating policy needs into enforceable engineering solutions. Working within the Data and ML team, you will define technical direction and partner with stakeholders to ensure compliance and quality standards are met across the organization.

• Senior Staff level
• Fully remote (US)
• Python + Java
• Data Governance focus

Join the Data Platform team to build highly available infrastructure that supports TRM's AI-powered intelligence solutions. You will develop systems that trace illicit activity and help disrupt crime by analyzing blockchain data. The team collaborates with data scientists and product managers to create services that process structured and unstructured data in real time. Your work will directly contribute to making the global financial system safer.

• Senior or Staff level
• Fully remote (Canada)
• Python + Spark + Kafka
• Petabyte-scale data

Join the Data Platform team to build highly available infrastructure that powers AI-driven crime investigation tools. You will design systems that process petabytes of blockchain data, enabling investigators to trace illicit activity and secure the financial system. The team collaborates with data scientists and product managers to deliver real-time insights. You will architect data models and pipelines that support sub-second latency for complex queries across dozens of blockchains.

• Senior or Staff level
• Fully remote (Brazil)
• Python + Spark + Kafka
• Petabyte-scale data

As a Forward Deployed Engineer, you will work directly inside customer environments to turn platform commitments into production outcomes. You will design, build, and deploy integrations while partnering with internal engineering teams to improve the core product based on field feedback.

• Fully remote (US/India)
• Python, Java, Go, Scala
• Kubernetes + Terraform
• Senior level role

You will own end-to-end data infrastructure projects, from design to production, supporting analytics and product teams. The work focuses on deploying robust systems, implementing security controls for the data lake, and enabling strategic data access across the organization.

• Senior Data Engineer
• Fully remote (CA/US/UK)
• AWS + Terraform
• Snowflake + Iceberg

As the Director of Decision Science, you will own the function’s strategy, standards, and personnel. You will hire and coach a team of decision scientists while remaining hands-on enough to review models and test designs. Your work will directly influence product development, pricing strategies, and operational efficiency by providing clear, data-backed recommendations to senior leaders.

• Director level role
• People leadership focus
• Fully remote options
• SQL + Python/R

Join Loopio’s Data Engineering Team to transform the RFP response process through robust data infrastructure. You will build and maintain scalable ETL pipelines, data warehouses, and feature stores that power both internal analytics and customer-facing platform features. This position requires close collaboration with data scientists, architects, and product managers. You will integrate diverse data sources, including clickstream and unstructured data, to support predictive modeling and business insights across RevOps, Marketing, and CX teams.

• Fully remote (Canada/UK/India)
• Python + AWS + Databricks
• 3+ years experience required
• Home office budget provided

Join the Threat Protection department to build cybersecurity features that secure user privacy and data. You will design robust data pipelines, optimize processes for scalability, and ensure data accuracy across distributed systems.

• Senior level
• Python, Scala, Go, Java
• AWS & Databricks
• Leadership duties

Join the data practice at Cuesta Partners to shape greenfield projects and drive client data strategies. You will deliver scalable data environments, ensure data integrity, and unlock analytical insights through robust architecture and leadership.

• Fully remote (Canada)
• Data Tech Lead
• 8-10 years experience
• AI-assisted dev tools

Join the Data Product team at TRM Labs to design and build mission-critical data services that power AI-powered intelligence solutions. You will collaborate with data scientists and engineers to create features that trace illicit activity on blockchains, ensuring sub-second latency for querying massive datasets. This position requires strong architectural skills and the ability to translate user needs into scalable technical solutions. You will work in a high-velocity, distributed team that values ownership, clear communication, and rapid iteration to deliver impact for global security agencies.

• Staff level role
• Fully remote (US)
• Python + SQL
• Blockchain data scale

You will own the product roadmap for Trust Wallet's data platform, transforming scattered capabilities into reusable products. Responsibilities include leading multi-chain data ingestion, managing token and market data sources, and serving downstream teams with APIs and analytics tools. The role requires close collaboration with engineering and business teams to ensure data accuracy, governance, and quality. You will define standardized parsing logic for various blockchains and establish mechanisms for data validation across multiple sources.

• Senior Product Manager
• Fully remote (Global)
• Web3 & Data Platform
• SQL proficiency required

Join the AI and Data Engineering team at E Source to solve operational challenges for North American utilities. You will embed directly with clients to understand their needs and build governed, reliable data systems in their environments. The work focuses on delivering trusted data flows quickly and hardening them for production use.

• Senior Data Engineer
• Remote (US only)
• Databricks + AWS
• 30-50% Travel

You will lead the product strategy for SentiLink’s identity resolution tools, including prefill and data merging technologies. Working closely with engineering and data science teams, you will translate complex internal needs into clear requirements and drive delivery from concept to adoption. The role involves managing cross-functional initiatives to improve the reliability and scalability of internal platforms. You will balance immediate operational demands with long-term strategic goals to ensure data assets support the company's rapid growth.

• Product Leader role
• Data platform focus
• US or India based
• Flexible remote work

Join Jellyfish to help build the foundations that make engineering data reliable and easy to use. You will work on maturing the Databricks-based platform, moving data from raw ingestion to trusted production datasets. The team focuses on turning messy pipelines into durable architecture. You will define how the modern lakehouse operates, covering ingestion, transformation, storage, governance, and serving.

• Senior Data Engineer
• Fully remote (US)
• Databricks + Spark
• No visa sponsorship