Senior Data Engineer
Socure · Remote · Remote - USA ·
COMPENSATION
$160k – $195k
Listed on the employer's job board (Ashby)
- Senior Data Engineer
- Fully remote
- AWS + Apache Spark
- Python or Scala
- No visa sponsorship
Join the Data Automation team at Socure, where you will design and build scalable data platforms and pipelines. Your work will power identity verification products and analytics, solving complex business problems with precision and ownership.
You will handle end-to-end delivery of data initiatives, from architecture to monitoring, while optimizing cost and performance. The role requires close collaboration with Data Science, Product, and Engineering teams to translate requirements into technical solutions.
What you'll do
- Design batch and streaming pipelines for data ingestion and ML feature engineering
- Own end-to-end delivery of data initiatives including architecture and deployment
- Evolve the data platform using modern cloud-native technologies
- Automate data operations such as validation, quality checks, and recovery workflows
- Optimize cost, performance, and reliability of data workloads
- Partner with cross-functional teams to translate requirements into technical solutions
- Evaluate and adopt new technologies like GenAI-assisted ingestion tools
What you'll need
- 5+ years of hands-on data engineering experience with production-grade platforms
- Strong programming skills in Python or Scala and SQL for analytics
- Deep experience with Apache Spark, including performance tuning
- Proven experience building data solutions on AWS (EMR, Lambda, S3)
- Strong understanding of data modeling and warehousing concepts
- Experience operating production pipelines with monitoring and incident response
- Solid foundation in software engineering practices like CI/CD and testing
Nice to have
- Experience with streaming processing tools like Kafka or Kinesis
- Hands-on experience with orchestration tools like Airflow or Step Functions
- Familiarity with Data Lakehouse, Data Mesh, or large-scale data sharing
- Experience with prompt engineering using LLMs and GenAI
- Experience mentoring engineers and contributing to best practices
Stack
- Python
- Scala
- SQL
- Apache Spark
- AWS
- EMR
- Lambda
- S3
- Kafka
- Kinesis
- Airflow
- Step Functions
How you'll work
- Fully remote position
- No visa sponsorship available now or in the future