Software Engineer, LLM & Automation
Basis Research Institute · Remote · New York Office · Remote ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Fully remote
- Python or Julia
- LLM integration
- Flexible contract type
- Nonprofit research
Basis is a nonprofit applied AI research organization focused on understanding intelligence and solving complex societal problems. This role centers on developing scalable systems that combine large language models with everyday business operations. You will create automated pipelines that streamline tasks across various departments while ensuring robustness and security.
What you'll do
- Architect automation pipelines combining internal tools with LLMs like GPT or Claude
- Integrate data from third-party APIs into unified automated workflows
- Use structured generation techniques to ensure correct LLM outputs
- Collaborate with Ops and R&D teams to identify automation opportunities
- Write production-grade code with focus on modularity and error handling
- Deploy and optimize solutions in secure cloud environments
- Document technical solutions for both technical and non-technical audiences
What you'll need
- 3+ years of production-level coding experience in Julia and/or Python
- Experience integrating LLMs using structured prompts or scaffolding frameworks
- Ability to handle concurrency and performance optimizations in deployments
- Comfortable with complex API orchestration including rate limits and OAuth
- Strong collaboration skills for gathering requirements from non-technical staff
- Knowledge of data-security best practices like encryption and secrets management
- Adaptable to iterative development cycles and new AI ecosystem developments
Nice to have
- Experience with Julia type-driven approaches or scientific computing
- Building Python microservices with FastAPI or Flask
- Familiarity with LangChain or open source LLM clients
- Knowledge of Docker, Kubernetes, and CI/CD pipelines
- Experience with task queues like Celery or Sidekiq
- Ability to design schemas and queries in PostgreSQL
- Understanding of OAuth flows and role-based access controls
Stack
- Julia
- Python
- GPT
- Claude
- LangChain
- FastAPI
- Flask
- Docker
- Kubernetes
- AWS
- GCP
- Azure
- Celery
- PostgreSQL
How you'll work
- Fully remote position
- Flexible arrangement: full-time, part-time, or contract
- Global hiring potential with data processing in US and other countries