Backend Engineer, AI (Agent Systems)
Bjak · Remote · China ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Fully remote
- Backend + AI Infrastructure
- Python & Node.js
- Kubernetes & Docker
- Small high-talent team
You will own the backend infrastructure that powers AI interactions, sitting between large language models and end users. Your focus is on turning model capabilities into stable, observable APIs for mobile and desktop clients while ensuring minimal prompting is required for users.
The team prioritizes high reliability for long-running workflows and persistent context. You will design service boundaries around models and optimize systems for speed, correctness, and cost efficiency in a production environment.
What you'll do
- Build and operate backend systems serving AI features in production
- Design inference pipelines and orchestration layers around models
- Manage monitoring, logging, alerting, and incident response
- Optimize latency and throughput via caching, batching, and streaming
- Ensure APIs are stable and support seamless frontend integration
What you'll need
- Strong backend engineering fundamentals in production environments
- Experience running high-throughput, low-latency services
- Familiarity with AI inference patterns like LLMs and embeddings
- Comfortable debugging distributed systems under heavy load
- Bias toward shipping code and learning from production behavior
Stack
- Python
- NodeJs
- Pytorch
- OpenAI
- Anthropic
- SQL
- NoSQL
- Kubernetes
- Docker
Hiring process
- Technical team evaluates initial applications
- Schedule three to four interviews maximum
- Interviews conducted via virtual meetings or onsite
- Prompt decision provided after final assessment