Staff / Principal Software Engineer - Canada
Inworld · Remote · Vancouver, British Columbia, Canada ·
COMPENSATION
€•• – ••k
Listed on the employer's job board (Ashby)
- Staff/Principal level
- Fully remote (Canada)
- Go, Python, C++, Rust
- High-scale AI infra
- Equity included
Join Inworld as a senior individual contributor to shape the backend architecture of their AI platform. You will work on high-volume systems serving trillions of tokens monthly, focusing on products like Inworld Router, TTS, and STT.
The team tackles challenges in realtime performance, multi-provider failover, and large-scale serving infrastructure. You will collaborate closely with machine learning teams to deliver low-latency solutions for developers building next-generation AI apps.
What you'll do
- Own core systems for multi-provider failover and cost-based routing
- Build realtime observability tools for massive scale operations
- Develop API-based model services including TTS and STT
- Collaborate with product managers to define technical scope and priorities
- Drive system improvements and advocate for engineering best practices
- Design low-latency routing layers handling hundreds of LLM providers
What you'll need
- Expertise in statically typed backend languages like Go, Python, C++, or Rust
- Experience deploying cloud services handling hundreds of queries per second
- Proficiency with relational databases such as PostgreSQL or MySQL
- Hands-on experience with Redis, Memcached, pubsub queues, and data pipelines
- Strong verbal and written communication skills for cross-team collaboration
- Ability to operate with technical autonomy and suggest new standards
Nice to have
- Experience building API gateways or multi-provider orchestration systems
- Familiarity with analytics databases like ClickHouse or Timescale
- Knowledge of OpenTelemetry for distributed tracing
- Background in C++ development
Stack
- Go
- Python
- C++
- Rust
- PostgreSQL
- MySQL
- Redis
- Memcached
- Flink
- Beam
- ClickHouse
- Timescale
- InfluxDB
- OpenTelemetry
How you'll work
- Fully remote within Canada
- Individual contributor focused role
- Collaboration with ML and engineering teams
What you get
- Base salary between C$180,000 and C$260,000
- Equity compensation included
- Comprehensive benefits package