9h ago
Staff / Principal Software Engineer
Vancouver, British Columbia, Canada
$180k-$260k / year
full-timesenior Hybridai-ml
🛠 Tech Stack
💼 About This Role
You'll own core systems for multi-provider failover, cost/latency-based routing, and real-time observability for Inworld Router and Realtime API services. You'll collaborate with ML teams to ship quickly and build a deep platform for scalable AI.
🎯 What You'll Do
- Design and build intelligent routing systems for 200+ LLMs
- Develop realtime API services for TTS/STT and multimodal models
- Implement multi-provider failover and cost-based routing logic
📋 Requirements
- Go, Python, C++ or Rust programming experience
- Experience deploying cloud-based services at hundreds of QPS+
- Hands-on with PostgreSQL or MySQL relational databases
- Experience with Redis or Memcached caching and pubsub/queues
✨ Nice to Have
- API gateway or routing/proxy layer experience
- Experience with ClickHouse, Timescale, or InfluxDB
- OpenTelemetry experience
🎁 Benefits & Perks
- 💰 Equity compensation
- 🏥 Comprehensive benefits
- 🏢 Hybrid work model
0 0 0