9h ago

Staff / Principal Software Engineer

Vancouver, British Columbia, Canada

$180k-$260k / year

full-timesenior Hybridai-ml

🛠 Tech Stack

💼 About This Role

You'll own core systems for multi-provider failover, cost/latency-based routing, and real-time observability for Inworld Router and Realtime API services. You'll collaborate with ML teams to ship quickly and build a deep platform for scalable AI.

🎯 What You'll Do

  • Design and build intelligent routing systems for 200+ LLMs
  • Develop realtime API services for TTS/STT and multimodal models
  • Implement multi-provider failover and cost-based routing logic

📋 Requirements

  • Go, Python, C++ or Rust programming experience
  • Experience deploying cloud-based services at hundreds of QPS+
  • Hands-on with PostgreSQL or MySQL relational databases
  • Experience with Redis or Memcached caching and pubsub/queues

✨ Nice to Have

  • API gateway or routing/proxy layer experience
  • Experience with ClickHouse, Timescale, or InfluxDB
  • OpenTelemetry experience

🎁 Benefits & Perks

  • 💰 Equity compensation
  • 🏥 Comprehensive benefits
  • 🏢 Hybrid work model
0 0 0