9h ago

Senior Software Engineer - API Gateway

Remote (US & Canada)

$150k-$210k / yearest.

full-timesenior Remoteai-ml

🛠 Tech Stack

💼 About This Role

You'll join the Platform Team to evolve the API gateway for open-model inference at Featherless.ai. You'll improve reliability, handle incidents, and ensure seamless authentication and model access. This role is ideal for those who love rapid iteration and building infrastructure for AI creators.

🎯 What You'll Do

  • Develop features and fix bugs for new models and clients
  • Improve API reliability through instrumentation and monitoring
  • Respond to availability incidents and triage inference issues
  • Manage infrastructure for the gateway

📋 Requirements

  • Familiarity with popular open LLMs and building with them
  • Experience with REST, websockets, DNS, networking, OpenTelemetry
  • Proficiency in Kubernetes, Node.js, Fastify, Redis, MongoDB, Python
  • Ability to debug complex issues across a wide stack

✨ Nice to Have

  • Experience with Elastic Cloud, Cloudflare, Sentry
  • Prior work on API gateways or inference platforms

🎁 Benefits & Perks

  • 🏖️ Remote-first with async communication
  • 💰 Competitive equity package
  • 🩺 Health insurance (US & Canada)
  • 📈 Professional development budget
  • 🏠 Home office stipend
0 0 0