4h ago
Senior Software Engineer, AI Gateway
Milan
✨ $130k-$160k / yearest.
full-timesenior Hybridsoftware
🛠 Tech Stack
💼 About This Role
You'll join the engineering team building the Kong AI Gateway, empowering companies to govern AI and LLM innovation. You will design, build, and maintain core features such as multi-LLM routing and semantic caching. This role offers the opportunity to work with a highly scalable distributed system that powers API and AI connectivity for Fortune 500 companies.
🎯 What You'll Do
- Design, build, and maintain API management software for AI and LLMs.
- Architect and implement new features including proxying, load balancing, and database support.
- Troubleshoot bugs, performance tune, and perform low-level optimizations.
- Mentor junior members of the engineering team.
📋 Requirements
- 5+ years of programming in server-side applications.
- Experience designing highly scalable, distributed, and resilient systems.
- Solid expertise in Linux systems troubleshooting and profiling.
- Hands-on experience with Rust.
✨ Nice to Have
- Hands-on experience with NGINX/OpenResty/Kong/LuaJIT.
- Hands-on experience with Envoy or Istio.
- Familiarity with AI LLM concepts and applications development.
🎁 Benefits & Perks
- 🏖️ Remote-friendly hybrid work in Milan.
- 💰 Competitive compensation with equity options.
- 📚 Learning and development budget.
0 0 0