🛠 Tech Stack

💼 About This Role

You'll design and build scalable AI infrastructure at Toast, including the LLM Proxy and autonomous agents that shape how hundreds of engineers build. You'll directly impact product development across the company by creating the foundational platform others rely on.

🎯 What You'll Do

• Design and ship core AI platform infrastructure including LLM proxy and observability pipelines
• Architect autonomous agents that participate in the software development lifecycle
• Lead technical design of MCP services and no-code service templates
• Drive adoption of agentic development practices through tooling and enablement

📋 Requirements

• 8+ years of experience designing and implementing scalable backend services
• Strong foundation in Java or Kotlin building scalable services
• Experience building, deploying, or operating LLM-powered agents
• Deep familiarity with AI coding assistants (Claude Code, Cursor, GitHub Copilot) and extending them

✨ Nice to Have

• Familiarity with A2A protocols and multi-agent orchestration
• Experience with ML infrastructure or model evaluation
• Experience building developer experience platforms or API gateways

🎁 Benefits & Perks

• 💰 Competitive compensation and total rewards package
• 🏖️ Flexible hybrid work model (2 days/week in office)
• 🚀 AI tools provided across all disciplines for faster building
• 📚 Learning culture embracing new AI technologies

📨 Hiring Process

Estimated timeline: 2-4 weeks · AI estimate

1. 1Recruiter Screen· 30 min
2. 2Technical Interview· 60 min
3. 3Hiring Manager Interview· 45 min