🛠 Tech Stack

💼 About This Role

You'll drive the lifecycle of LLM projects at Sesame, bridging research and user-ready voice agents. Your core impact is transforming user feedback into technical evaluation datasets to improve real-world performance. You'll manage the quality loop across research and production teams.

🎯 What You'll Do

• Manage end-to-end lifecycle of LLM projects from research to production.
• Design objective metrics and datasets from subjective user feedback.
• Implement technical evaluations into existing codebase pipelines.
• Track feedback and ensure issues are resolved in subsequent iterations.

📋 Requirements

• BS or MS in Computer Science or related technical field.
• 3+ years managing LLM research or AI/ML product cycles.
• Proficiency in Python for writing evaluation logic.
• Solid technical understanding of LLMs and voice-based interfaces.

✨ Nice to Have

• Prior experience with LLM-based voice products.
• Experience integrating model evaluations into automated testing pipelines.
• Familiarity with architectural challenges of low-latency conversational AI.

🎁 Benefits & Perks

• 💰 401(k) max employer match: 3.5% of compensation
• 🏥 100% employer-paid health, vision, and dental for you and dependents
• 🏖️ Unlimited PTO and sick time
• 💵 Flexible spending account with employer match up to $1,650/year (medical FSA)
• 📈 Opportunity for competitive stock options