🛠 Tech Stack

💼 About This Role

You'll define architect agent behavior at enterprise scale by building agentic systems for coding agents. You'll own major pillars of the quality stack and drive hill-climb infrastructure for large-scale experimentation. You'll partner with product and modeling leadership to turn customer pain into trusted metrics and experiment loops.

🎯 What You'll Do

• Design and evolve pipelines for large-scale experimentation and iteration.
• Lead postmortems on quality regressions and cluster failure modes.
• Align product, infra, and applied AI on quality standards for critical workflows.
• Ensure quality systems are dependable with reproducible runs and versioning.

📋 Requirements

• 8+ years shipping AI/ML-backed software in production with Staff-level ownership.
• Strong track record building eval harnesses and experimentation loops for LLM/agent systems.
• Proficiency in Python, TypeScript, Go (strong in at least two).
• Exceptional communication skills: crisp writeups and ability to influence without authority.

✨ Nice to Have

• Deep experience with agentic coding tools (IDE agents, CLI agents).
• Background in data engineering (dbt, Airflow) or retrieval/RAG systems.
• Prior work on LLM observability, safety/guardrails, or production quality systems.

🎁 Benefits & Perks

• 💰 Competitive salary and equity.
• 🏖️ Unlimited PTO.
• 🏥 Health insurance (medical, dental, vision).
• 📈 401(k) plan with company match.
• 🏢 Hybrid work environment.

🚩 Heads Up

• Hybrid role listed as remote in workplaceType but hybrid in text
• Salary range wide ($236K-$339K) may indicate band ambiguity