Tech Stack

Description

You will design and build scalable infrastructure to orchestrate tens of thousands of LLM calls per second, collaborate with the research team to deploy innovative models, and interface with customers to design intuitive workflows. This role directly influences how AI applications are tested and deployed across industries.

Requirements

• 7+ years industry experience, 3+ years leading large initiatives
• Track record of designing and scaling complex distributed systems
• Strong proficiency in backend languages (Python, Go, Rust)
• Deep knowledge of cloud infrastructure (Kubernetes, Terraform, AWS, GCP, Azure)
• Strong understanding of relational and NoSQL databases (Postgres, MongoDB, Redis)

Responsibilities

• Design and build scalable infrastructure for orchestrating tens of thousands of LLM calls per second
• Collaborate with research team to deploy new models for AI reliability tooling
• Interface with customers to understand pain points and design user workflows
• Act as technical leader, mentoring team and setting technical direction
• Develop processes to reinforce operational excellence