19h ago

Software Engineer, Backend

San Francisco

$145k-$195k / yearest.

full-timemidai-ml

🛠 Tech Stack

+3

💼 About This Role

You'll build the infrastructure behind AI observability platform for teams like Notion and Stripe. You'll design high-availability data pipelines and evolve open source libraries for LLM tracing. This role offers the chance to solve hard systems problems in a fast-paced startup.

🎯 What You'll Do

  • Design and ship features for LLM usage insights
  • Integrate and proxy data from OpenAI, Anthropic, Gemini
  • Develop open source libraries for tracing LLM calls
  • Build real-time data pipelines for AI usage data

📋 Requirements

  • 5+ years of backend engineering experience
  • Experience with infrastructure projects and scalable design
  • Proficiency in Node.js, Go, Python, or Rust
  • Experience with observability tooling like Grafana, Prometheus

✨ Nice to Have

  • Experience with Postgres, Redis, Terraform, Docker, AWS
  • Background in AI/ML or LLM development
  • Contributions to open source projects

🎁 Benefits & Perks

  • 🏥 Medical, dental, and vision insurance
  • 🍱 Daily lunch, snacks, and beverages
  • 🏖️ Flexible time off
  • 📈 Competitive salary and equity
  • 🤖 AI Stipend
0 0 0