12h ago

Technical Program Manager, Frontier Evals

San Francisco, CA

$207k-$230k / year

full-timemid Hybridai-ml

๐Ÿ›  Tech Stack

๐Ÿ’ผ About This Role

You'll drive frontier evaluation and research programs from concept to analysis, partnering with researchers and engineers. You'll design evals, manage human data campaigns, and build roadmaps. This hybrid IC/PM role offers hands-on technical work in a fast-moving research environment.

๐ŸŽฏ What You'll Do

  • Manage frontier evaluation projects from research questions to benchmarks
  • Design and manage human data campaigns and quality control workflows
  • Build roadmaps and operating rhythms for research efforts
  • Coordinate across research, engineering, data, product, safety, legal, and vendors
  • Do hands-on technical work including prompt iteration and data analysis

๐Ÿ“‹ Requirements

  • Proficiency in Python or SQL for analyzing datasets and automating workflows
  • Experience in technical program management, research operations, or similar role
  • Understanding of how large language models work, including prompting and evaluation
  • Ability to ramp quickly on new domains and turn vague goals into clear plans

โœจ Nice to Have

  • Experience with model-based evaluation workflows
  • Background in safety or frontier model research

๐ŸŽ Benefits & Perks

  • ๐Ÿ–๏ธ Unlimited PTO
  • ๐Ÿ’ฐ Equity offered
  • ๐Ÿšš Relocation assistance
  • ๐Ÿข Hybrid work with 3 days in office per week

๐Ÿ“จ Hiring Process

Estimated timeline: 2-4 weeks ยท AI estimate

  1. 1Recruiter Screenยท 30 min
  2. 2Technical Interviewยท 60 min
  3. 3Hiring Manager Interviewยท 45 min
0 0 0