💼 About This Role

You'll lead evaluation and optimization of large-scale datasets for generative video models at Protege, a platform for AI training data exchange. Your work will directly impact model quality and define the value of our video data assets. This role offers the chance to shape the future of data-centric AI at a fast-moving startup backed by top investors.

🎯 What You'll Do

• Analyze and summarize video catalog with data scorecards
• Design and run evaluations connecting data gaps to model failures
• Define eval sets and slices for real-world video use cases
• Build relationships with external researchers on video data needs

📋 Requirements

• PhD or Master's +4 years industry experience in ML/CS/Stats
• Proven experience designing model evaluations and data analyses
• Ability to understand data impact on models at various training stages
• Excellent written and verbal communication skills

✨ Nice to Have

• Publications in data-centric AI or related areas
• Experience developing evaluation frameworks for training data
• Prior work on video generation or understanding models

📨 Hiring Process

Estimated timeline: 2-4 weeks · AI estimate

1. 1Recruiter Screen· 30 min
2. 2Technical Interview· 60 min
3. 3Onsite Interview· 4 hours