🛠 Tech Stack

💼 About This Role

You'll design and build robust model evaluation frameworks for video-language models, automating repetitive processes. Your work will directly enhance data quality and model assessment while collaborating with research and product teams. You'll drive our post-training evaluation strategy and improve tools for sustainable data operations.

🎯 What You'll Do

• Design and build robust model evaluation frameworks.
• Manage resource allocation and timelines across data streams.
• Enhance dataset quality through vendor collaboration.
• Establish labeling guidelines and monitor data quality.
• Partner with Engineering and AI Model teams on data needs.

📋 Requirements

• 5+ years experience in AI-focused data operations.
• Track record designing and executing large scale data or evaluation projects.
• Ability to analyze complex data and distill findings into guidelines.
• Proficiency with Python for automation.

✨ Nice to Have

• Experience in data collection for multimodal language models.
• Experience in red teaming or localization testing.
• Experience working with research scientists.

🎁 Benefits & Perks

• 🤝 Open and inclusive culture and work environment.
• 🧑‍💻 Work closely with a collaborative, mission-driven team on cutting-edge AI.
• 🦷 Full health, dental, and vision benefits.
• ✈️ Flexible PTO and parental leave policy.

📨 Hiring Process

Estimated timeline: 2-4 weeks · AI estimate

1. 1Recruiter Screen· 30 min
2. 2Technical Interview· 60 min
3. 3Onsite/Final Round· 120 min