🛠 Tech Stack

💼 About This Role

You'll develop evaluation frameworks and run experiments for GenAI features at Roblox, a leading immersive platform. Your core impact is defining metrics and building automated tools to ensure safety and quality. You'll conduct applied research at the frontier of GenAI and data science.

🎯 What You'll Do

• Design evaluation frameworks for GenAI features including text, image, and 3D.
• Run rigorous online experiments and causal inference studies.
• Define success metrics with cross-functional partners.
• Build automated evaluation tooling to improve rigor and efficiency.

📋 Requirements

• Possess or pursuing a PhD in a quantitative field.
• Strong proficiency in SQL and Python or R.
• Solid grounding in experimentation and causal inference.
• Familiarity with GenAI models and safety/quality evaluation.

✨ Nice to Have

• Expertise in model training lifecycle (fine-tuning, RLHF, synthetic data).
• Applied research or publications in relevant fields.

🎁 Benefits & Perks

• 💰 Equity compensation
• 🏖️ Hybrid office schedule (onsite Tue-Thu, optional Mon/Fri)
• 🏥 Benefits package as described on company page

📨 Hiring Process

Estimated timeline: 2-3 weeks · AI estimate

1. 1Recruiter Screen· 30 min
2. 2Technical Phone Screen· 45 min
3. 3Onsite Interviews (4-5 rounds)· 4 hours