🛠 Tech Stack

💼 About This Role

You'll serve as the measurement backbone for Pinterest's foundational model initiatives within the Advanced Technology Group (ATG). You'll design evaluation frameworks and system-level metrics that quantify how model improvements translate into real user and business outcomes. This role directly influences model investment decisions and launch criteria across Pinterest's recommendation ecosystem.

🎯 What You'll Do

• Design system-level measurement frameworks for foundational model improvements.
• Define and own success metrics that quantify foundational model value.
• Build causal inference methods to isolate impact of individual model changes.
• Collaborate cross-functionally with ML Engineers and Applied Scientists.

📋 Requirements

• 5+ years of experience analyzing data in a fast-paced data-driven environment.
• Hands-on experience in ML system evaluation or recommender system measurement.
• Deep familiarity with large-scale recommendation or ranking systems and their evaluation.
• Strong quantitative programming in Python and data manipulation in SQL/Spark.

✨ Nice to Have

• Experience with causal inference and A/B experimentation at scale.
• Experience with multi-surface holdouts and long-run effect estimation.
• Excellent communication skills for translating complex findings to leadership.

🎁 Benefits & Perks

• 🏖️ Flexible remote work options.
• 💰 Equity compensation.
• 🏥 Comprehensive health benefits.
• 📈 Career development opportunities.
• 🏢 Inclusive workplace culture.

📨 Hiring Process

Estimated timeline: 3-5 weeks · AI estimate

1. 1Recruiter Screen· 30 min
2. 2Technical Interview· 60 min
3. 3On-site Interviews· 4 hours