19h ago
Sr. Data Scientist, Responsible AI
San Francisco, CA, US; Remote, CA, US
$139.8k-$287.7k / year
full-timesenior Remoteai-ml
๐ Tech Stack
๐ผ About This Role
You'll lead automated adversarial testing for Pinterest's generative AI products like Pinterest Assistant and Canvas. Your work will directly influence product safety and user trust across 500M+ monthly active users.
๐ฏ What You'll Do
- Design automated adversarial testing for GenAI vulnerabilities
- Build hybrid evaluation pipelines combining LLM judges and classifiers
- Develop harm taxonomies grounded in industry standards
- Design adaptive refinement loops to surface unknown vulnerabilities
๐ Requirements
- 5+ years of experience in data-driven environments
- Hands-on experience in AI safety or adversarial machine learning
- Deep familiarity with LLMs and their failure modes
- Experience designing evaluation frameworks for AI systems
โจ Nice to Have
- Familiarity with AI safety taxonomies like OWASP LLM Top 10
- Experience with ML pipelines and large-scale experimentation
๐ Benefits & Perks
- ๐๏ธ Flexible PTO
- ๐ฅ Health insurance
- ๐ Equity compensation
- ๐ Remote work options
๐จ Hiring Process
Estimated timeline: 2-4 weeks ยท AI estimate
- 1Recruiter Screenยท 30 min
- 2Technical Interviewยท 60 min
- 3Onsite (multiple rounds)ยท 4 hours
0 0 0