11h ago
Staff Software Engineer
San Francisco, CA, USA
$244.5k-$305.6k / year
full-timeleadgaming
๐ Tech Stack
๐ผ About This Role
You'll design and evolve the large-scale offline ML platform at Unity, building reliable infrastructure for training dataset generation and distributed model training. You'll partner with ML engineers to ensure pipelines efficiently handle growing data volumes and complex workloads.
๐ฏ What You'll Do
- Design and operate large-scale data pipelines for ML training datasets
- Develop infrastructure for distributed training with Pytorch, Ray Data, Ray Train
- Integrate ML pipelines with workflow orchestration systems like Flyte or Airflow
- Optimize performance and resource utilization across distributed compute systems
๐ Requirements
- Experience with distributed computing frameworks such as Ray, Spark, Flink
- Experience building infrastructure for training data generation or ML feature pipelines
- Deep experience designing and operating production-grade data pipelines
- Strong programming skills in Python and large-scale distributed workloads
๐ Benefits & Perks
- ๐๏ธ Generous vacation and personal days
- ๐ป Employee stock ownership
- ๐ฅ Comprehensive health, life, and disability insurance
- ๐ง Mental Health and Wellbeing programs
- ๐ Training and development programs
๐จ Hiring Process
Estimated timeline: 2-4 weeks ยท AI estimate
- 1Recruiter Screenยท 30 min
- 2Technical Interviewยท 60 min
- 3Onsite Interviewsยท 4 hours
0 0 0