🛠 Tech Stack

💼 About This Role

You'll shape our language model roadmap through end-to-end pretraining development. You will work extremely closely with the pretraining team to integrate your insights into next-generation models. This role involves large-scale training runs and performance optimization of our pretraining stack.

🎯 What You'll Do

• Develop and optimize large-scale pretraining pipelines
• Implement model and data parallelism strategies
• Conduct architecture and methodology research
• Curate and evaluate training datasets

📋 Requirements

• Strong engineering aptitude for reliable and robust systems
• Ability to rapidly learn and implement new ideas
• Excellent communication and collaboration skills
• Experience with large-scale GPU clusters and distributed training

✨ Nice to Have

• Published machine learning research in top venues
• Postgraduate degree in a scientific field
• Deep understanding of experimental methodology

🎁 Benefits & Perks

• 🏥 Comprehensive medical, dental, vision
• 💰 Competitive compensation and 401(k)
• 🍽️ In-office snacks and meals
• 🏖️ Unlimited PTO
• 🚀 Relocation and immigration support

📨 Hiring Process

Estimated timeline: 2-4 weeks · AI estimate

1. 1Recruiter screen· 30 min
2. 2Technical assessment· 60 min
3. 3On-site interviews· 4 hours