🛠 Tech Stack

💼 About This Role

You'll join a small, flat team focused on engineering excellence to evaluate and improve AI models. You'll conduct complete model assessments and identify weaknesses through deep dives into training data. This role offers the chance to directly contribute to xAI's mission and work with advanced inference frameworks like SGlang and vLLM.

🎯 What You'll Do

• Provide complete assessment of models.
• Deep dive into model training and data to identify weakness points.
• Communicate with modeling and data team to improve model quality.

📋 Requirements

• Experience in model assessment and evaluation task development.
• Ability to collect and synthesize data for new evals.
• Build infrastructure and framework for easy-to-use model evaluation.
• Familiarity with inference frameworks like SGlang and vLLM.

🎁 Benefits & Perks

• 🏖️ Base salary $180,000 - $440,000 USD
• 🏥 Comprehensive medical, vision, and dental coverage
• 💰 Equity included
• 🏦 401(k) retirement plan
• 🛡️ Short and long-term disability insurance, life insurance