🛠 Tech Stack

💼 About This Role

You'll build ML operations analytics and lead LLM evaluation initiatives at a legal AI company. Your work will ensure operational excellence and quality assurance across AI systems. This role offers the chance to shape the analytics layer for cutting-edge GenAI applications.

🎯 What You'll Do

• Build ML operations analytics tracking pipeline health and quality metrics
• Lead production LLM evaluation and observability initiatives
• Drive development with ML teams based on analytics outputs
• Create actionable dashboards and insights for leadership

📋 Requirements

• 3+ years in data science, ML operations, or analytics engineering
• Experience with LLM evaluation frameworks and quality metrics design
• Strong Python, SQL, and data visualization skills
• Knowledge of prompt optimization techniques

✨ Nice to Have

• Deep understanding of latest trends in LLMs and production deployments
• Collaborative mindset with ability to work across teams
• Experience with data annotation and prompt engineering

🎁 Benefits & Perks

• 🏖️ Work from home certain days
• 🩺 Health insurance
• 💰 Competitive compensation
• 📈 Growth opportunities
• 🤝 Collaborative team culture

🚩 Heads Up

• Role title 'Senior' but 3+ years required (actually mid-level)
• Hybrid remote mentioned but workplace type 'hybrid' in posting
• Contractor commitment may imply limited benefits