💼 About This Role

You'll evaluate and benchmark advanced agentic audio models for real-world conversational AI applications. You'll simulate realistic customer support interactions across multiple industries, directly influencing next-generation voice agents performance. This remote contract role offers flexible work and exposure to cutting-edge AI technologies.

🎯 What You'll Do

• Design and execute structured conversational scenarios simulating real customer service interactions.
• Create and run role-play evaluations in domains like travel, finance, telecom, and tech support.
• Evaluate AI model outputs using standardized qualitative and quantitative criteria.
• Support structured documentation and feedback loops for model improvement.

📋 Requirements

• Strong verbal communication skills and experience in simulated customer support environments.
• Ability to evaluate structured dialogue and follow detailed assessment frameworks.
• Basic understanding of structured data concepts like JSON, functions, and logic reasoning.
• English proficiency across reading, writing, listening, and speaking.

✨ Nice to Have

• Analytical mindset with attention to detail and consistency in evaluation.
• Comfort working with technical documentation, evaluation rubrics, and prompt-based workflows.
• Reliable access to a high-quality microphone for audio-based assessments.

🎁 Benefits & Perks

• 💰 Hourly rate: $11 – $30.65 based on experience and location
• 🏠 Remote, contract-based engagement with flexible working arrangements
• 🚀 Opportunity to contribute to advanced AI model development projects
• 🎯 Exposure to cutting-edge conversational and agentic audio technologies
• 📋 Project-based work with clear evaluation frameworks and structured tasks

📨 Hiring Process

Estimated timeline: 2-3 weeks · AI estimate

1. 1Application Review· 1 week
2. 2Technical Assessment· 1 week
3. 3Interview with Hiring Team· 1 week