💼 About This Role

You'll design and execute conversational scenarios to evaluate agentic audio models for real-world AI applications, simulating customer support interactions across multiple industries. Your work directly influences how next-generation voice agents understand and respond in complex service environments, contributing to high-quality datasets that shape model performance.

🎯 What You'll Do

• Design and execute structured conversational scenarios simulating customer support interactions.
• Contribute to dataset creation and model benchmarking across multiple domains.
• Evaluate AI model outputs using standardized qualitative and quantitative criteria.
• Assess conversational quality including clarity, flow, tone, and naturalness.

📋 Requirements

• English proficiency across reading, writing, listening, and speaking.
• Ability to evaluate structured dialogue and follow detailed assessment frameworks.
• Basic understanding of structured data concepts such as JSON, functions, and logic reasoning.
• Reliable access to a high-quality microphone for audio-based assessments.

✨ Nice to Have

• Experience in simulated customer support or conversational environments.
• Familiarity with evaluation rubrics and prompt-based workflows.
• Analytical mindset with attention to detail.

🎁 Benefits & Perks

• 💰 Hourly compensation between $11-$30.65 per hour based on experience.
• 🏠 Remote, contract-based engagement with flexible working arrangements.
• 🌐 Exposure to cutting-edge conversational AI technologies.
• 📋 Project-based work with clear evaluation frameworks.

📨 Hiring Process

Estimated timeline: 2-3 weeks · AI estimate

1. 1Recruiter Call· 30 min
2. 2Technical Interview· 45 min
3. 3Task or Assessment· 1 hour