🛠 Tech Stack

💼 About This Role

You'll design and evaluate conversational scenarios to benchmark advanced AI audio models. Your work directly influences how next-generation voice agents understand and adapt in complex service environments. This is a remote, flexible contract role at the intersection of language, audio, and AI systems.

🎯 What You'll Do

• Design and execute structured customer service scenarios for AI evaluation
• Assess AI model outputs using qualitative and quantitative criteria
• Document and provide structured feedback for model improvement
• Contribute to diverse datasets for benchmarking conversational audio agents

📋 Requirements

• Strong verbal communication skills for structured dialogue assessment
• English proficiency across reading, writing, listening, and speaking
• Experience in simulated customer support or conversational environments
• Basic understanding of structured data concepts like JSON and functions

✨ Nice to Have

• Ability to evaluate structured dialogue and follow detailed assessment frameworks
• Comfort with technical documentation and prompt-based workflows
• Analytical mindset with attention to detail and consistency

🎁 Benefits & Perks

• 💵 Hourly compensation: $11 – $30.65 per hour
• 🌍 Remote, flexible contract with no fixed schedules
• 🤖 Exposure to cutting-edge conversational AI technologies
• 📋 Project-based work with clear evaluation frameworks

📨 Hiring Process

Estimated timeline: 1-2 weeks · AI estimate

1. 1Recruiter Call· 30 min
2. 2Technical Assessment· 1 hour
3. 3Offer· 15 min

🚩 Heads Up

• Role mixes AI evaluation, dataset creation, and technical documentation without clear boundaries
• Requirements include device with microphone but no hardware compensation mentioned