🛠 Tech Stack

💼 About This Role

You'll contribute to a cutting-edge initiative evaluating and benchmarking advanced agentic audio models for real-world conversational AI. By simulating realistic customer support interactions, you'll assess how AI systems perform in dynamic, human-like scenarios, directly improving their reliability and naturalness.

🎯 What You'll Do

• Design and execute structured conversational scenarios simulating real customer service interactions
• Contribute to dataset creation and model benchmarking across multiple domains
• Evaluate AI model outputs using standardized qualitative and quantitative criteria
• Assess conversational quality including clarity, flow, tone, and naturalness

📋 Requirements

• Strong verbal communication skills and experience in simulated customer support or conversational environments
• English proficiency across reading, writing, listening, and speaking
• Ability to evaluate structured dialogue and follow detailed assessment frameworks
• Basic understanding of structured data concepts such as JSON, functions, and simple logic reasoning

✨ Nice to Have

• Comfort working with technical documentation and prompt-based workflows
• Analytical mindset with attention to detail and consistency in evaluation
• Reliable access to a high-quality microphone for audio-based assessments

🎁 Benefits & Perks

• 💰 Hourly compensation: $11 – $30.65 per hour (based on experience, expertise, and location)
• 🌍 Remote, contract-based engagement with flexible working arrangements
• 🤖 Contribution to advanced AI model development and evaluation projects
• 🔊 Exposure to cutting-edge conversational and agentic audio technologies
• 📋 Project-based work with clear evaluation frameworks and structured tasks

📨 Hiring Process

Estimated timeline: 1-2 weeks · AI estimate

1. 1Recruiter call· 30 min
2. 2Technical assessment· 60 min
3. 3Offer· N/A