🛠 Tech Stack

💼 About This Role

You'll evaluate and benchmark advanced agentic audio models for real-world conversational AI applications, simulating customer support interactions across industries. Your work directly improves AI reliability, naturalness, and usability in dynamic service environments.

🎯 What You'll Do

• Design and execute structured conversational scenarios for AI evaluation.
• Create role-play simulations for customer support across multiple domains.
• Assess AI model outputs using standardized qualitative and quantitative criteria.
• Evaluate conversational quality including clarity, flow, tone, and naturalness.

📋 Requirements

• Strong verbal communication skills and experience in simulated customer support environments.
• English proficiency across reading, writing, listening, and speaking.
• Ability to evaluate structured dialogue and follow detailed assessment frameworks.
• Basic understanding of structured data concepts such as JSON and simple logic reasoning.

✨ Nice to Have

• Experience evaluating AI systems using defined rubrics.
• Comfort working with technical documentation and prompt-based workflows.
• Analytical mindset with attention to detail and consistency.

🎁 Benefits & Perks

• 💰 Hourly compensation $11–$30.65 based on experience.
• 🌍 Remote, contract-based engagement with flexible hours.
• 🤖 Contribute to cutting-edge conversational AI technologies.
• 📋 Project-based work with clear evaluation frameworks.
• ⏰ No fixed schedule or traditional employee obligations.

📨 Hiring Process

Estimated timeline: 2-4 weeks · AI estimate

1. 1Application Review· 1 week
2. 2Recruiter Call· 30 min
3. 3Skills Assessment· 1 hour