🛠 Tech Stack

💼 About This Role

You'll contribute to evaluating and benchmarking advanced agentic audio models for real-world conversational AI applications. Your work directly influences how next-generation voice agents understand and respond in complex service environments. This is a remote, flexible contract role ideal for those working at the intersection of language, audio, and AI systems.

🎯 What You'll Do

• Design conversational scenarios simulating real customer service interactions.
• Create role-play evaluations for travel, finance, telecom, and tech support.
• Evaluate AI model outputs using qualitative and quantitative criteria.
• Assess conversational quality, task completion, and instruction adherence.

📋 Requirements

• Strong verbal communication skills and experience in simulated customer support.
• English proficiency across reading, writing, listening, and speaking.
• Ability to evaluate structured dialogue using detailed assessment frameworks.
• Basic understanding of structured data like JSON, functions, and logic.

✨ Nice to Have

• Experience with AI model evaluation or benchmarking.
• Familiarity with prompt-based workflows and rubrics.
• Analytical mindset with attention to detail and consistency.

🎁 Benefits & Perks

• 💰 Hourly pay $11-$30.65 based on experience and location
• 🏠 Remote contract with flexible hours
• 🤖 Cutting-edge AI project exposure
• 📋 Structured tasks with clear frameworks
• 🚫 No traditional employee obligations (PTO, benefits)

📨 Hiring Process

Estimated timeline: 2-3 weeks · AI estimate

1. 1Recruiter Screen· 30 min
2. 2Skills Assessment· 60 min
3. 3Technical Interview· 45 min