🛠 Tech Stack

💼 About This Role

You'll evaluate AI coding agents' performance in real-world scenarios, assessing their outputs for engineering judgment and quality. Your insights will directly impact the development of advanced coding tools. This role blends critique with impact on AI evolution.

🎯 What You'll Do

• Evaluate AI-generated coding interactions end-to-end
• Judge the usefulness and correctness of outputs
• Assess quality of explanations and reasoning
• Differentiate levels of response quality

📋 Requirements

• Staff or Principal-level engineer with equivalent experience
• Strong background in TypeScript/JavaScript or Python
• Experience with OpenAI Codex and Claude Code
• Familiarity with AI-assisted development workflows

✨ Nice to Have

• Comfortable giving direct feedback on technical outputs
• High standards for good engineering practices

🎁 Benefits & Perks

• 💵 Competitive hourly pay based on location
• ⏰ Flexible working hours (10–20 hrs/week)
• 🏠 Remote work environment
• 🔄 Potential for contract extension
• 📚 Opportunities for ongoing training and development

📨 Hiring Process

Estimated timeline: 1-2 weeks · AI estimate

1. 1Recruiter Call· 30 min
2. 2Technical Screen· 60 min
3. 3Offer· 15 min