🛠 Tech Stack

💼 About This Role

You'll evaluate AI coding agents in real-world scenarios, critiquing their engineering judgment and response quality. Your insights will directly impact the development of advanced coding tools to align them with experienced engineers' expectations. This role offers a flexible remote contract with a focus on high-standards assessment.

🎯 What You'll Do

• Evaluate AI-generated coding interactions end-to-end
• Judge usefulness and correctness of outputs
• Assess quality of explanations and reasoning
• Provide constructive feedback on outputs

📋 Requirements

• Staff/Principal-level engineer or equivalent experience
• Strong background in TypeScript/JavaScript or Python
• Experience with OpenAI Codex and Claude Code
• Familiarity with modern AI-assisted development workflows

✨ Nice to Have

• Comfortable giving direct feedback on technical outputs
• High standards for good engineering practices

🎁 Benefits & Perks

• 💵 Competitive hourly pay based on location
• ⏰ Flexible working hours (10–20 hrs/week)
• 🏠 Remote work environment
• 📅 Potential for contract extension
• 📈 Ongoing training and development

📨 Hiring Process

Estimated timeline: 2-3 weeks · AI estimate

1. 1Application Review· 1 week
2. 2Technical Interview· 1 hour
3. 3Offer· 1 week