🛠 Tech Stack

💼 About This Role

You'll evaluate AI coding agents by assessing their outputs in real-world scenarios, focusing on engineering judgment and quality. Your insights will directly impact the development of advanced AI tools. This role emphasizes critiquing AI reasoning rather than traditional coding.

🎯 What You'll Do

• Evaluate AI-generated coding interactions end-to-end
• Judge the usefulness and correctness of AI outputs
• Assess quality of explanations and reasoning
• Differentiate levels of response quality
• Provide constructive feedback on AI outputs

📋 Requirements

• Staff/Principal-level engineer or equivalent experience
• Strong background in TypeScript or Python
• Experience with OpenAI Codex and Claude Code
• Familiarity with modern AI-assisted development workflows

✨ Nice to Have

• Experience evaluating code without deep review
• Comfort giving direct feedback on technical outputs
• High standards for good engineering practices

🎁 Benefits & Perks

• 💰 Competitive hourly pay based on location
• 🕐 Flexible working hours (10–20 hrs/week)
• 🏠 Remote work environment
• 🔁 Potential for contract extension
• 📚 Ongoing training and development

📨 Hiring Process

Estimated timeline: 1-2 weeks · AI estimate

1. 1Phone Screen· 30 min
2. 2Technical Assessment· 60 min
3. 3Offer· 15 min