🛠 Tech Stack

💼 About This Role

You'll evaluate AI coding agents by assessing their outputs in real-world scenarios, focusing on engineering judgment and response quality. Your insights will directly impact the development of advanced AI tools, ensuring they align with experienced engineers' expectations. This role stands out for its emphasis on critiquing AI thought processes rather than traditional coding.

🎯 What You'll Do

• Evaluate AI-generated coding interactions end-to-end
• Judge the usefulness and correctness of outputs
• Assess quality of explanations and reasoning
• Provide constructive feedback on outputs

📋 Requirements

• Staff or Principal-level engineering experience
• Strong background in TypeScript, JavaScript, or Python
• Experience with OpenAI Codex and Claude Code
• Familiarity with AI-assisted development workflows

✨ Nice to Have

• Experience evaluating code without deep line-by-line review
• Comfortable giving direct feedback on technical outputs

🎁 Benefits & Perks

• 💰 Competitive hourly pay based on location
• 🕒 Flexible working hours (10–20 hrs/week)
• 🏠 Remote work environment
• 📄 Potential for contract extension
• 📚 Ongoing training and development

📨 Hiring Process

Estimated timeline: 1-2 weeks · AI estimate

1. 1Recruiter Call· 30 min
2. 2Technical Assessment· 60 min
3. 3Hiring Manager Interview· 45 min