🛠 Tech Stack

💼 About This Role

You'll evaluate the performance of AI coding agents in real-world scenarios, focusing on their outputs and engineering judgment. Your insights will directly impact the development of these advanced tools. This role emphasizes understanding and critiquing how well models emulate great engineering thought processes.

🎯 What You'll Do

• Evaluate AI-generated coding interactions end-to-end
• Assess quality of explanations and reasoning
• Differentiate levels of response quality
• Provide constructive feedback on outputs

📋 Requirements

• Staff / Principal-level engineer or equivalent experience
• Strong background in TypeScript / JavaScript or Python
• Experience with OpenAI Codex and Claude Code
• Familiarity with modern AI-assisted development workflows

✨ Nice to Have

• Ability to evaluate code without deep line-by-line review
• Comfortable giving direct feedback on technical outputs
• High standards for good engineering practices

🎁 Benefits & Perks

• 💵 Competitive hourly pay based on location
• 🕒 Flexible working hours (10–20 hrs/week)
• 🏠 Remote work environment
• 📝 Potential for contract extension
• 📚 Opportunities for ongoing training and development

📨 Hiring Process

Estimated timeline: 1-2 weeks · AI estimate

1. 1Recruiter call· 30 min
2. 2Technical interview· 60 min
3. 3Offer· 30 min