🛠 Tech Stack

💼 About This Role

You'll evaluate AI coding agents' performance in real-world scenarios, assessing their outputs for engineering judgment and quality. Your insights will directly impact the development of advanced tools to align with experienced engineers' expectations.

🎯 What You'll Do

• Evaluate AI-generated coding interactions end-to-end
• Assess quality of explanations and reasoning
• Differentiate levels of response quality
• Provide constructive feedback on outputs

📋 Requirements

• Staff / Principal-level engineer experience
• Strong background in TypeScript / JavaScript or Python
• Experience with OpenAI Codex and Claude Code
• Familiarity with AI-assisted development workflows

✨ Nice to Have

• High standards for good engineering practices
• Comfortable giving direct feedback on technical outputs

🎁 Benefits & Perks

• 💰 Competitive hourly pay based on location
• 🕒 Flexible working hours (10–20 hrs/week)
• 🏠 Remote work environment
• 📋 Potential for contract extension
• 📚 Opportunities for ongoing training

📨 Hiring Process

Estimated timeline: 2-4 weeks · AI estimate

1. 1Recruiter call· 30 min
2. 2Technical assessment· 60 min
3. 3Offer· 30 min