🛠 Tech Stack

💼 About This Role

You'll evaluate the performance of AI coding agents in real-world scenarios, assessing their outputs for engineering judgment and quality. Your insights will directly impact the development of advanced tools to align with experienced engineers' expectations.

🎯 What You'll Do

• Evaluate AI-generated coding interactions end-to-end
• Judge the usefulness and correctness of outputs
• Assess quality of explanations and reasoning
• Provide constructive feedback on outputs

📋 Requirements

• Staff / Principal-level engineer or equivalent experience
• Strong background in TypeScript / JavaScript or Python
• Familiarity with modern AI-assisted development workflows
• Comfortable giving direct feedback on technical outputs

✨ Nice to Have

• Experience with OpenAI Codex and Claude Code
• Ability to evaluate code without deep line-by-line review

🎁 Benefits & Perks

• 💰 Competitive hourly pay based on location
• 🕒 Flexible working hours (10–20 hrs/week)
• 🏠 Remote work environment
• 📄 Potential for contract extension
• 📚 Ongoing training and development

📨 Hiring Process

Estimated timeline: 2-4 weeks · AI estimate

1. 1Phone Screen· 30 min
2. 2Technical Interview· 60 min
3. 3Offer· N/A