🛠 Tech Stack

💼 About This Role

You'll evaluate AI coding agents in real-world scenarios, assessing their outputs for engineering judgment and quality. Your insights directly impact how these models emulate great engineering thought processes. This role stands out as a unique blend of software engineering and AI evaluation.

🎯 What You'll Do

• Evaluate AI-generated coding interactions end-to-end
• Assess quality of explanations and reasoning
• Differentiate levels of response quality
• Provide constructive feedback on outputs

📋 Requirements

• Staff / Principal-level engineer or equivalent experience
• Strong background in TypeScript, JavaScript, or Python
• Experience with OpenAI Codex and Claude Code
• Familiarity with modern AI-assisted development workflows

✨ Nice to Have

• Experience evaluating code without deep line-by-line review
• Comfortable giving direct feedback on technical outputs

🎁 Benefits & Perks

• 💰 Competitive hourly pay based on location
• 🕒 Flexible working hours (10–20 hrs/week)
• 🏠 Remote work environment
• 📄 Potential for contract extension
• 📚 Ongoing training and development

📨 Hiring Process

Estimated timeline: 1-2 weeks · AI estimate

1. 1Recruiter Phone Screen· 30 min
2. 2Technical Interview· 60 min
3. 3Offer· 1 day

🚩 Heads Up

• Role title says Sr. but requirements ask for Staff/Principal level