🛠 Tech Stack

💼 About This Role

You'll evaluate AI coding agents' quality and reasoning, judging whether their outputs reflect strong developer intuition. Your analysis will directly shape how AI-assisted development tools are refined. This role sits at the frontier of AI evaluation and software engineering expertise.

🎯 What You'll Do

• Evaluate AI-generated coding interactions end-to-end for usefulness and correctness.
• Analyze AI reasoning and explanations for engineering judgment quality.
• Provide structured, opinionated feedback on model performance and failure patterns.
• Contribute to defining evaluation standards for AI-assisted development workflows.

📋 Requirements

• Staff-level or Principal-level software engineering experience (or equivalent senior expertise)
• Strong proficiency in TypeScript/JavaScript or Python
• Experience using modern AI coding tools such as Codex, Claude Code, or Cursor
• Ability to evaluate code and system behavior at a conceptual level without full execution

✨ Nice to Have

• Experience mentoring engineers or defining engineering best practices
• Exposure to prompt engineering or AI evaluation workflows

🎁 Benefits & Perks

• 💰 Competitive hourly compensation: $100–$200/hour
• ⏳ Flexible part-time engagement: 10–20 hours/week
• 🏠 Remote work with high autonomy and async-friendly collaboration
• 🚀 Opportunity to influence next-generation AI coding tools
• ⚡ Fast onboarding with immediate start availability

📨 Hiring Process

Estimated timeline: 2-3 weeks · AI estimate

1. 1Application Review· 1 week
2. 2Technical Screen· 1 hour
3. 3Interview· 1 hour