🛠 Tech Stack

💼 About This Role

You'll evaluate AI coding agent interactions for quality and engineering judgment, not writing production code. Your core impact is defining what great engineering taste looks like in model outputs. This contract role offers flexible remote work with compensation up to $200/hr.

🎯 What You'll Do

• Evaluate AI-generated coding interactions end-to-end
• Judge outputs for usefulness, correctness, and engineering alignment
• Distinguish between different levels of response quality
• Provide clear, opinionated feedback on what worked or felt off

📋 Requirements

• Staff / Principal-level engineer experience
• Strong background in TypeScript/JavaScript or Python
• Hands-on experience with OpenAI Codex, Claude Code, or Cursor
• Ability to evaluate code without full execution or deep line-by-line review

✨ Nice to Have

• Experience with Cursor or similar AI-first IDEs
• Prior exposure to prompt design or evaluation workflows
• Experience mentoring senior engineers or defining engineering standards

🎁 Benefits & Perks

• 💰 Up to $200/hr compensation
• 🌍 Fully remote work
• ⏰ Flexible hours (~10-20 hrs/week)
• 🚀 Start ASAP with possible extension

📨 Hiring Process

Estimated timeline: 1-2 weeks

1. 1Take-home evaluation exercise· unknown
2. 2One behavioral interview· 45 min