Description

You will challenge advanced language models on coding scenarios and theoretical programming questions, verify code correctness, capture error traces, and suggest improvements to prompt engineering and evaluation metrics. Your expertise will help power the next generation of AI by providing high-quality training data.

Requirements

• Bachelor's or master's degree in computer science, software engineering, or related field
• Strong understanding of software engineering, algorithms, data structures, debugging, architecture, version control, testing, and code optimization
• Expertise in OOP, functional programming, API design, concurrency, cloud-native development, and DevOps
• Clear, metacognitive communication skills

Responsibilities

• Conversing with the model on coding scenarios and theoretical programming questions
• Verifying code correctness and logical soundness
• Capturing reproducible error traces
• Suggesting improvements to prompt engineering and evaluation metrics
• Documenting failure modes to harden model reasoning