Description

You will use your legal expertise to train AI models by engaging in substantive dialogue, evaluating reasoning, identifying failure points, and refining prompts to improve model performance.

Requirements

• JD and active law license
• Substantial litigation experience (trial work, appellate advocacy, or other contested matters)
• Ability to articulate legal reasoning clearly and precisely
• Preferred: publication history, clerkships, teaching experience, or subject matter specialization

Responsibilities

• Challenge AI models with realistic legal scenarios and assess their reasoning
• Evaluate model responses for factual accuracy and analytical rigor
• Identify reproducible failure points
• Collaborate with team to refine prompts and improve evaluation metrics
• Document performance gaps to strengthen model reasoning