Description

You will help train advanced AI models by engaging in realistic legal scenarios, evaluating their reasoning, and identifying gaps in performance. Collaborate with the team to refine prompts and improve evaluation metrics, directly shaping AI tools for legal professionals.

Requirements

• JD and active law license required
• Significant litigation experience (trial, appellate, or complex dispute resolution)
• Ability to articulate legal reasoning clearly and precisely
• History of publication, clerkship, teaching, or specialization preferred
• Must supply own secure computer and high-speed internet

Responsibilities

• Challenge AI models with realistic legal scenarios
• Evaluate model reasoning for accuracy and analytical rigor
• Identify reproducible failure points in model performance
• Engage in substantive legal dialogue with the model
• Collaborate on refining prompts and improving evaluation metrics