Description

You'll challenge advanced language models on STEM topics, verifying factual accuracy and logical soundness, capturing error traces, and suggesting improvements to prompting and evaluation. Your expertise will help power the next generation of AI by providing high-quality training data.

Requirements

• Bachelor's or master's degree in a STEM discipline
• Fluency in Russian
• Clear, metacognitive communication skills
• Published research, engineering design experience, data analysis projects, or coding portfolios are a plus

Responsibilities

• Challenge AI models on STEM topics like thermodynamics, mechanics, calculus, statistics, materials science, electronics, algorithm design, and quantitative modeling
• Document failure modes to harden model reasoning
• Converse with the model on real-world STEM problem-solving scenarios
• Verify factual accuracy and logical soundness
• Suggest improvements to prompt engineering and evaluation metrics