Description

You will review videos, posts, and other media from social networks to assess whether certain criteria are met. You'll evaluate model outputs across categories, verify factual accuracy and logical soundness, capture error traces, and suggest improvements to prompt engineering and evaluation metrics. This role offers the opportunity to shape the future of AI by providing high-quality training data from your social media expertise.

Requirements

• Native-level fluency in English
• Deep practical understanding of social media trends
• Ability to recognize cultural nuances
• Experience in content moderation, digital media analysis, or community-based projects is a plus
• Clear, metacognitive communication skills

Responsibilities

• Review videos, posts, and other media from social networks for specific criteria
• Assess model outputs across various categories against specified criteria
• Converse with the model on language scenarios and verify factual accuracy
• Capture reproducible error traces and suggest improvements to prompt engineering
• Assist in improving evaluation metrics