Description

You will challenge advanced language models on Punjabi grammar, syntax, semantics, and cultural context, documenting failure modes to improve model reasoning. This freelance role involves conversing with the model on language scenarios, verifying accuracy, and suggesting improvements to evaluation metrics.

Requirements

• Master's or PhD in Punjabi language, linguistics, or closely related field
• Peer-reviewed publications, translation experience, or hands-on linguistic analysis projects preferred
• Clear, metacognitive communication skills

Responsibilities

• Conversing with AI models on Punjabi language scenarios
• Verifying factual accuracy and logical soundness of model outputs
• Capturing reproducible error traces
• Documenting failure modes related to dialectal variation, formal vs colloquial language, translation accuracy, semantic ambiguity, and cultural context
• Suggesting improvements to prompt engineering and evaluation metrics