Description

You will challenge advanced language models on software engineering topics in Hindi (Roman Script), verifying logical accuracy and coding fluency, capturing error traces, and suggesting improvements to prompt engineering and evaluation metrics.

Requirements

• Bachelor's, Master's, or PhD in CS or related field
• Real-world coding experience
• Technical writing in Hindi (Roman Script) or open-source contributions
• Clear, metacognitive communication skills

Responsibilities

• Converse with the model on software engineering tasks in Hindi (Roman Script)
• Verify logical accuracy and coding fluency of model responses
• Assess naturalness and correctness of Hindi language usage
• Capture reproducible error traces
• Suggest improvements to prompt engineering and evaluation metrics