🛠 Tech Stack

💼 About This Role

You'll lead Arabic benchmark adaptation projects for AI evaluation, managing distributed expert teams across GCC domains. Your work ensures culturally and regulatory accurate Arabic content for LLM benchmarks. This contract role offers flexible remote work and competitive compensation.

🎯 What You'll Do

• Onboard task creators and reviewers on rubric methodology and tools.
• Gate tasks for quality at all checkpoints: tasks, rubrics, reviews, solutions.
• Manage rework decisions to ensure utmost quality.
• Coordinate across domain pods and maintain weekly delivery cadence.

📋 Requirements

• Native-level Arabic (MSA) with professional working English.
• Project management experience leading distributed expert teams.
• Familiarity with LLMs, rubric evaluation, and LLM pipelines.
• Demonstrable judgment about quality in professional GCC Arabic content.

✨ Nice to Have

• Prior experience on AI evaluation, benchmarking, or RLHF/SFT data programs.
• Working familiarity with one or more relevant sectors (Finance, Healthcare, etc.).

🎁 Benefits & Perks

• ⏰ Flexible schedule – work when you want as an independent contractor.
• 💵 Competitive rates and prompt payments.
• 🌍 Work on cutting-edge AI and language technology projects.
• 🤝 Global community of linguists and subject matter experts.

📨 Hiring Process

Estimated timeline: 2-4 weeks

1. 1Resume/CV submission· 1 week
2. 2Structured interview· 1 hour
3. 3Reference check· 1 week

[email protected]