1d ago

AI Engineer, Evaluation

India

โœจ $100k-$150k / yearest.

full-timemid Remoteai-ml

๐Ÿ›  Tech Stack

๐Ÿ’ผ About This Role

You'll design and implement AI model evaluation frameworks to ensure quality, accuracy, and safety at scale. You will build automated testing pipelines and dashboards that track performance metrics across production environments. Your work directly influences how enterprise AI systems are trusted and deployed.

๐ŸŽฏ What You'll Do

  • Design and implement automated evaluation pipelines for AI model quality.
  • Develop task-specific benchmarks and test suites for model iteration.
  • Build dashboards and reporting systems for performance metrics.
  • Create automated regression testing integrated into CI/CD pipelines.

๐Ÿ“‹ Requirements

  • 3+ years of software engineering in data/ML environments.
  • Python proficiency for data processing and automation.
  • Statistical analysis and data visualization techniques.
  • Understanding of ML evaluation metrics like precision, recall, F1.

โœจ Nice to Have

  • Experience with dashboarding and monitoring tools.
  • Familiarity with A/B testing frameworks.
  • Experience with CI/CD pipelines for model deployment.

๐ŸŽ Benefits & Perks

  • ๐Ÿ’ฐ Competitive compensation aligned with experience
  • ๐ŸŒ Global exposure to large-scale AI systems
  • ๐Ÿ”ฌ Collaborative culture focused on experimentation
  • ๐Ÿ“ˆ Career growth in advanced AI and ML infrastructure
  • ๐Ÿก Flexible work practices depending on team needs

๐Ÿ“จ Hiring Process

Estimated timeline: 2-4 weeks ยท AI estimate

  1. 1Recruiter Callยท 30 min
  2. 2Technical Interviewยท 60 min
  3. 3Team Interviewยท 45 min
0 0 0