3h ago

Senior Software Quality Engineer - AI

Vancouver Metro, Canada
full-timesenior HybridSoftware Integration and Automation

Tech Stack

Description

In this role, you will bridge traditional software quality engineering with AI quality practices. You'll design and implement comprehensive testing strategies for backend infrastructure and Generative AI features powering agentic applications. Your work will establish quality standards across microservices and AI/ML models, ensuring robust and production-ready products.

Requirements

  • Deep expertise in automated testing for backend and AI/ML systems
  • Experience with LLM/SLM model testing and prompt/output validation
  • Ability to create evaluation datasets covering edge cases and adversarial scenarios
  • Proficiency in observability and monitoring for AI quality assessment
  • Strong collaboration skills to advocate for quality-first practices

Responsibilities

  • Design and execute test plans for backend services, APIs, and microservices
  • Partner with engineering and product teams to identify quality risks early
  • Develop automated testing frameworks (Pytest, Playwright, unittest)
  • Build end-to-end test suites for backend systems, AI agents, and databases
  • Design automated evaluation frameworks for Generative AI features and agentic workflows
0 views 0 saves 0 applications