Description

You will own Brex's simulation and validation platform for AI-powered products, building a system that uses synthetic data and scenario generation to ensure every AI surface is continuously scrutinized under realistic conditions. You'll partner with product teams to catch regressions before customers do and set quality gates, including authority to block launches when standards are not met.

Requirements

• Experience building and owning complex software systems where correctness, reliability, and failure modes are critical
• Experience designing test, simulation, or validation systems for non-deterministic or high-stakes environments
• Strong systems thinking, ability to decompose complex problems and reduce incidental complexity
• Demonstrated ability to influence product architecture through quality, reliability, and launch-readiness constraints
• Comfort operating with real authority and cross-team influence, including blocking launches

Responsibilities

• Evolve and scale a simulation and validation platform to stress-test AI products using large-scale synthetic data
• Develop evaluation mechanisms to detect regressions, edge cases, and failure modes in non-deterministic systems
• Run continuous testing in isolated, production-like environments and set quality gates
• Partner with product engineering teams to improve system testability and robustness
• Define and uphold company-wide standards for AI feature quality