Flakiness Detection

A test that passes one run and fails the next teaches your team to ignore failures, which defeats the point of testing. Flakiness Detection identifies tests that flip between pass and fail without any code change and reports on them, so you can isolate the unreliable ones and restore trust in a red result.

Who it’s for#

Teams whose suites have grown noisy, where intermittent failures get rerun or waved through instead of investigated.

What it does#

• Flaky test identification — Spot tests that pass and fail without changes.
• Per-test reporting — Review flakiness for an individual test case.
• Per-application reporting — See flakiness rolled up across an application.
• Top flaky tests — View the worst offenders so you know where to start.
• Quarantine and fix — Set unreliable tests aside and address them deliberately.

How it works#

The platform tracks how each test behaves across runs and flags ones that change result without a corresponding change in code. You can review flakiness for a single test case or across a whole application, and a top flaky tests view points you at the cases doing the most damage.

Why it matters#

Flaky tests erode trust in the entire suite, because once people learn to rerun a failure they stop reading failures at all. Finding and quarantining the unreliable ones keeps a failing test meaningful, which is the only reason to run tests in the first place.