Manager's Guide to Flaky Test Management
You're in the Sprint Review, and the team is feeling pretty good about the new feature, it’s done, the CI (Continuous Integration) pipeline is green, and they have a Friday release planned. Things are going according to plan. Then something worse happens. A test fails. But no one has an explanation. It passed yesterday. It works on my machine. Perhaps it is just the test environment again? You rerun it; green. Rerun it; red. The inconsistency starts introducing doubt. Is it an actual problem?