Hunting Intermittent Tests

Dave Dash
5 min readDec 13, 2015

There’s a sad time in testing land when you have a test suite that you can’t rely on. Instead of running a suite and merging if it passes, you have to glance over the failed tests and say “Oh that one… that test is flaky.”

Then it becomes a class of tests, “oh we can ignore Elasticsearch tests.” Eventually we stop trusting the build and just merge it. Because it’s probably the Elasticsearch test that failed. At least I think that’s what my email said:

The builds all start to blur together.

--

--

Dave Dash

DadOps 24/7 and DevOps Consultant. Formerly @Pinterest and @Mozilla