Build false negatives


Our stack:

Ruby 2.4.1, Ruby on Rails 5.0, RSpec 3.5

There are regular (2 out of 3) builds, that fail on a random RSpec test. The reason is 100% not our tests, because:

  1. our tests are green locally
  2. CI fails on the random test
  3. REbuilding solves it and in 100% of cases rebuild makes the build pass.
1 Like