Flaky Spec Detection for Retry Specs

We wanted to implement a retry functionality for flaky specs, but we want to know if the Insights detect a failed spec that has been retry a couple of times as a flaky/broken spec even if it passes in a third run?


That would depend on how you are adding the retry if it is within the same job that ran the test originally if you are re-running the test within the job, we won’t be able to detect it, as we currently use the last test result for a given test for a given job when using our flaky test detection.

If you are re-running the whole job it will show as flaky within the Insights.

Kind Regards
Owen Oliver