Flake It ’Till You Make It: Using Automated Repair to Induce and Fix Latent Test Flakiness

by Owain Parry, Michael Hilton, Gregory M. Kapfhammer, and Phil McMinn

International Workshop on Automated Program Repair (APR 2020)



Since flaky tests pass or fail nondeterministically, without any code changes, they are an unreliable indicator of program quality. Developers may quarantine or delete flaky tests because it is often too time consuming to repair them. Yet, since decommissioning too many tests may ultimately degrade a test suite’s effectiveness, devel- opers may eventually want to fix them, a process that is challenging because the nondeterminism may have been introduced previously. We contend that the best time to discover and repair a flaky test is when a developer first creates and best understands it. We refer to tests that are not ... [more]


Reference

Owain Parry, Michael Hilton, Gregory M. Kapfhammer, and Phil McMinn. Flake It ’Till You Make It: Using Automated Repair to Induce and Fix Latent Test Flakiness. International Workshop on Automated Program Repair (APR 2020), 2020


Bibtex Entry
@inproceedings{Parry2020,
  author    = "Parry, Owain and Hilton, Michael and Kapfhammer, Gregory M. and McMinn, Phil",
  title     = "Flake It 'Till You Make It: Using Automated Repair to Induce and Fix Latent Test Flakiness",
  booktitle = "International Workshop on Automated Program Repair (APR 2020)",
  year      = "2020"
}