Using Controlled Numbers of Real Faults and Mutants to Empirically Evaluate Coverage-Based Test Case Prioritization

by David Paterson, Gregory M. Kapfhammer, Gordon Fraser, and Phil McMinn

International Workshop on Automated Software Test (AST 2018) (To Appear)



Used to establish confidence in the correctness of evolving software, regression testing is an important, yet costly, task. Test case prioritization enables the rapid detection of faults during regression testing by reordering the test suite so that effective tests are run as early as is possible. However, a distinct lack of information about the regression faults found in complex real-world software forced prior experimental studies of these methods to use artificial faults called mutants. Using the Defects4J database of real faults, this paper presents the results of experiments evaluating the effectiveness of four representative test prioritization techniques. Since this paper’s ... [more]


Reference

David Paterson, Gregory M. Kapfhammer, Gordon Fraser, and Phil McMinn. Using Controlled Numbers of Real Faults and Mutants to Empirically Evaluate Coverage-Based Test Case Prioritization. International Workshop on Automated Software Test (AST 2018) (To Appear), 2018


Bibtex Entry
@inproceedings{Paterson2018,
  author    = "Paterson, David and Kapfhammer, Gregory M. and Fraser, Gordon and McMinn, Phil",
  title     = "Using Controlled Numbers of Real Faults and Mutants to Empirically Evaluate Coverage-Based Test Case Prioritization",
  booktitle = "International Workshop on Automated Software Test (AST 2018) (To Appear)",
  year      = "2018"
}