A Comprehensive Survey of Trends in Oracles for Software Testing

by Mark Harman, Phil McMinn, Muzammil Shahbaz and Shin Yoo

Technical Report (Department of Computer Science, University of Sheffield), 2013


A more recent and expanded journal version of this paper is available — see "The Oracle Problem in Software Testing: A Survey".


Testing involves examining the behaviour of a system in order to discover potential faults. Determining the desired correct behaviour for a given input is called the “oracle problem”. Oracle automation is important to remove a current bottleneck which inhibits greater overall test automation; without oracle automation, the human has to determine whether observed behaviour is correct. The literature on oracles has introduced techniques for oracle automation, including modelling, specifications, contract-driven development and metamorphic testing. When none of these is completely adequate, the final source of oracle information remains the human, who may be aware of informal specifications, expectations, norms and ... [more]


Reference

Mark Harman, Phil McMinn, Muzammil Shahbaz and Shin Yoo. A Comprehensive Survey of Trends in Oracles for Software Testing. Department of Computer Science, University of Sheffield Technical Report CS-13-01, 2013


Bibtex Entry
@techreport{Harman2013,
  author      = "Harman, Mark and McMinn, Phil and Shahbaz, Muzammil and Yoo, Shin",
  title       = "A Comprehensive Survey of Trends in Oracles for Software Testing",
  number      = "CS-13-01",
  year        = "2013",
  institution = "Department of Computer Science, University of Sheffield"
}