The Oracle Problem in Software Testing: A Survey

by Earl T. Barr, Mark Harman, Phil McMinn, Muzammil Shahbaz and Shin Yoo

IEEE Transactions on Software Engineering, 2015



Testing involves examining the behaviour of a system in order to discover potential faults. Given an input for a system, the challenge of distinguishing the corresponding desired, correct behaviour from potentially incorrect behavior is called the “test oracle problem”. Test oracle automation is important to remove a current bottleneck that inhibits greater overall test automation. Without test oracle automation, the human has to determine whether observed behaviour is correct. The literature on test oracles has introduced techniques for oracle automation, including modelling, specifications, contract-driven development and metamorphic testing. When none of these is completely adequate, the final source of test ... [more]


Reference

Earl T. Barr, Mark Harman, Phil McMinn, Muzammil Shahbaz and Shin Yoo. The Oracle Problem in Software Testing: A Survey. IEEE Transactions on Software Engineering, vol. 41, no. 5, pp. 507–525, 2015


Bibtex Entry
@article{Barr2015,
  author  = "Barr, Earl T. and Harman, Mark and McMinn, Phil and Shahbaz, Muzammil and Yoo, Shin",
  title   = "The Oracle Problem in Software Testing: A Survey",
  journal = "IEEE Transactions on Software Engineering",
  volume  = "41",
  number  = "5",
  pages   = "507--525",
  year    = "2015"
}