Ezio Bartocci, Dirk Beyer, Paul E. Black, Grigory Fedyukovich, Hubert Garavel, Arnd Hartmanns, Marieke Huisman, Fabrice Kordon, Julian Nagele, Mihaela Sighireanu, Bernhard Steffen, Martin Suda, Geoff Sutcliffe, Tjark Weber, and Akihisa Yamada. In Dirk Beyer, Marieke Huisman, Fabrice Kordon, and Bernhard Steffen, editors, Tools and Algorithms for the Construction and Analysis of Systems - 25 Years of TACAS: TOOLympics, Held as Part of ETAPS 2019, Prague, Czech Republic, April 6-11, 2019, Proceedings, Part III, volume 11429 of Lecture Notes in Computer Science, pages 3-24. Springer, 2019.
Evaluation of scientific contributions can be done in many different ways. For the various research communities working on the verification of systems (software, hardware, or the underlying involved mechanisms), it is important to bring together the community and to compare the state of the art, in order to identify progress of and new challenges in the research area. Competitions are a suitable way to do that.
The first verification competition was created in 1992 (SAT competition), shortly followed by the CASC competition in 1996. Since the year 2000, the number of dedicated verification competitions is steadily increasing. Many of these events now happen regularly, gathering researchers that would like to understand how well their research prototypes work in practice. Scientific results have to be reproducible, and powerful computers are becoming cheaper and cheaper, thus, these competitions are becoming an important means for advancing research in verification technology.
TOOLympics 2019 is an event to celebrate the achievements of the various competitions, and to understand their commonalities and differences. This volume is dedicated to the presentation of the 16 competitions that joined TOOLympics as part of the celebration of the 25th anniversary of the TACAS conference.
@inproceedings{bartocci19toolympics,
author = {Ezio Bartocci and Dirk Beyer and Paul E. Black and Grigory Fedyukovich and Hubert Garavel and Arnd Hartmanns and Marieke Huisman and Fabrice Kordon and Julian Nagele and Mihaela Sighireanu and Bernhard Steffen and Martin Suda and Geoff Sutcliffe and Tjark Weber and Akihisa Yamada},
title = {{TOOLympics} 2019: An Overview of Competitions in Formal Methods},
editor = {Dirk Beyer and Marieke Huisman and Fabrice Kordon and Bernhard Steffen},
booktitle = {Tools and Algorithms for the Construction and Analysis of Systems - 25 Years of {TACAS:} TOOLympics, Held as Part of {ETAPS} 2019, Prague, Czech Republic, April 6-11, 2019, Proceedings, Part {III}},
volume = {11429},
series = {Lecture Notes in Computer Science},
pages = {3--24},
publisher = {Springer},
year = {2019},
url = {https://doi.org/10.1007/978-3-030-17502-3\_1},
doi = {10.1007/978-3-030-17502-3\_1}
}