Abstract
We report on the organization and results of the third edition of the Cyber-Physical Systems tool competition, held as part of the SBFT workshop. Six tools (i.e., CRAG, EvoMBT, RIGAA, RoadSign, Spirale, and WOGAN) competed with the aim of triggering failures of two autonomous driving agents.We evaluated the effectiveness of the tools in exposing failures as well as the diversity of the generated failures. This report describes our methodology, the competitors, the results, and the challenges we faced while running the competition experiments.
| Original language | English |
|---|---|
| Title of host publication | 2023 IEEE/ACM International Workshop on Search-Based and Fuzz Testing (SBFT) |
| Publisher | IEEE |
| Pages | 45-48 |
| ISBN (Electronic) | 979-8-3503-0182-3 |
| ISBN (Print) | 979-8-3503-0183-0 |
| DOIs | |
| Publication status | Published - 2023 |
| MoE publication type | A4 Article in a conference publication |
| Event | IEEE/ACM International Workshop on Search-Based and Fuzz Testing - Duration: 14 May 2023 → … |
Conference
| Conference | IEEE/ACM International Workshop on Search-Based and Fuzz Testing |
|---|---|
| Abbreviated title | SBFT |
| Period | 14/05/23 → … |
Funding
ACKNOWLEDGMENTS We thank the participants for their invaluable contributions and feedback, which support the evolution and maturity of automated testing strategies for CPSs. We thank BeamNG GmbH for providing the driving simulator to the participants. We would also like to thank the IEEE Technical Community on Software Engineering (TCSE) and ACM Special Interest Group on Software Engineering (SIGSOFT) for sponsoring SBFT’23. Matteo Biagiola and Vincenzo Riccio were partially supported by the H2020 project PRECRIME, funded under the ERC Advanced Grant 2017 Program (ERC Grant Agreement n. 787703). J. Peltomäki was supported by funding from the ECSEL Joint Undertaking (JU) under grant agreement 374 No 101007350.