Automatic exploratory performance testing using a discriminator neural network

Tutkimustuotos: Artikkeli kirjassa/raportissa/konferenssijulkaisussaKonferenssiartikkeliTieteellinenvertaisarvioitu

3 Sitaatiot (Scopus)

Abstrakti

We present a novel exploratory performance testing algorithm that uses supervised learning to optimize the test suite generation process. The goal of the proposed approach is to generate test suites that contain a large number of positive tests, revealing performance defects or other issues of interest in the system under test. The key idea is to use a deep neural network to predict which test could be positive and to train this network online during the test generation process, designing and executing the test suite simultaneously. The proposed algorithm assumes that the system under test is stateless and the outcome of the tests is deterministic. Also, only integer and floating point inputs are supported. Otherwise, the approach is completely automatic and it does not require any prior knowledge about the internals of the system under test. It can also be used effectively in a continuous integration setting where small variations of a system are tested successively. We evaluate our algorithm using two example problems: searching for bottlenecks in a web service and searching for efficient hardware configurations in a single-board computer. In both examples, the presented algorithm performed several times better than a random test generator and significantly better compared to our previously published algorithm, producing test suites with a large proportion of positive tests.
AlkuperäiskieliEnglanti
Otsikko2020 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)
Kustantajathe Institute of Electrical and Electronics Engineers, Inc.
Sivut105-113
Sivumäärä9
ISBN (elektroninen)9781728110752
ISBN (painettu)9781728110769
DOI - pysyväislinkit
TilaJulkaistu - 2020
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaIEEE International Conference on Software Testing, Verification and Validation Workshops -
Kesto: 24 lokakuuta 2020 → …

Konferenssi

KonferenssiIEEE International Conference on Software Testing, Verification and Validation Workshops
LyhennettäICSTW
Ajanjakso24/10/20 → …

Sormenjälki Sukella tutkimusaiheisiin 'Automatic exploratory performance testing using a discriminator neural network'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Viittausmuodot