Write a Blog >>
ICST 2020
Sat 24 - Wed 28 October 2020 Porto, Portugal
Sun 25 Oct 2020 15:24 - 15:36 at Infante - Teasers Chair(s): Jacques Klein, David Lo
Mon 26 Oct 2020 02:24 - 02:36 at Infante - Teasers Chair(s): David Lo, Jacques Klein

Performance testing remains a challenge, particularly for complex systems. Different application-, platform- and workload-based factors can influence the performance of software under test. Common approaches for generating platform- and workload-based test conditions are often based on system model or source code analysis, real usage modeling and use-case based design techniques. Nonetheless, creating a detailed performance model is often difficult, and also those artifacts might not be always available during the testing. On the other hand, test automation solutions such as automated test case generation can enable effort and cost reduction with the potential to improve the intended test criteria coverage. Furthermore, if the optimal way (policy) to generate test cases can be learnt by testing system, then the learnt policy can be reused in further testing situations such as testing variants, evolved versions of software, and different testing scenarios. This capability can lead to additional cost and computation time saving in the testing process. In this research, we present an autonomous performance testing framework which uses a model-free reinforcement learning augmented by fuzzy logic and self-adaptive strategies. It is able to learn the optimal policy to generate platform- and workload-based test conditions which result in meeting the intended testing objective without access to system model and source code. The use of fuzzy logic and self-adaptive strategy helps to tackle the issue of uncertainty and improve the accuracy and adaptivity of the proposed learning. Our evaluation experiments show that the proposed autonomous performance testing framework is able to generate the test conditions efficiently and in a way adaptive to varying testing situations.

Sun 25 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

15:00 - 16:00: TeasersPosters Track at Infante +11h
Chair(s): Jacques KleinUniversity of Luxembourg, Luxembourg, David LoSingapore Management University
15:00 - 15:12
Talk
Poster: Agent-based Testing of Extended Reality Systems
Posters Track
Rui PradaUniversidade de Lisboa, Wishnu PrasetyaUtrecht University, Fitsum KifetewFondazione Bruno Kessler, Frank DignumUmea University, Tanja E. J. VosUniversitat Politècnica de València, Jason LanderGameware, Jean-Yves DonnartThales AVS, Alexandre KazmierowskiThales SIX GTS, Joseph DavidsonGood AI, Pedro FernandesUniversidade de Lisboa
Link to publication DOI
15:12 - 15:24
Talk
Poster: Is Euclidean Distance the best Distance Measurement for Adaptive Random Testing?
Posters Track
Rubing HuangJiangsu University, Chenhui CuiJiangsu University, Weifeng SunJiangsu University, Dave ToweyUniversity of Nottingham Ningbo China
Link to publication DOI
15:24 - 15:36
Talk
Poster: Performance Testing Driven by Reinforcement Learning
Posters Track
Mahshid Helali MoghadamRISE Research Institutes of Sweden , Mehrdad SaadatmandRISE Research Institutes of Sweden, Markus BorgRISE Research Institutes of Sweden, Markus BohlinRISE Research Institutes of Sweden, Bjorn LisperMälardalen University
Link to publication DOI
15:36 - 15:48
Talk
Poster: SONAR Testing - Novel Testing Approach Based on Operation Recording and Visualization
Posters Track
Link to publication DOI
15:48 - 16:00
Talk
Poster: Test Case Prioritization Using Error Propagation Probability
Posters Track
Jeonghyun JooKorea Air Force Academy, Seunghoon YooKorea Air Force Academy, Myunghwan ParkKorea Air Force Academy
Link to publication DOI

Mon 26 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

02:00 - 03:00: TeasersPosters Track at Infante
Chair(s): David LoSingapore Management University, Jacques KleinUniversity of Luxembourg, Luxembourg
02:00 - 02:12
Talk
Poster: Agent-based Testing of Extended Reality Systems
Posters Track
Rui PradaUniversidade de Lisboa, Wishnu PrasetyaUtrecht University, Fitsum KifetewFondazione Bruno Kessler, Frank DignumUmea University, Tanja E. J. VosUniversitat Politècnica de València, Jason LanderGameware, Jean-Yves DonnartThales AVS, Alexandre KazmierowskiThales SIX GTS, Joseph DavidsonGood AI, Pedro FernandesUniversidade de Lisboa
Link to publication DOI
02:12 - 02:24
Talk
Poster: Is Euclidean Distance the best Distance Measurement for Adaptive Random Testing?
Posters Track
Rubing HuangJiangsu University, Chenhui CuiJiangsu University, Weifeng SunJiangsu University, Dave ToweyUniversity of Nottingham Ningbo China
Link to publication DOI
02:24 - 02:36
Talk
Poster: Performance Testing Driven by Reinforcement Learning
Posters Track
Mahshid Helali MoghadamRISE Research Institutes of Sweden , Mehrdad SaadatmandRISE Research Institutes of Sweden, Markus BorgRISE Research Institutes of Sweden, Markus BohlinRISE Research Institutes of Sweden, Bjorn LisperMälardalen University
Link to publication DOI
02:36 - 02:48
Talk
Poster: SONAR Testing - Novel Testing Approach Based on Operation Recording and Visualization
Posters Track
Link to publication DOI
02:48 - 03:00
Talk
Poster: Test Case Prioritization Using Error Propagation Probability
Posters Track
Jeonghyun JooKorea Air Force Academy, Seunghoon YooKorea Air Force Academy, Myunghwan ParkKorea Air Force Academy
Link to publication DOI