Write a Blog >>
ICST 2020
Sat 24 - Wed 28 October 2020 Porto, Portugal
Sun 25 Oct 2020 15:24 - 15:36 at Infante - Teasers Chair(s): Jacques Klein, David Lo
Mon 26 Oct 2020 02:24 - 02:36 at Infante - Teasers Chair(s): Jacques Klein, David Lo

Performance testing remains a challenge, particularly for complex systems. Different application-, platform- and workload-based factors can influence the performance of software under test. Common approaches for generating platform- and workload-based test conditions are often based on system model or source code analysis, real usage modeling and use-case based design techniques. Nonetheless, creating a detailed performance model is often difficult, and also those artifacts might not be always available during the testing. On the other hand, test automation solutions such as automated test case generation can enable effort and cost reduction with the potential to improve the intended test criteria coverage. Furthermore, if the optimal way (policy) to generate test cases can be learnt by testing system, then the learnt policy can be reused in further testing situations such as testing variants, evolved versions of software, and different testing scenarios. This capability can lead to additional cost and computation time saving in the testing process. In this research, we present an autonomous performance testing framework which uses a model-free reinforcement learning augmented by fuzzy logic and self-adaptive strategies. It is able to learn the optimal policy to generate platform- and workload-based test conditions which result in meeting the intended testing objective without access to system model and source code. The use of fuzzy logic and self-adaptive strategy helps to tackle the issue of uncertainty and improve the accuracy and adaptivity of the proposed learning. Our evaluation experiments show that the proposed autonomous performance testing framework is able to generate the test conditions efficiently and in a way adaptive to varying testing situations.

Sun 25 Oct

Displayed time zone: Lisbon change

15:00 - 16:00
TeasersPosters Track at Infante +11h
Chair(s): Jacques Klein University of Luxembourg, Luxembourg, David Lo Singapore Management University
15:00
12m
Talk
Poster: Agent-based Testing of Extended Reality Systems
Posters Track
Rui Prada Universidade de Lisboa, Wishnu Prasetya Utrecht University, Fitsum Kifetew Fondazione Bruno Kessler, Frank Dignum Umea University, Tanja E. J. Vos Universitat Politècnica de València, Jason Lander Gameware, Jean-Yves Donnart Thales AVS, Alexandre Kazmierowski Thales SIX GTS, Joseph Davidson Good AI, Pedro Fernandes Universidade de Lisboa
Link to publication DOI
15:12
12m
Talk
Poster: Is Euclidean Distance the best Distance Measurement for Adaptive Random Testing?
Posters Track
Rubing Huang Jiangsu University, Chenhui Cui Jiangsu University, Weifeng Sun Jiangsu University, Dave Towey University of Nottingham Ningbo China
Link to publication DOI
15:24
12m
Talk
Poster: Performance Testing Driven by Reinforcement Learning
Posters Track
Mahshid Helali Moghadam RISE Research Institutes of Sweden , Mehrdad Saadatmand RISE Research Institutes of Sweden, Markus Borg RISE Research Institutes of Sweden, Markus Bohlin RISE Research Institutes of Sweden, Bjorn Lisper Mälardalen University
Link to publication DOI
15:36
12m
Talk
Poster: SONAR Testing - Novel Testing Approach Based on Operation Recording and Visualization
Posters Track
Link to publication DOI
15:48
12m
Talk
Poster: Test Case Prioritization Using Error Propagation Probability
Posters Track
Jeonghyun Joo Korea Air Force Academy, Seunghoon Yoo Korea Air Force Academy, Myunghwan Park Korea Air Force Academy
Link to publication DOI

Mon 26 Oct

Displayed time zone: Lisbon change

02:00 - 03:00
TeasersPosters Track at Infante
Chair(s): Jacques Klein University of Luxembourg, Luxembourg, David Lo Singapore Management University
02:00
12m
Talk
Poster: Agent-based Testing of Extended Reality Systems
Posters Track
Rui Prada Universidade de Lisboa, Wishnu Prasetya Utrecht University, Fitsum Kifetew Fondazione Bruno Kessler, Frank Dignum Umea University, Tanja E. J. Vos Universitat Politècnica de València, Jason Lander Gameware, Jean-Yves Donnart Thales AVS, Alexandre Kazmierowski Thales SIX GTS, Joseph Davidson Good AI, Pedro Fernandes Universidade de Lisboa
Link to publication DOI
02:12
12m
Talk
Poster: Is Euclidean Distance the best Distance Measurement for Adaptive Random Testing?
Posters Track
Rubing Huang Jiangsu University, Chenhui Cui Jiangsu University, Weifeng Sun Jiangsu University, Dave Towey University of Nottingham Ningbo China
Link to publication DOI
02:24
12m
Talk
Poster: Performance Testing Driven by Reinforcement Learning
Posters Track
Mahshid Helali Moghadam RISE Research Institutes of Sweden , Mehrdad Saadatmand RISE Research Institutes of Sweden, Markus Borg RISE Research Institutes of Sweden, Markus Bohlin RISE Research Institutes of Sweden, Bjorn Lisper Mälardalen University
Link to publication DOI
02:36
12m
Talk
Poster: SONAR Testing - Novel Testing Approach Based on Operation Recording and Visualization
Posters Track
Link to publication DOI
02:48
12m
Talk
Poster: Test Case Prioritization Using Error Propagation Probability
Posters Track
Jeonghyun Joo Korea Air Force Academy, Seunghoon Yoo Korea Air Force Academy, Myunghwan Park Korea Air Force Academy
Link to publication DOI