Write a Blog >>
ICST 2020
Sat 24 - Wed 28 October 2020 Porto, Portugal

Dates
Rooms
Tracks
Badges
Your Program
You're viewing the program in a time zone which is different from your device's time zone - change time zone

Sat 24 Oct

Displayed time zone: Lisbon change

09:00 - 10:30
Welcome + Session: Process ImprovementNEXTA at D. Luis
Chair(s): Pasqualina Potena RISE Research Institutes of Sweden AB
09:00
15m
Day opening
Welcome address and practical arrangements
NEXTA

09:15
30m
Full-paper
Test Automation Process Improvement in a DevOps Team: Experience report
NEXTA
Yuqing Wang University of Oulu, Maaret Pyhäjärvi F-Secure, Mika Mäntylä University of Oulu
Link to publication DOI
09:45
20m
Short-paper
Test Automation Challenges for Application Landscape Frameworks
NEXTA
Nils Wild Research Group Software Construction RWTH Aachen University, Horst Lichter RWTH Aachen University, Peter Kehren Research Group Software Construction RWTH Aachen University
Link to publication DOI
10:05
20m
Full-paper
Test Automation Improvement Model - TAIM 2.0
NEXTA
Sigrid Eldh Ericsson
Link to publication DOI
09:00 - 10:30
Session IA-MOST at Porto
Chair(s): Bernhard Aichernig Graz University of Technology

A-MOST2020 is held as a virtual workshop via Zoom. Contact [email protected] for the details.

09:00
10m
Day opening
Opening
A-MOST

09:10
80m
Talk
Keynote: Why models?
A-MOST
I: Ana Paiva Faculty of Engineering of the University of Porto
09:15 - 10:30
Session IITEQS at São João
Chair(s): Mehrdad Saadatmand RISE Research Institutes of Sweden

ITEQS 2020 is held as a virtual workshop via Zoom. Contact [email protected] for the details.

09:15
15m
Day opening
Welcome and opening message
ITEQS

09:30
30m
Full-paper
Automatic exploratory performance testing using a discriminator neural network
ITEQS
Ivan Porres Åbo Akademi University, Tanwir Ahmad Åbo Akademi University, Hergys Rexha Åbo Akademi University, Sebastien Lafond Åbo Akademi University, Dragos Truscan Åbo Akademi University
Link to publication DOI
10:00
30m
Full-paper
Performance Evaluation of Container's Shared Volumes
ITEQS
Naylor Garcia University of São Paulo - USP, Paulo Sergio Lopes de Souza University of São Paulo - USP, Sarita M. Bruschi University of São Paulo - USP, Simone do Rocio Senger de Souza University of São Paulo - USP
Link to publication DOI
11:00 - 12:30
Session: OptimisationNEXTA at D. Luis
Chair(s): Adnan Causevic Mälardalen University
11:00
30m
Full-paper
Optimization of automated executions based on integration test configurations of embedded software
NEXTA
Masashi Mizoguchi Hitachi Ltd., Takahiro Iida Hitachi Automotive Systems Ltd., Toru Irie Hitachi Automotive Systems Ltd.
Link to publication DOI
11:30
30m
Full-paper
Selective Regression Testing based on Big Data: Comparing Feature Extraction Techniques
NEXTA
Khaled Al-Sabbagh University of Gothenburg, Miroslaw Staron University of Gothenburg, Regina Hebig Chalmers | Gothenburg University, Miroslaw Ochodek Poznan University of Technology, Wilhelm Meding Ericsson
Link to publication DOI
12:00
20m
Full-paper
Runtime Prioritization with the Classification Tree Method for Test Automation
NEXTA
Barbara Jung Expleo Germany, Peter M. Kruse Expleo Group
Link to publication DOI
11:00 - 12:30
Session IIA-MOST at Porto
Chair(s): Angelo Gargantini University of Bergamo

A-MOST2020 is held as a virtual workshop via Zoom. Contact [email protected] for the details.

11:00
30m
Full-paper
A Tool for the Automatic Generation of Test Cases and Oracles for Simulation Models Based on Functional Requirements
A-MOST
Aitor Arrieta Mondragon Goi Eskola Politeknikoa, Joseba Andoni Agirre Universidad Mondragon , Goiuria Sagardui University of Mondragon
Link to publication DOI
11:30
30m
Full-paper
A Model-Based Security Testing Approach for Automotive Over-The-Air Updates
A-MOST
Shahid Mahmood Coventry University , Alexy Fouillade Ecole superieure d’electronique de l’Ouest, Hoang Nga Nguyen Coventry University , Siraj Ahmed Shaikh Coventry University, Coventry, UK
Link to publication DOI
12:00
30m
Full-paper
Ontology-based Testing: An Emerging Paradigm for Modeling and Testing Systems and Software
A-MOST
Franz Wotawa Technische Universitaet Graz, Josip Bozic Graz University of Technology (Alumnus), Yihao Li Institute of Technology, Graz University of Technology
Link to publication DOI
11:00 - 12:30
Session IIITEQS at São João
Chair(s): Eduard Paul Enoiu Mälardalen University

ITEQS 2020 is held as a virtual workshop via Zoom. Contact [email protected] for the details.

11:00
30m
Full-paper
Prioritizing Scenarios based on STAMP/STPA Using Statistical Model Checking
ITEQS
Mitsuaki Tsuji Nara Institute of Science and Technology, Toshinori Takai Nara Institute of Science and Technology, Kazuki Kakimoto Nara Institute of Science and Technology, Naoki Ishihama Japan Aerospace Exploration Agency, Masafumi Katahira Japan Aerospace Exploration Agency, Hajimu Iida Nara Institute of Science and Technology
Link to publication DOI
11:30
30m
Full-paper
Generating Tests for the Discovery of Security Flaws in Product Variants
ITEQS
Francisco Araújo LASIGE, Faculdade de Ciências da Universidade de Lisboa, Ibéria Medeiros LaSIGE, Faculdade de Ciências da Universidade de Lisboa, Nuno Neves DI FC UL
Link to publication DOI
12:00
30m
Full-paper
Test Data Generation for False Data Injection Attack Testing in Air Traffic Surveillance *Best Paper*
ITEQS
Aymeric Cretin Femto-ST Institute, Alexandre Vernotte Femto-ST Institute, Antoine Chevrot Femto-ST Institute, Fabien Peureux Institut FEMTO-ST (UMR CNRS 6174) and Smartesting S&S, Bruno Legeard FEMTO-ST / DISC
Link to publication DOI
12:40 - 15:00
Session IMutation at Arrábida
12:40
25m
Day opening
Warm Up
Mutation

13:05
10m
Day opening
Welcome
Mutation

13:15
75m
Talk
Keynote
Mutation
Mike Papadakis University of Luxembourg, Luxembourg
14:30
15m
Full-paper
On the impact of timeouts and JVM crashes in Pitest
Mutation
Thomas Laurent Lero & University College Dublin, Fionnuala Wall Lero and University College Dublin, Anthony Ventresque Lero and University College Dublin
Link to publication DOI
14:45
15m
Full-paper
Using mutation testing to measure behavioural test diversity
Mutation
Francisco Gomes Chalmers | University of Gothenburg, Felix Dobslaw Chalmers University of Technology, Robert Feldt Chalmers University of Technology
Link to publication DOI
13:00 - 14:00
Opening SessionIWCT at Farfetch (D. Maria)
13:00
15m
Day opening
Welcome to IWCT
IWCT
Dimitris Simos SBA Research, Jeff Yu Lei University of Texas at Arlington, Changhai Nie
13:15
45m
Talk
Keynote: Verifying autonomous systems using ontology-based testing
IWCT
Franz Wotawa Technische Universitaet Graz
13:00 - 14:20
Session ITAIC PART at Miragaia
13:00
10m
Day opening
Opening
TAIC PART

13:26
26m
Talk
Coding Effective Testing Tools Within Minutes – Live!
TAIC PART
Andreas Zeller CISPA, Germany
14:10
10m
Live Q&A
Q&A: Coding Effective Testing Tools Within Minutes – Live!
TAIC PART

14:00 - 15:30
Session: Test GenerationNEXTA at D. Luis
Chair(s): Serge Demeyer University of Antwerp, Belgium
14:00
30m
Full-paper
Optimizing the Parameters of an Evolutionary Algorithm for Fuzzing and Test Data Generation
NEXTA
Ralf Gerlich Dr. Rainer Gerlich System and Software Engineering, Christian R. Prause German Aerospace Center - Space Administration
Link to publication DOI
14:30
30m
Full-paper
Boundary Value Exploration for Software Analysis
NEXTA
Felix Dobslaw Chalmers University of Technology, Francisco Gomes Chalmers | University of Gothenburg, Robert Feldt Chalmers University of Technology
Link to publication DOI
15:00
20m
Short-paper
Test Data Generation for MC/DC Criterion using Reinforcement Learning
NEXTA
Ján Čegiň Faculty of Informatics and Information Technologies Slovak Technical University, Karol Rástočný Faculty of Informatics and Information Technologies, Slovak University of Technology in Bratislava
Link to publication DOI
14:00 - 15:30
Session IIIA-MOST at Porto
Chair(s): Raluca Lefticaru University of Bradford

A-MOST2020 is held as a virtual workshop via Zoom. Contact [email protected] for the details.

14:00
30m
Full-paper
Using tabular notation to support Model Based Testing
A-MOST
Rachid Kherrazi Akka Technologies
Link to publication DOI
14:30
30m
Full-paper
Model-Based Testing for MAPE-K adaptation control loops
A-MOST
Paolo Arcaini National Institute of Informatics , Raffaela Mirandola Politecnico di Milano , Elvinia Riccobene Computer Science Dept., University of Milan, Patrizia Scandurra University of Bergamo, Italy
Link to publication DOI
15:00
30m
Full-paper
Conformance Testing in UPPAAL: A diabolic approach
A-MOST
Florian Lorber Aalborg University, Emil Jørgensen Njor Aalborg University, Nikolaj Isgård Schmidt Aalborg University, Sebastian Reidar Petersen Aalborg University
Link to publication DOI
14:00 - 15:30
Session IIIITEQS at São João
Chair(s): Dragos Truscan Åbo Akademi University

ITEQS 2020 is held as a virtual workshop via Zoom. Contact [email protected] for the details.

14:00
60m
Talk
Security Testing using Artificial Intelligence Methods and Techniques
ITEQS
Franz Wotawa Technische Universitaet Graz
15:00
30m
Full-paper
Keywords-based test categorization for Extra-Functional Properties
ITEQS
Muhammad Abbas RISE Research Institutes of Sweden, Abdul Rauf RISE Research Institutes of Sweden, Mehrdad Saadatmand RISE Research Institutes of Sweden, Eduard Paul Enoiu Mälardalen University, Daniel Sundmark Mälardalen University
Link to publication DOI
15:30
10m
Day closing
Best Paper Award & Closing
ITEQS

14:15 - 14:20
Poster Presentation SessionIWCT at Farfetch (D. Maria)
14:15
5m
Talk
Toward an Encoding Approach to Interaction-based Test Suite Minimization
IWCT
Kohei Nishino Waseda University, Takashi Kitamura National Institute of Advanced Industrial Science and Technology (AIST), Tomoji Kishi Waseda University, Cyrille Artho KTH Royal Institute of Technology
Link to publication DOI
14:20 - 15:10
Test Generation and Combinatorial Testing Applications SessionIWCT at Farfetch (D. Maria)
14:20
20m
Full-paper
An Automata-Based Generation Method for Combinatorial Sequence Testing of Finite State Machines
IWCT
Andrea Bombarda University of Bergamo, Angelo Gargantini University of Bergamo
Link to publication DOI
14:40
10m
Short-paper
Combinatorial Methods for Explainable AI
IWCT
Rick Kuhn Natl Institute of Standards & Technology, Raghu Kacker National Institute of Standards and Technology, Jeff Yu Lei University of Texas at Arlington, Dimitris Simos SBA Research
Link to publication DOI
14:50
20m
Full-paper
Generation of Invalid Test Inputs from Over-Constrained Test Models for Combinatorial Robustness Testing
IWCT
Konrad Fögen RWTH Aachen University, Horst Lichter RWTH Aachen University
Link to publication DOI
15:00 - 17:00
Session ICCIW at Infante
15:00
30m
Day opening
Welcome to CCIW
CCIW

15:30
30m
Talk
Interoperability Challenges in CI/CD Ecosystem
CCIW
Fatih Degirmenci Ericsson Software Technology
16:00
30m
Talk
Test flakiness reduction of retry reduction? Why not have both?
CCIW
16:30
30m
Talk
Continuous Data Analysis for CI
CCIW
Thomas Bach Heidelberg University
15:15 - 16:30
Session IIMutation at Arrábida
15:15
15m
Full-paper
SiMut: Exploring Program Similarity to Support the Cost Reduction of Mutation Testing
Mutation
Alessandro V. Pizzoleto Federal University of Sao Carlos, Fabiano Ferrari Federal University of São Carlos, Lucas D. Dallilo University of Sao Paulo, Jeff Offutt George Mason University
Link to publication DOI
15:30
15m
Full-paper
Predicting Survived and Killed Mutants
Mutation
Alejandra Duque Torres Institute of Computer Science, University of Tartu, Natia Doliashvili Institute of Computer Science, University of Tartu, Dietmar Pfahl University of Tartu, Rudolf Ramler Software Competence Center Hagenberg
Link to publication DOI
15:45
15m
Full-paper
Fault Types of Adaptive and Context-Aware Systems and Their Relationship with Fault-based Testing Approaches
Mutation
Bento Rafael Siqueira Federal University of São Carlos, Fabiano Ferrari Federal University of São Carlos, Kathiani E. Souza Federal University of São Carlos, Daniel S. M. Santibáñez Federal University of São Carlos, Valter Vieira Camargo Federal University of São Carlos
Link to publication DOI
16:00
15m
Full-paper
MutantDistiller: Using Symbolic Execution for Automatic Detection of Equivalent Mutants and Generation of Mutant Killing Tests
Mutation
Michael Baer , Norbert Oster , Michael Philippsen Friedrich-Alexander University Erlangen-Nürnberg (FAU)
Link to publication DOI
16:15
15m
Full-paper
An Approach to Identifying Minimal and Equivalent Mutants Based on Source Code Structure
Mutation
Claudinei Brito Junior Universidade de São Paulo, Vinicius Durelli Universidade Federal de São João del-Rei, Rafael S. Durelli Federal University of Lavras Lavras, Simone do Rocio Senger de Souza University of São Paulo - USP, Auri Vincenzi Federal University of São Carlos, Marcio Eduardo Delamaro Universidade de São Paulo
Link to publication DOI
15:30 - 16:40
Combinatorial Testing Tools SessionIWCT at Farfetch (D. Maria)
15:30
10m
Short-paper
On Using Ontologies for Testing Compilers
IWCT
Yihao Li Institute of Technology, Graz University of Technology, Franz Wotawa Technische Universitaet Graz
Link to publication DOI
15:40
20m
Full-paper
A Comparison Infrastructure for Fault Characterization Algorithms
IWCT
Torben Friedrichs RWTH Aachen University, Konrad Fögen RWTH Aachen University, Horst Lichter RWTH Aachen University
Link to publication DOI
16:00
20m
Full-paper
Avocado: Open-Source Flexible Constrained Interaction Testing for Practical Application
IWCT
Jan Richter Czech Technical University in Prague, Bestoun S. Ahmed Karlstad University, Miroslav Bures Czech Technical University in Prague, Cleber R. Rosa Junior Red Hat, Inc.
Link to publication DOI
16:20
20m
Full-paper
CAGEN: A fast combinatorial test generation tool with support for constraints and higher-index arrays
IWCT
Michael Wagner SBA Research, Kristoffer Kleine SBA Research, Dimitris Simos SBA Research, Rick Kuhn Natl Institute of Standards & Technology, Raghu Kacker National Institute of Standards and Technology
Link to publication DOI
16:00 - 17:30
Session: User-Interface Testing + ClosingNEXTA at D. Luis
Chair(s): Kristian Wiklund Ericsson AB
16:00
30m
Full-paper
On the Industrial Applicability of Augmented Testing: An Empirical Study
NEXTA
Michel Nass Blekinge Institute of Technology, Emil Alégroth Blekinge Institute of Technology, Robert Feldt Chalmers University of Technology
Link to publication DOI
16:30
20m
Full-paper
Session-Based Recommender Systems for Action Selection in GUI Test Generation
NEXTA
Varun Nayak ReTest GmbH, Daniel Kraus ReTest GmbH
Link to publication DOI
16:50
40m
Awards
Award Ceremony -- Best Question Award; Best Presentation Award; Most influential tweet award
NEXTA

16:00 - 17:30
Session IVA-MOST at Porto
Chair(s): Florian Lorber Aalborg University

A-MOST2020 is held as a virtual workshop via Zoom. Contact [email protected] for the details.

16:00
30m
Full-paper
Model-Based Testing of Read Only Graph Queries
A-MOST
Leen Lambers Hasso-Plattner-Institut, Universität Potsdam , Sven Schneider Hasso-Plattner-Institut, Universität Potsdam , Marcel Weisgut Hasso-Plattner-Institut, Universität Potsdam
Link to publication DOI
16:30
30m
Full-paper
Optimizing decision making in concolic execution using reinforcement learning
A-MOST
Ciprian Paduraru University of Bucharest , Alin Stefanescu University of Bucharest , Miruna Gabriela Paduraru University of Bucharest
Link to publication DOI
17:00
30m
Day closing
Closing
A-MOST

16:55 - 17:55
16:55
60m
Day closing
Wrap up (feedback, planning)
IWCT

19:00 - 19:30
Recap DiscussionCCIW at Infante
19:00
30m
Talk
What are the biggest challenges in large scale CI/CD?
CCIW

Sun 25 Oct

Displayed time zone: Lisbon change

09:00 - 09:15
Intro & WelcomeResearch Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room +11h
Chair(s): João Pascoal Faria Faculty of Engineering, University of Porto and INESC TEC, Rui Abreu Faculty of Engineering, University of Porto, Portugal
09:00
15m
Day opening
Intro & Welcome
Research Papers

09:15 - 10:45
IT1 - Test Generation & RefactoringIndustry Track at Farfetch (D. Maria) +11h
Chair(s): João Pascoal Faria Faculty of Engineering, University of Porto and INESC TEC
09:15
30m
Talk
Parallelization of Classical Numerical Optimization in Quantum Variational Algorithms
Industry Track
Marco Pistoia JPMorgan Chase & Co, Peng Liu Google, Chun-Fu Richard Chen IBM, Shaohan Hu IBM, Stephen Wood IBM
Link to publication DOI
09:45
30m
Talk
SPECMATE: Automated Creation of Test Cases from Acceptance Criteria
Industry Track
Jannik Fischbach Qualicen GmbH, Andreas Vogelsang University of Cologne, Dominik Spies Qualicen GmbH, Andreas Wehrle Qualicen GmbH, Maximilian Junker Qualicen GmbH, Dietmar Freudenstein Allianz Deutschland AG
Link to publication DOI
10:15
30m
Talk
Tool Support for Refactoring Manual Tests
Industry Track
Elodie Bernard FEMTO-ST Institute, Univ. Bourgogne Franche-Comté, Sogeti, Julien Botella Smartesting, Fabrice Ambert FEMTO-ST Institute, Bruno Legeard FEMTO-ST / DISC, Mark Utting University of the Sunshine Coast
Link to publication DOI
09:15 - 10:45
RT1 - Fault Localization and Debugging InfanteResearch Papers at Infante +11h
Chair(s): Andreas Zeller CISPA, Germany
09:15
30m
Talk
Can We Predict the Quality of Spectrum-based Fault Localization?
Research Papers
Mojdeh Golagha Technical University of Munich, Alexander Pretschner Technical University of Munich, Lionel Briand University of Luxembourg, University of Ottawa
Link to publication DOI
09:45
30m
Talk
Substate Profiling for Enhanced Fault Detection and Localization: An Empirical Study
Research Papers
Rawad Abou Assi American University of Beirut, Wes Masri American University of Beirut, Chadi Trad American University of Beirut
Link to publication DOI
10:15
30m
Talk
More Accurate Dynamic Slicing for Better Supporting Software Debugging
Research Papers
Xiangyu Li Georgia Institute of Technology, Alessandro Orso Georgia Tech
Link to publication DOI
11:00 - 12:30
RT3 - Testing Deep Learning and Robotic SystemsResearch Papers at Farfetch (D. Maria) +11h
Chair(s): Antonio Filieri Imperial College London
11:00
30m
Talk
An Empirical Evaluation of Mutation Operators for Deep Learning SystemsDistinguished Paper Award
Research Papers
Gunel Jahangirova USI Lugano, Switzerland, Paolo Tonella Università della Svizzera Italiana (USI)
Link to publication DOI
11:30
30m
Talk
Comparing Offline and Online Testing of Deep Neural Networks: An Autonomous Car Case Study
Research Papers
Fitash Ul Haq University of Luxembourg, Donghwan Shin University of Luxembourg, Shiva Nejati University of Luxembourg, Lionel Briand University of Luxembourg, University of Ottawa
Link to publication DOI
12:00
30m
Talk
A Study on Challenges of Testing Robotic Systems
Research Papers
Afsoon Afzal Carnegie Mellon University, Claire Le Goues Carnegie Mellon University, Michael Hilton Carnegie Mellon University, USA, Christopher Steven Timperley Carnegie Mellon University
Link to publication DOI
11:00 - 12:30
RT2 - Test Generation InfanteResearch Papers at Infante +11h
Chair(s): Marcelo d'Amorim Federal University of Pernambuco
11:00
30m
Talk
Language-Agnostic Generation of Compilable Test Programs
Research Papers
Patrick Kreutzer Friedrich-Alexander University Erlangen-Nürnberg, Stefan Kraus Friedrich-Alexander University Erlangen-Nürnberg, Michael Philippsen Friedrich-Alexander University Erlangen-Nürnberg (FAU)
Link to publication DOI
11:30
30m
Talk
MiMIs: Simple, Efficient, and Fast Bounded-Exhaustive Test Case Generators
Research Papers
Kyle Dewey California State University, Northridge, Shant Hairapetian University of Oregon, Miroslav Gavrilov University of California, Santa Barbara
Link to publication DOI
12:00
30m
Talk
Learning How to Search: Generating Exception-Triggering Tests Through Adaptive Fitness Function Selection
Research Papers
Hussein Almulla University of South Carolina, Gregory Gay Chalmers and the University of Gothenburg
Link to publication DOI
14:00 - 16:00
RT5 - Testing for APIsTesting Tools Track / Research Papers at Farfetch (D. Maria) +11h
Chair(s): José Miguel Rojas University of Leicester, UK
14:00
30m
Talk
QuickREST: Property-based Test Generation of OpenAPI-Described RESTful APIs
Research Papers
Stefan Karlsson ABB AB, Mälardalen University, Adnan Causevic Mälardalen University, Daniel Sundmark Mälardalen University
Link to publication DOI
14:30
30m
Talk
RESTTESTGEN: Automated Black-Box Testing of RESTful APIsDistinguished Paper Award
Research Papers
Emanuele Viglianisi FBK, Michael Dallago University of Trento, Mariano Ceccato University of Verona
Link to publication DOI
15:00
30m
Talk
Testability Transformations For Existing APIs
Research Papers
Andrea Arcuri Kristiania University College, Norway, Juan Pablo Galeotti University of Buenos Aires
Link to publication DOI
15:30
15m
Talk
CDST: A Toolkit for Testing Cockpit Display Systems
Testing Tools Track
Hassan Sartaj QUEST - UAV Dependability Lab, Muhammad Zohaib Iqbal National University of Computer and Emerging Sciences, Muhammad Uzair Khan National University of Computer and Emerging Sciences
Link to publication DOI
15:45
15m
Talk
Open-source Defect Injection Benchmark Testbed for the Evaluation of Testing
Testing Tools Track
Miroslav Bures Czech Technical University in Prague, Pavel Herout University of West Bohemia, Pilsen, CZ, Bestoun S. Ahmed Karlstad University
Link to publication DOI
14:00 - 15:00
RT4 - Misc 1Research Papers at Infante +11h
Chair(s): Andrea Stocco Università della Svizzera italiana (USI)
14:00
30m
Talk
Determining Method-Call Sequences for Object Creation in C++
Research Papers
Thomas Bach Heidelberg University, Ralf Pannemans SAP, Artur Andrzejak Heidelberg University
Link to publication DOI
14:30
30m
Talk
NodeRacer: Event Race Detection for Node.js Applications
Research Papers
André T. Endo Federal University of Technology - Paraná (UTFPR), Anders Møller Aarhus University, Denmark
Link to publication DOI
15:00 - 16:00
TeasersPosters Track at Infante +11h
Chair(s): Jacques Klein University of Luxembourg, Luxembourg, David Lo Singapore Management University
15:00
12m
Talk
Poster: Agent-based Testing of Extended Reality Systems
Posters Track
Rui Prada Universidade de Lisboa, Wishnu Prasetya Utrecht University, Fitsum Kifetew Fondazione Bruno Kessler, Frank Dignum Umea University, Tanja E. J. Vos Universitat Politècnica de València, Jason Lander Gameware, Jean-Yves Donnart Thales AVS, Alexandre Kazmierowski Thales SIX GTS, Joseph Davidson Good AI, Pedro Fernandes Universidade de Lisboa
Link to publication DOI
15:12
12m
Talk
Poster: Is Euclidean Distance the best Distance Measurement for Adaptive Random Testing?
Posters Track
Rubing Huang Jiangsu University, Chenhui Cui Jiangsu University, Weifeng Sun Jiangsu University, Dave Towey University of Nottingham Ningbo China
Link to publication DOI
15:24
12m
Talk
Poster: Performance Testing Driven by Reinforcement Learning
Posters Track
Mahshid Helali Moghadam RISE Research Institutes of Sweden , Mehrdad Saadatmand RISE Research Institutes of Sweden, Markus Borg RISE Research Institutes of Sweden, Markus Bohlin RISE Research Institutes of Sweden, Bjorn Lisper Mälardalen University
Link to publication DOI
15:36
12m
Talk
Poster: SONAR Testing - Novel Testing Approach Based on Operation Recording and Visualization
Posters Track
Link to publication DOI
15:48
12m
Talk
Poster: Test Case Prioritization Using Error Propagation Probability
Posters Track
Jeonghyun Joo Korea Air Force Academy, Seunghoon Yoo Korea Air Force Academy, Myunghwan Park Korea Air Force Academy
Link to publication DOI
16:15 - 17:15
Keynote 1Research Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room
Chair(s): João Pascoal Faria Faculty of Engineering, University of Porto and INESC TEC
16:15
60m
Keynote
One-click formal methods
Research Papers
Link to publication
20:00 - 20:15
Intro & WelcomeResearch Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room
Chair(s): João Pascoal Faria Faculty of Engineering, University of Porto and INESC TEC, Rui Abreu Faculty of Engineering, University of Porto, Portugal
20:00
15m
Day opening
Intro & Welcome
Research Papers

20:15 - 21:45
IT1 - Test Generation & RefactoringIndustry Track at Farfetch (D. Maria)
Chair(s): John Micco VMware
20:15
30m
Talk
Parallelization of Classical Numerical Optimization in Quantum Variational Algorithms
Industry Track
Marco Pistoia JPMorgan Chase & Co, Peng Liu Google, Chun-Fu Richard Chen IBM, Shaohan Hu IBM, Stephen Wood IBM
Link to publication DOI
20:45
30m
Talk
SPECMATE: Automated Creation of Test Cases from Acceptance Criteria
Industry Track
Jannik Fischbach Qualicen GmbH, Andreas Vogelsang University of Cologne, Dominik Spies Qualicen GmbH, Andreas Wehrle Qualicen GmbH, Maximilian Junker Qualicen GmbH, Dietmar Freudenstein Allianz Deutschland AG
Link to publication DOI
21:15
30m
Talk
Tool Support for Refactoring Manual Tests
Industry Track
Elodie Bernard FEMTO-ST Institute, Univ. Bourgogne Franche-Comté, Sogeti, Julien Botella Smartesting, Fabrice Ambert FEMTO-ST Institute, Bruno Legeard FEMTO-ST / DISC, Mark Utting University of the Sunshine Coast
Link to publication DOI
20:15 - 21:45
RT1 - Fault Localization and Debugging InfanteResearch Papers at Infante
Chair(s): Jose Campos University of Lisbon, Portugal
20:15
30m
Talk
Can We Predict the Quality of Spectrum-based Fault Localization?
Research Papers
Mojdeh Golagha Technical University of Munich, Alexander Pretschner Technical University of Munich, Lionel Briand University of Luxembourg, University of Ottawa
Link to publication DOI
20:45
30m
Talk
Substate Profiling for Enhanced Fault Detection and Localization: An Empirical Study
Research Papers
Rawad Abou Assi American University of Beirut, Wes Masri American University of Beirut, Chadi Trad American University of Beirut
Link to publication DOI
21:15
30m
Talk
More Accurate Dynamic Slicing for Better Supporting Software Debugging
Research Papers
Xiangyu Li Georgia Institute of Technology, Alessandro Orso Georgia Tech
Link to publication DOI
22:00 - 23:30
RT3 - Testing Deep Learning and Robotic SystemsResearch Papers at Farfetch (D. Maria)
Chair(s): João Pascoal Faria Faculty of Engineering, University of Porto and INESC TEC
22:00
30m
Talk
An Empirical Evaluation of Mutation Operators for Deep Learning SystemsDistinguished Paper Award
Research Papers
Gunel Jahangirova USI Lugano, Switzerland, Paolo Tonella Università della Svizzera Italiana (USI)
Link to publication DOI
22:30
30m
Talk
Comparing Offline and Online Testing of Deep Neural Networks: An Autonomous Car Case Study
Research Papers
Fitash Ul Haq University of Luxembourg, Donghwan Shin University of Luxembourg, Shiva Nejati University of Luxembourg, Lionel Briand University of Luxembourg, University of Ottawa
Link to publication DOI
23:00
30m
Talk
A Study on Challenges of Testing Robotic Systems
Research Papers
Afsoon Afzal Carnegie Mellon University, Claire Le Goues Carnegie Mellon University, Michael Hilton Carnegie Mellon University, USA, Christopher Steven Timperley Carnegie Mellon University
Link to publication DOI
22:00 - 23:30
RT2 - Test Generation InfanteResearch Papers at Infante
Chair(s): Corina S. Pasareanu Carnegie Mellon University Silicon Valley, NASA Ames Research Center
22:00
30m
Talk
Language-Agnostic Generation of Compilable Test Programs
Research Papers
Patrick Kreutzer Friedrich-Alexander University Erlangen-Nürnberg, Stefan Kraus Friedrich-Alexander University Erlangen-Nürnberg, Michael Philippsen Friedrich-Alexander University Erlangen-Nürnberg (FAU)
Link to publication DOI
22:30
30m
Talk
MiMIs: Simple, Efficient, and Fast Bounded-Exhaustive Test Case Generators
Research Papers
Kyle Dewey California State University, Northridge, Shant Hairapetian University of Oregon, Miroslav Gavrilov University of California, Santa Barbara
Link to publication DOI
23:00
30m
Talk
Learning How to Search: Generating Exception-Triggering Tests Through Adaptive Fitness Function Selection
Research Papers
Hussein Almulla University of South Carolina, Gregory Gay Chalmers and the University of Gothenburg
Link to publication DOI

Mon 26 Oct

Displayed time zone: Lisbon change

01:00 - 03:00
RT5 - Testing for APIsResearch Papers / Testing Tools Track at Farfetch (D. Maria)
Chair(s): Marcelo d'Amorim Federal University of Pernambuco
01:00
30m
Talk
QuickREST: Property-based Test Generation of OpenAPI-Described RESTful APIs
Research Papers
Stefan Karlsson ABB AB, Mälardalen University, Adnan Causevic Mälardalen University, Daniel Sundmark Mälardalen University
Link to publication DOI
01:30
30m
Talk
RESTTESTGEN: Automated Black-Box Testing of RESTful APIsDistinguished Paper Award
Research Papers
Emanuele Viglianisi FBK, Michael Dallago University of Trento, Mariano Ceccato University of Verona
Link to publication DOI
02:00
30m
Talk
Testability Transformations For Existing APIs
Research Papers
Andrea Arcuri Kristiania University College, Norway, Juan Pablo Galeotti University of Buenos Aires
Link to publication DOI
02:30
15m
Talk
CDST: A Toolkit for Testing Cockpit Display Systems
Testing Tools Track
Hassan Sartaj QUEST - UAV Dependability Lab, Muhammad Zohaib Iqbal National University of Computer and Emerging Sciences, Muhammad Uzair Khan National University of Computer and Emerging Sciences
Link to publication DOI
02:45
15m
Talk
Open-source Defect Injection Benchmark Testbed for the Evaluation of Testing
Testing Tools Track
Miroslav Bures Czech Technical University in Prague, Pavel Herout University of West Bohemia, Pilsen, CZ, Bestoun S. Ahmed Karlstad University
Link to publication DOI
01:00 - 02:00
RT4 - Misc 1Research Papers at Infante
Chair(s): Corina S. Pasareanu Carnegie Mellon University Silicon Valley, NASA Ames Research Center
01:00
30m
Talk
Determining Method-Call Sequences for Object Creation in C++
Research Papers
Thomas Bach Heidelberg University, Ralf Pannemans SAP, Artur Andrzejak Heidelberg University
Link to publication DOI
01:30
30m
Talk
NodeRacer: Event Race Detection for Node.js Applications
Research Papers
André T. Endo Federal University of Technology - Paraná (UTFPR), Anders Møller Aarhus University, Denmark
Link to publication DOI
02:00 - 03:00
TeasersPosters Track at Infante
Chair(s): Jacques Klein University of Luxembourg, Luxembourg, David Lo Singapore Management University
02:00
12m
Talk
Poster: Agent-based Testing of Extended Reality Systems
Posters Track
Rui Prada Universidade de Lisboa, Wishnu Prasetya Utrecht University, Fitsum Kifetew Fondazione Bruno Kessler, Frank Dignum Umea University, Tanja E. J. Vos Universitat Politècnica de València, Jason Lander Gameware, Jean-Yves Donnart Thales AVS, Alexandre Kazmierowski Thales SIX GTS, Joseph Davidson Good AI, Pedro Fernandes Universidade de Lisboa
Link to publication DOI
02:12
12m
Talk
Poster: Is Euclidean Distance the best Distance Measurement for Adaptive Random Testing?
Posters Track
Rubing Huang Jiangsu University, Chenhui Cui Jiangsu University, Weifeng Sun Jiangsu University, Dave Towey University of Nottingham Ningbo China
Link to publication DOI
02:24
12m
Talk
Poster: Performance Testing Driven by Reinforcement Learning
Posters Track
Mahshid Helali Moghadam RISE Research Institutes of Sweden , Mehrdad Saadatmand RISE Research Institutes of Sweden, Markus Borg RISE Research Institutes of Sweden, Markus Bohlin RISE Research Institutes of Sweden, Bjorn Lisper Mälardalen University
Link to publication DOI
02:36
12m
Talk
Poster: SONAR Testing - Novel Testing Approach Based on Operation Recording and Visualization
Posters Track
Link to publication DOI
02:48
12m
Talk
Poster: Test Case Prioritization Using Error Propagation Probability
Posters Track
Jeonghyun Joo Korea Air Force Academy, Seunghoon Yoo Korea Air Force Academy, Myunghwan Park Korea Air Force Academy
Link to publication DOI
09:30 - 10:30
Keynote 2Research Papers at Plenary Room
Chair(s): Luís Cruz Deflt University of Technology
10:45 - 12:15
IT2 - MiscIndustry Track at Farfetch (D. Maria) +11h
Chair(s): Luís Cruz Deflt University of Technology
10:45
30m
Talk
EC.LANG - A Language for Specifying Response Time Analyses of Event Chains
Industry Track
Max Friese Christian-Albrechts-Universität zu Kiel, Johannes Traub Daimler AG, Dirk Nowotka Christian-Albrechts-Universität zu Kiel
Link to publication DOI
11:15
30m
Talk
Detecting Higher-Order Merge Conflicts in Large Software Projects
Industry Track
Thorsten Wuensche SAP SE, Artur Andrzejak Heidelberg University, Sascha Schwedes SAP SE
Link to publication DOI
11:45
30m
Talk
Scaling Test Case Generation For Expressive Decision Tables
Industry Track
Supriya Agrawal Tata Consultancy Services Ltd. (TCS), R Venkatesh Tata Consultancy Services Ltd. (TCS), Ulka Shrotri Tata Consultancy Services Ltd. (TCS), Amey Zare Tata Consultancy Services Ltd. (TCS), Sagar Verma Tata Consultancy Services Ltd. (TCS)
Link to publication DOI
10:45 - 12:15
RT6 - Web TestingResearch Papers at Infante +11h
Chair(s): Jose Campos University of Lisbon, Portugal
10:45
30m
Talk
Fostering the Diversity of Exploratory Testing in Web Applications
Research Papers
Julien Leveau LaBRI, Xavier Blanc LaBRI, Laurent Réveillère LaBRI, Jean-Rémy Falleri Bordeaux INP, Romain Rouvoy Univ. Lille / Inria / IUF
Link to publication DOI
11:15
30m
Talk
Dependency-Aware Web Test Generation
Research Papers
Matteo Biagiola Fondazione Bruno Kessler (FBK), Andrea Stocco Università della Svizzera italiana (USI), Filippo Ricca Università di Genova, Paolo Tonella Università della Svizzera Italiana (USI)
Link to publication DOI
11:45
30m
Talk
Metamorphic Security Testing for Web Systems
Research Papers
Phu X. Mai University of Luxembourg, Fabrizio Pastore University of Luxembourg, Arda Goknil SnT, University of Luxembourg, Lionel Briand University of Luxembourg, University of Ottawa
Link to publication DOI
10:45 - 12:15
Doctoral Symposium 1Doctoral Symposium at São João
Chair(s): Ana Paiva Faculty of Engineering of the University of Porto, Shaukat Ali Simula Research Laboratory
10:45
30m
Talk
Panel 1: From research to industry
Doctoral Symposium
Goiuria Sagardui University of Mondragon
11:15
30m
Talk
How Can Software Testing be Improved by Analytics to Deliver Better Apps?
Doctoral Symposium
Julian Harty Commercetest Ltd
Link to publication DOI
11:45
30m
Talk
Automated verification of compliance of non-functional requirements on mobile applications through metamorphic testing
Doctoral Symposium
Misael Júnior University of Sao Paulo (USP)
Link to publication DOI
13:45 - 15:15
Journal First 1Journal-First Papers at Farfetch (D. Maria) +11h
Chair(s): Maurício Aniche Delft University of Technology, Netherlands
13:45
30m
Talk
Modeling Foundations for Executable Model-Based Testing of Self-Healing Cyber-Physical Systems
Journal-First Papers
Tao Ma Simula Research Laboratory, Shaukat Ali Simula Research Laboratory, Tao Yue Nanjing University of Aeronautics and Astronautics
Link to publication DOI
14:15
30m
Talk
Empirical evaluation of mutation-based test case prioritization techniques
Journal-First Papers
Donghwan Shin University of Luxembourg, Shin Yoo Korea Advanced Institute of Science and Technology, Mike Papadakis University of Luxembourg, Luxembourg, Doo-Hwan Bae Korea Advanced Institute of Science and Technology
Link to publication DOI
14:45
30m
Talk
Are Unit and Integration Test Definitions Still Valid for Modern Java Projects? An Empirical Study on Open-Source Projects
Journal-First Papers
Fabian Trautsch University of Göttingen, Steffen Herbold University of Göttingen, Jens Grabowski University of Göttingen
Link to publication DOI
13:45 - 15:15
RT7 - Optimizing TestingResearch Papers at Infante +11h
Chair(s): Fabiano Ferrari Federal University of São Carlos
13:45
30m
Talk
Optimizing Mutation Testing by Discovering Dynamic Mutant Subsumption Relations
Research Papers
Marcio Augusto Guimarães Federal University of Alagoas (UFAL), Leo Fernandes Federal Institute of Alagoas (IFAL), Márcio Ribeiro Federal University of Alagoas, Brazil, Marcelo d'Amorim Federal University of Pernambuco, Rohit Gheyi Federal University of Campina Grande
Link to publication DOI
14:15
30m
Talk
Massively Parallel, Highly Efficient, but What About the Test Suite Quality? Applying Mutation Testing to GPU Programs
Research Papers
Qianqian Zhu TU Delft, Andy Zaidman Delft University of Technology
Link to publication DOI Pre-print
14:45
30m
Talk
STICCER: Fast and Effective Database Test Suite Reduction Through Merging of Similar Test Cases
Research Papers
Abdullah Alsharif The University of Sheffield, Gregory Kapfhammer Allegheny College, USA, Phil McMinn University of Sheffield
Link to publication DOI
13:45 - 15:15
Doctoral Symposium 2Doctoral Symposium at São João
Chair(s): Ana Paiva Faculty of Engineering of the University of Porto, Shaukat Ali Simula Research Laboratory
13:45
30m
Talk
Panel 2: How to get your paper rejected?
Doctoral Symposium
Jeff Offutt George Mason University
14:15
30m
Talk
Well-informed Test Case Generation and Crash Reproduction
Doctoral Symposium
Pouria Derakhshanfar Delft University of Technology
Link to publication DOI
14:45
30m
Talk
Anomaly Analyses to Guide Software Testing Activity
Doctoral Symposium
Allan Mori University of São Paulo - USP
Link to publication DOI
15:30 - 17:00
RT9 - Empirical Analysis and Program RepairResearch Papers at Farfetch (D. Maria) +11h
Chair(s): Corina S. Pasareanu Carnegie Mellon University Silicon Valley, NASA Ames Research Center
15:30
30m
Talk
An Empirical Analysis of Blind Tests
Research Papers
Kesina Baral George Mason University, Jeff Offutt George Mason University
Link to publication DOI
16:00
30m
Talk
A Family of Experiments to Assess the Impact of Page Object Pattern in Web Test Suite Development
Research Papers
Maurizio Leotta Università di Genova, Matteo Biagiola Fondazione Bruno Kessler (FBK), Filippo Ricca Università di Genova, Mariano Ceccato University of Verona, Paolo Tonella Università della Svizzera Italiana (USI)
Link to publication DOI
16:30
30m
Talk
Human-In-The-Loop Automatic Program Repair
Research Papers
Marcel Böhme Monash University, Australia, Charaka Geethal Monash University, Van-Thuan Pham Monash University
Link to publication DOI
15:30 - 17:00
RT8 - Misc 2Journal-First Papers / Research Papers at Infante +11h
Chair(s): Alin Stefanescu University of Bucharest
15:30
30m
Talk
Implementation-induced Inconsistency and Nondeterminism in Deterministic Clustering Algorithms
Research Papers
Xin Yin New Jersey Institute of Technology, Iulian Neamtiu New Jersey Institute of Technology, USA, Saketan Patil New Jersey Institute of Technology, Sean Andrews New Jersey Institute of Technology
Link to publication DOI
16:00
30m
Talk
CBR: Controlled Burst Recording
Research Papers
Oscar Cornejo University of Milano Bicocca, Italy, Daniela Briola University of Milano Bicocca, Daniela Micucci University of Milano Bicocca, Leonardo Mariani University of Milano Bicocca
Link to publication DOI
16:30
30m
Talk
Mahtab: Phase-wise acceleration of regression testing for C
Journal-First Papers
Shouvick Mondal IIT Madras, India, Rupesh Nasre IIT Madras, India
Link to publication DOI Media Attached
15:30 - 17:00
Doctoral Symposium 3Doctoral Symposium at São João
Chair(s): Ana Paiva Faculty of Engineering of the University of Porto, Shaukat Ali Simula Research Laboratory
15:30
30m
Talk
Panel 3: Why and How to Get a Ph.D.?
Doctoral Symposium
Lionel Briand University of Luxembourg, University of Ottawa
16:00
30m
Talk
Toward Automated Assessment of User Experience in Extended Reality
Doctoral Symposium
Saba Gholizadeh Ansari Utrecht University
Link to publication DOI
16:30
30m
Talk
Source-Codeless Testing for Android Apps
Doctoral Symposium
Camilo Escobar-Velásquez Universidad de los Andes
Link to publication DOI
20:00 - 20:30
Most Influential Paper AwardsResearch Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room
Chair(s): Rui Abreu Faculty of Engineering, University of Porto, Portugal, João Pascoal Faria Faculty of Engineering, University of Porto and INESC TEC
20:00
15m
Awards
Using Mutation to Automatically Suggest Fixes for Faulty ProgramsDistinguished Paper Award
Research Papers
Media Attached
20:15
15m
Awards
Searching for a needle in a haystack predicting security vulnerabilities for Windows VistaDistinguished Paper Award
Research Papers
Thomas Zimmermann Microsoft Research, Nachiappan Nagappan Microsoft Research, USA, Laurie Williams North Carolina State University
Media Attached
21:45 - 23:15
IT2 - MiscIndustry Track at Farfetch (D. Maria)
Chair(s): Rui Abreu Faculty of Engineering, University of Porto, Portugal
21:45
30m
Talk
EC.LANG - A Language for Specifying Response Time Analyses of Event Chains
Industry Track
Max Friese Christian-Albrechts-Universität zu Kiel, Johannes Traub Daimler AG, Dirk Nowotka Christian-Albrechts-Universität zu Kiel
Link to publication DOI
22:15
30m
Talk
Detecting Higher-Order Merge Conflicts in Large Software Projects
Industry Track
Thorsten Wuensche SAP SE, Artur Andrzejak Heidelberg University, Sascha Schwedes SAP SE
Link to publication DOI
22:45
30m
Talk
Scaling Test Case Generation For Expressive Decision Tables
Industry Track
Supriya Agrawal Tata Consultancy Services Ltd. (TCS), R Venkatesh Tata Consultancy Services Ltd. (TCS), Ulka Shrotri Tata Consultancy Services Ltd. (TCS), Amey Zare Tata Consultancy Services Ltd. (TCS), Sagar Verma Tata Consultancy Services Ltd. (TCS)
Link to publication DOI
21:45 - 23:15
RT6 - Web TestingResearch Papers at Infante
Chair(s): Fabiano Ferrari Federal University of São Carlos
21:45
30m
Talk
Fostering the Diversity of Exploratory Testing in Web Applications
Research Papers
Julien Leveau LaBRI, Xavier Blanc LaBRI, Laurent Réveillère LaBRI, Jean-Rémy Falleri Bordeaux INP, Romain Rouvoy Univ. Lille / Inria / IUF
Link to publication DOI
22:15
30m
Talk
Dependency-Aware Web Test Generation
Research Papers
Matteo Biagiola Fondazione Bruno Kessler (FBK), Andrea Stocco Università della Svizzera italiana (USI), Filippo Ricca Università di Genova, Paolo Tonella Università della Svizzera Italiana (USI)
Link to publication DOI
22:45
30m
Talk
Metamorphic Security Testing for Web Systems
Research Papers
Phu X. Mai University of Luxembourg, Fabrizio Pastore University of Luxembourg, Arda Goknil SnT, University of Luxembourg, Lionel Briand University of Luxembourg, University of Ottawa
Link to publication DOI

Tue 27 Oct

Displayed time zone: Lisbon change

00:45 - 02:15
Journal First 1Journal-First Papers at Farfetch (D. Maria)
Chair(s): Fabiano Ferrari Federal University of São Carlos
00:45
30m
Talk
Modeling Foundations for Executable Model-Based Testing of Self-Healing Cyber-Physical Systems
Journal-First Papers
Tao Ma Simula Research Laboratory, Shaukat Ali Simula Research Laboratory, Tao Yue Nanjing University of Aeronautics and Astronautics
Link to publication DOI
01:15
30m
Talk
Empirical evaluation of mutation-based test case prioritization techniques
Journal-First Papers
Donghwan Shin University of Luxembourg, Shin Yoo Korea Advanced Institute of Science and Technology, Mike Papadakis University of Luxembourg, Luxembourg, Doo-Hwan Bae Korea Advanced Institute of Science and Technology
Link to publication DOI
01:45
30m
Talk
Are Unit and Integration Test Definitions Still Valid for Modern Java Projects? An Empirical Study on Open-Source Projects
Journal-First Papers
Fabian Trautsch University of Göttingen, Steffen Herbold University of Göttingen, Jens Grabowski University of Göttingen
Link to publication DOI
00:45 - 02:15
RT7 - Optimizing TestingResearch Papers at Infante
Chair(s): Corina S. Pasareanu Carnegie Mellon University Silicon Valley, NASA Ames Research Center
00:45
30m
Talk
Optimizing Mutation Testing by Discovering Dynamic Mutant Subsumption Relations
Research Papers
Marcio Augusto Guimarães Federal University of Alagoas (UFAL), Leo Fernandes Federal Institute of Alagoas (IFAL), Márcio Ribeiro Federal University of Alagoas, Brazil, Marcelo d'Amorim Federal University of Pernambuco, Rohit Gheyi Federal University of Campina Grande
Link to publication DOI
01:15
30m
Talk
Massively Parallel, Highly Efficient, but What About the Test Suite Quality? Applying Mutation Testing to GPU Programs
Research Papers
Qianqian Zhu TU Delft, Andy Zaidman Delft University of Technology
Link to publication DOI Pre-print
01:45
30m
Talk
STICCER: Fast and Effective Database Test Suite Reduction Through Merging of Similar Test Cases
Research Papers
Abdullah Alsharif The University of Sheffield, Gregory Kapfhammer Allegheny College, USA, Phil McMinn University of Sheffield
Link to publication DOI
02:30 - 04:00
RT9 - Empirical Analysis and Program RepairResearch Papers at Farfetch (D. Maria)
Chair(s): Corina S. Pasareanu Carnegie Mellon University Silicon Valley, NASA Ames Research Center
02:30
30m
Talk
An Empirical Analysis of Blind Tests
Research Papers
Kesina Baral George Mason University, Jeff Offutt George Mason University
Link to publication DOI
03:00
30m
Talk
A Family of Experiments to Assess the Impact of Page Object Pattern in Web Test Suite Development
Research Papers
Maurizio Leotta Università di Genova, Matteo Biagiola Fondazione Bruno Kessler (FBK), Filippo Ricca Università di Genova, Mariano Ceccato University of Verona, Paolo Tonella Università della Svizzera Italiana (USI)
Link to publication DOI
03:30
30m
Talk
Human-In-The-Loop Automatic Program Repair
Research Papers
Marcel Böhme Monash University, Australia, Charaka Geethal Monash University, Van-Thuan Pham Monash University
Link to publication DOI
02:30 - 04:00
02:30
30m
Talk
Implementation-induced Inconsistency and Nondeterminism in Deterministic Clustering Algorithms
Research Papers
Xin Yin New Jersey Institute of Technology, Iulian Neamtiu New Jersey Institute of Technology, USA, Saketan Patil New Jersey Institute of Technology, Sean Andrews New Jersey Institute of Technology
Link to publication DOI
03:00
30m
Talk
CBR: Controlled Burst Recording
Research Papers
Oscar Cornejo University of Milano Bicocca, Italy, Daniela Briola University of Milano Bicocca, Daniela Micucci University of Milano Bicocca, Leonardo Mariani University of Milano Bicocca
Link to publication DOI
03:30
30m
Talk
Mahtab: Phase-wise acceleration of regression testing for C
Journal-First Papers
Shouvick Mondal IIT Madras, India, Rupesh Nasre IIT Madras, India
Link to publication DOI Media Attached
09:00 - 10:00
Tool DemosTool Demos Track at Farfetch (D. Maria) +11h
Chair(s): Tao Yue Nanjing University of Aeronautics and Astronautics
09:00
12m
Talk
Cerberus: an Automated Tool for Continuous Testing
Tool Demos Track
Antoine Craske La Redoute
09:12
12m
Talk
EvoMaster: Search-Based System Test Generation for RESTful APIs
Tool Demos Track
Andrea Arcuri Kristiania University College, Norway, Juan Pablo Galeotti University of Buenos Aires, Bogdan Marculescu Kristiania University College, Norway, Man Zhang Kristiania University College, Norway
09:24
12m
Talk
Quick and Precise Security Testing During Development with Intelligence-Directed DAST
Tool Demos Track
Takuya Iwatsuka NTT, Haruto Tanno NTT, Eric Sharidan WhiteHat Security, Joseph Feiman WhiteHat Security
09:36
12m
Talk
Self guided test Automation - Adaptive and Self Healing automation of Cloud native applications
Tool Demos Track
Mahesh Venkataraman Accenture Solutions, Chinmaya Jena Accenture Solutions, Sunder Nochilur Accenture Solutions, Prabir Ghoushal Kumar Accenture Solutions
09:48
12m
Talk
User-Friendly Input Assistance with Web Crawling for Test Script Generation
Tool Demos Track
09:00 - 10:00
RT10 - Misc 3Research Papers at Infante +11h
Chair(s): Thomas Durieux KTH Royal Institute of Technology, Sweden
09:00
30m
Talk
A Framework for In-Vivo Testing of Mobile Applications
Research Papers
Mariano Ceccato University of Verona, Davide Corradini Fondazione Bruno Kessler, Luca Gazzola Università degli Studi di Milano-Bicocca, Fitsum Kifetew Fondazione Bruno Kessler, Leonardo Mariani University of Milano Bicocca, Matteo Orru University of Milano Bicocca, Paolo Tonella Università della Svizzera Italiana (USI)
Link to publication DOI
09:30
30m
Talk
Prioritizing Runtime Verification Violations
Research Papers
Breno Miranda Federal University of Pernambuco, Igor Lima Federal University of Pernambuco, Owolabi Legunsen Cornell University, Marcelo d'Amorim Federal University of Pernambuco
Link to publication DOI
10:00 - 11:00
IT3 - Safety & SecurityIndustry Track at Farfetch (D. Maria) +11h
Chair(s): Rui Abreu Faculty of Engineering, University of Porto, Portugal
10:00
30m
Talk
Generating Avoidable Collision Scenarios for Testing Autonomous Driving Systems
Industry Track
Alessandro Calò Technical University of Munich, Paolo Arcaini National Institute of Informatics , Shaukat Ali Simula Research Laboratory, Florian Hauer Technical University of Munich, Fuyuki Ishikawa National Institute of Informatics
Link to publication DOI
10:30
30m
Talk
Checking Security Properties of Cloud Service REST APIs
Industry Track
Vaggelis Atlidakis Columbia University, Patrice Godefroid Microsoft Research, USA, Marina Polishchuk Microsoft Research, USA
Link to publication DOI
10:00 - 11:00
Testing toolsTesting Tools Track at Infante +11h
Chair(s): René Just University of Washington, USA, Andy Zaidman Delft University of Technology
10:00
15m
Talk
Callisto: Entropy-based Test Generation and Data Quality Assessment for Machine Learning Systems
Testing Tools Track
Sakshi Udeshi , Xingbin Jiang Singapore University of Technology and Design, Sudipta Chattopadhyay Singapore University of Technology and Design
Link to publication DOI
10:15
15m
Talk
Run Java Applications and Test Them In-Vivo Meantime
Testing Tools Track
Antonia Bertolino CNR-ISTI, Guglielmo De Angelis CNR-IASI, CNR-ISTI, Breno Miranda Federal University of Pernambuco, Paolo Tonella Università della Svizzera Italiana (USI)
Link to publication DOI
10:30
15m
Talk
AFLNet: A Greybox Fuzzer for Network Protocols
Testing Tools Track
Van-Thuan Pham Monash University, Marcel Böhme Monash University, Australia, Abhik Roychoudhury National University of Singapore, Singapore
Link to publication DOI
10:45
15m
Talk
ct-fuzz: Fuzzing for Timing Leaks
Testing Tools Track
Shaobo He University of Utah, Michael Emmi Amazon Web Services, Gabriela Ciocarlie SRI International
Link to publication DOI
11:15 - 12:15
Open Steering Commitee & ICST 2021 PresentationResearch Papers at Plenary Room
Chair(s): Shin Yoo Korea Advanced Institute of Science and Technology
11:15
60m
Meeting
Open Steering Commitee & ICST 2021 Presentation
Research Papers

13:45 - 14:45
Keynote 3Research Papers at Plenary Room
Chair(s): Rui Abreu Faculty of Engineering, University of Porto, Portugal
13:45
60m
Keynote
SunDew: Systematic Automated Security Testing
Research Papers
20:00 - 21:00
Tool DemosTool Demos Track at Farfetch (D. Maria)
Chair(s): Tao Yue Nanjing University of Aeronautics and Astronautics
20:00
12m
Talk
Cerberus: an Automated Tool for Continuous Testing
Tool Demos Track
Antoine Craske La Redoute
20:12
12m
Talk
EvoMaster: Search-Based System Test Generation for RESTful APIs
Tool Demos Track
Andrea Arcuri Kristiania University College, Norway, Juan Pablo Galeotti University of Buenos Aires, Bogdan Marculescu Kristiania University College, Norway, Man Zhang Kristiania University College, Norway
20:24
12m
Talk
Quick and Precise Security Testing During Development with Intelligence-Directed DAST
Tool Demos Track
Takuya Iwatsuka NTT, Haruto Tanno NTT, Eric Sharidan WhiteHat Security, Joseph Feiman WhiteHat Security
20:36
12m
Talk
Self guided test Automation - Adaptive and Self Healing automation of Cloud native applications
Tool Demos Track
Mahesh Venkataraman Accenture Solutions, Chinmaya Jena Accenture Solutions, Sunder Nochilur Accenture Solutions, Prabir Ghoushal Kumar Accenture Solutions
20:48
12m
Talk
User-Friendly Input Assistance with Web Crawling for Test Script Generation
Tool Demos Track
20:00 - 21:00
RT10 - Misc 3Research Papers at Infante
Chair(s): Luís Cruz Deflt University of Technology
20:00
30m
Talk
A Framework for In-Vivo Testing of Mobile Applications
Research Papers
Mariano Ceccato University of Verona, Davide Corradini Fondazione Bruno Kessler, Luca Gazzola Università degli Studi di Milano-Bicocca, Fitsum Kifetew Fondazione Bruno Kessler, Leonardo Mariani University of Milano Bicocca, Matteo Orru University of Milano Bicocca, Paolo Tonella Università della Svizzera Italiana (USI)
Link to publication DOI
20:30
30m
Talk
Prioritizing Runtime Verification Violations
Research Papers
Breno Miranda Federal University of Pernambuco, Igor Lima Federal University of Pernambuco, Owolabi Legunsen Cornell University, Marcelo d'Amorim Federal University of Pernambuco
Link to publication DOI
21:00 - 22:00
IT3 - Safety & SecurityIndustry Track at Farfetch (D. Maria)
Chair(s): Rui Abreu Faculty of Engineering, University of Porto, Portugal
21:00
30m
Talk
Generating Avoidable Collision Scenarios for Testing Autonomous Driving Systems
Industry Track
Alessandro Calò Technical University of Munich, Paolo Arcaini National Institute of Informatics , Shaukat Ali Simula Research Laboratory, Florian Hauer Technical University of Munich, Fuyuki Ishikawa National Institute of Informatics
Link to publication DOI
21:30
30m
Talk
Checking Security Properties of Cloud Service REST APIs
Industry Track
Vaggelis Atlidakis Columbia University, Patrice Godefroid Microsoft Research, USA, Marina Polishchuk Microsoft Research, USA
Link to publication DOI
21:00 - 22:00
Testing toolsTesting Tools Track at Infante
Chair(s): René Just University of Washington, USA, Andy Zaidman Delft University of Technology
21:00
15m
Talk
Callisto: Entropy-based Test Generation and Data Quality Assessment for Machine Learning Systems
Testing Tools Track
Sakshi Udeshi , Xingbin Jiang Singapore University of Technology and Design, Sudipta Chattopadhyay Singapore University of Technology and Design
Link to publication DOI
21:15
15m
Talk
Run Java Applications and Test Them In-Vivo Meantime
Testing Tools Track
Antonia Bertolino CNR-ISTI, Guglielmo De Angelis CNR-IASI, CNR-ISTI, Breno Miranda Federal University of Pernambuco, Paolo Tonella Università della Svizzera Italiana (USI)
Link to publication DOI
21:30
15m
Talk
AFLNet: A Greybox Fuzzer for Network Protocols
Testing Tools Track
Van-Thuan Pham Monash University, Marcel Böhme Monash University, Australia, Abhik Roychoudhury National University of Singapore, Singapore
Link to publication DOI
21:45
15m
Talk
ct-fuzz: Fuzzing for Timing Leaks
Testing Tools Track
Shaobo He University of Utah, Michael Emmi Amazon Web Services, Gabriela Ciocarlie SRI International
Link to publication DOI

Wed 28 Oct

Displayed time zone: Lisbon change

09:00 - 10:30
Session IToCaMS at Miragaia
09:00
15m
Talk
Welcome Session
ToCaMS

09:15
45m
Keynote
Keynote: Product Line Testing with pure::variants and Beyond
ToCaMS
Danilo Beuche Leipzig University
10:00
30m
Social Event
World Cafe
ToCaMS

09:00 - 11:10
09:00
10m
Day opening
Welcom
INTUITESTBEDS

09:10
30m
Full-paper
Translation from Visual to Layout-based Android Test Cases: a Proof of Concept
INTUITESTBEDS
Riccardo Coppola Politecnico di Torino, Luca Ardito Politecnico di Torino, Marco Torchiano Politecnico di Torino, Emil Alégroth Blekinge Institute of Technology
Link to publication DOI
09:40
30m
Full-paper
An Automated Testing Framework For Smart TV apps Based on Model Separation
INTUITESTBEDS
Bestoun S. Ahmed Karlstad University, Angelo Gargantini University of Bergamo, Miroslav Bures Czech Technical University in Prague
Link to publication DOI
10:10
30m
Full-paper
Supporting efficient test automation using lightweight MBT
INTUITESTBEDS
Elodie Bernard FEMTO-ST Institute, Univ. Bourgogne Franche-Comté, Sogeti, Fabrice Ambert FEMTO-ST Institute, Bruno Legeard FEMTO-ST / DISC
Link to publication DOI
10:40
30m
Full-paper
Model-Based Testing of GUI Applications Featuring Dynamic Instanciation of Widgets
INTUITESTBEDS
Alexandre Canny ICS-IRIT, Université Toulouse III Paul Sabatier, Philippe Palanque ICS-IRIT, Université Toulouse III Paul Sabatier, David Navarre ICS-IRIT, Université Toulouse III Paul Sabatier
Link to publication DOI
10:00 - 10:05
10:00
5m
Day opening
Welcome
InSTA

10:05 - 11:05
10:05
20m
Full-paper
Techniques to Reach Common Ground about Test Aspect within a Test Team
InSTA
Tomohiro Odan Mamezou Co.,Ltd. Shinjuku-ku, Tokyo, Shizuka Ban NPO ASTER Minato-ku, Tokyo, Hiroki Iseri NPO ASTER Minato-ku, Tokyo, Kumiko Iseri NPO ASTER Minato-ku, Tokyo, Akiharu Satoh NPO ASTER Minato-ku, Tokyo
Link to publication DOI
10:25
20m
Full-paper
An Integrated Metamodel of Test Scenario to Conform Automotive Standards
InSTA
Hidetoshi Suhara Veriserve Corporation, Yasuharu Nishi University of Electro-Communications, Tokyo
Link to publication DOI
10:45
20m
Full-paper
Complex Software Testing Analysis using International Standards
InSTA
Satoshi Masuda , Yasuharu Nishi University of Electro-Communications, Tokyo, Kazuhiro Suzuki Hitachi, Ltd. Kanagawa
Link to publication DOI
11:00 - 12:30
Session IIToCaMS at Miragaia
11:00
30m
Full-paper
Towards a Deep Learning Model for Vulnerability Detection on Web Application Variants
ToCaMS
Ana Fidalgo LASIGE, Faculdade de Ciências da Universidade de Lisboa, Ibéria Medeiros LaSIGE, Faculdade de Ciências da Universidade de Lisboa, Paulo Antunes LASIGE, Faculdade de Ciências da Universidade de Lisboa, Nuno Neves DI FC UL
Link to publication DOI
11:30
30m
Full-paper
Test Design with the Classification Tree Method in Presence of Variants
ToCaMS
Vladimir Schmidt Expleo Germany GmbH, Berlin, Peter M. Kruse Expleo Group
Link to publication DOI
12:00
30m
Full-paper
Regression Test Suite Reduction for Cloud Systems
ToCaMS
Oussama Jebbar Gina Cody School of Engineering and Computer Science, Concordia University, Montreal, Mohamed Aymen Saied Concordia University, Ferhat Khendek  Concordia University, Maria Toeroe Ericsson Inc, Montreal
Link to publication DOI
11:20 - 12:20
11:20
20m
Full-paper
Automated security testing of Android applications for secure mobile development
InSTA
Francisco Palma ISTAR - Information Sciences and Technologies and Architecture Research Center, Nuno Realista ISTAR - Information Sciences and Technologies and Architecture Research Center, Carlos Serrão ISTAR - Information Sciences and Technologies and Architecture Research Center, Luís Nunes ISTAR - Information Sciences and Technologies and Architecture Research Center, João Oliveira ISTAR - Information Sciences and Technologies and Architecture Research Center, Ana Almeida ISTAR - Information Sciences and Technologies and Architecture Research Center
Link to publication DOI
11:40
20m
Full-paper
Selenium based Testing Systems for Analytical Data Generation of Website User Behavior
InSTA
Takamasa Tanaka Recruit Sumai Company Ltd, Tokyo, Hidekazu Niibori Recruit Sumai Company Ltd, Tokyo, Li Shiyingxue Recruit Sumai Company Ltd, Tokyo, Shimpei Nomura Recruit Sumai Company Ltd, Tokyo, Tadayoshi Nakao Nomura Research Institute, Ltd. Tokyo, Kazuhiko Tsuda University of Tsukuba Tokyo
Link to publication DOI
12:00
20m
Full-paper
Identifying Software Test Architect Skills and Knowledge
InSTA
Jon D. Hagar Grand Software Testing, LLC, Hot Sulphur Springs, CO, Laura Hagar Grand Software Testing, LLC, Hot Sulphur Springs, CO
Link to publication DOI
12:00 - 13:00
12:00
60m
Talk
Testing software: Challenges and hardships of non-traditional testers
INTUITESTBEDS
Sandeep Kuttal The University of Tulsa
12:20 - 12:30
12:20
10m
Day closing
Wrap up
InSTA

13:00 - 13:50
Session ITestEd at Arrábida
13:00
5m
Day opening
Welcome
TestEd
Birgitta Lindström , Jeff Offutt George Mason University
13:05
15m
Talk
Teaching a Testing Concept (JUnit) with Active Learning
TestEd
Kesina Baral George Mason University, Paul Ammann George Mason University, USA
Link to publication DOI
13:20
15m
Talk
Teaching Software Testing with Free and Open Source Software
TestEd
Lin Deng Towson University, Josh Dehlinger Towson University, Suranjan Chakraborty Towson University
Link to publication DOI
13:35
15m
Talk
Teaching Software Testing in an Algorithms and Data Structures Course
TestEd
Andrea Arcuri Kristiania University College, Norway
Link to publication DOI
13:00 - 14:30
Tool Demos SessionINTUITESTBEDS at São João
13:00
30m
Demonstration
Augmented Testing using Scout
INTUITESTBEDS
Michel Nass Blekinge Institute of Technology, Emil Alégroth Blekinge Institute of Technology, Robert Feldt Chalmers University of Technology
13:30
30m
Demonstration
Sequence Mining for Automatic Generation of Software Tests from GUI event traces
INTUITESTBEDS
Alberto Oliveira , Alípio Jorge Department of Computer Science, University of Porto, Ricardo Freitas , Nuno Moniz Department of Computer Science, University of Porto, Ana Paiva Faculty of Engineering of the University of Porto, Vítor Amorim , Paulo J. Azevedo
14:00
30m
Demonstration
A Tool for Testing Event-Driven Programs in Processing
INTUITESTBEDS
Hiroshi Hosobe Hosei University
14:00 - 14:45
Session IITestEd at Arrábida
14:00
15m
Talk
How to Teach Software Testing? Experiences with a Sandwich Approach
TestEd
Leen Lambers Hasso-Plattner-Institut, Universität Potsdam
Link to publication DOI
14:15
15m
Talk
A Case-based Approach for introducing Testing Tools and Principles
TestEd
Frédéric Dadeau Univ. Bourgogne Franche-Comté FEMTO-ST Institute/DISC, CNRS, Besançon, Jean-Philippe Gros , Fabien Peureux Institut FEMTO-ST (UMR CNRS 6174) and Smartesting S&S
Link to publication DOI
14:30
15m
Talk
Can Learning Formal Specification Be Fun? - Experience and Perspective
TestEd
Wishnu Prasetya Utrecht University, Craig Leek Utrecht University, Roan Oosenbrug Utrecht University, Petar Kostic Utrecht University, Mike de Vries Utrecht University
Link to publication DOI
15:00 - 15:45
Session IIITestEd at Arrábida
15:00
15m
Talk
Integrating Testing Throughout the CS Curriculum
TestEd
Sarah Heckman NC State University, Jessica Young Schmidt North Carolina State University, Jason King North Carolina State University
Link to publication DOI
15:15
15m
Talk
A Preliminary Report on Hands-On and Cross-Course Activities in a College Software Testing Course
TestEd
Upsorn Praphamontripong Computer Science, University of Virginia, Charlottesville, Mark Floryan Computer Science, University of Virginia, Charlottesville, Ryan Ritzo Computer Science, University of Virginia, Charlottesville
Link to publication DOI
15:30
15m
Talk
Incorporating Testing Topics in an Object-Oriented Programming Course
TestEd
Link to publication DOI