Program - ICST 2020

Time Zone

The program is currently displayed in (GMT+01:00) Greenwich Mean Time : Lisbon.

Use conference time zone: (GMT+01:00) Greenwich Mean Time : LisbonSelect other time zone

The GMT offsets shown reflect the offsets at the moment of the conference.

Time Band

By setting a time band, the program will dim events that are outside this time window. This is useful for (virtual) conferences with a continuous program (with repeated sessions).
The time band will also limit the events that are included in the personal iCalendar subscription service.

Display full programSpecify a time band

Save

You're viewing the program in a time zone which is different from your device's time zone - change time zone

Sat 24 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

	09:00 - 10:30: Welcome + Session: Process ImprovementNEXTA at D. Luis Chair(s): Pasqualina PotenaRISE Research Institutes of Sweden AB

	09:00 - 09:15 Day opening		Welcome address and practical arrangements NEXTA
	09:15 - 09:45 Full-paper		Test Automation Process Improvement in a DevOps Team: Experience report NEXTA Yuqing WangUniversity of Oulu, Maaret PyhäjärviF-Secure, Mika MäntyläUniversity of Oulu Link to publication DOI
	09:45 - 10:05 Short-paper		Test Automation Challenges for Application Landscape Frameworks NEXTA Nils WildResearch Group Software Construction RWTH Aachen University, Horst LichterRWTH Aachen University, Peter KehrenResearch Group Software Construction RWTH Aachen University Link to publication DOI
	10:05 - 10:25 Full-paper		Test Automation Improvement Model - TAIM 2.0 NEXTA Sigrid EldhEricsson Link to publication DOI

	09:00 - 10:30: Session IA-MOST at Porto Chair(s): Bernhard AichernigGraz University of Technology A-MOST2020 is held as a virtual workshop via Zoom. Contact [email protected] for the details.

	09:00 - 09:10 Day opening		Opening A-MOST
	09:10 - 10:30 Talk		Keynote: Why models? A-MOST I: Ana PaivaFaculty of Engineering of the University of Porto

	09:15 - 10:30: Session IITEQS at São João Chair(s): Mehrdad SaadatmandRISE Research Institutes of Sweden ITEQS 2020 is held as a virtual workshop via Zoom. Contact [email protected] for the details.

	09:15 - 09:30 Day opening		Welcome and opening message ITEQS
	09:30 - 10:00 Full-paper		Automatic exploratory performance testing using a discriminator neural network ITEQS Ivan PorresÅbo Akademi University, Tanwir AhmadÅbo Akademi University, Hergys RexhaÅbo Akademi University, Sebastien LafondÅbo Akademi University, Dragos TruscanÅbo Akademi University Link to publication DOI
	10:00 - 10:30 Full-paper		Performance Evaluation of Container's Shared Volumes ITEQS Naylor GarciaUniversity of São Paulo - USP, Paulo Sergio Lopes de SouzaUniversity of São Paulo - USP, Sarita M. BruschiUniversity of São Paulo - USP, Simone do Rocio Senger de SouzaUniversity of São Paulo - USP Link to publication DOI

	11:00 - 12:30: Session: OptimisationNEXTA at D. Luis Chair(s): Adnan CausevicMälardalen University

	11:00 - 11:30 Full-paper		Optimization of automated executions based on integration test configurations of embedded software NEXTA Masashi MizoguchiHitachi Ltd., Takahiro IidaHitachi Automotive Systems Ltd., Toru IrieHitachi Automotive Systems Ltd. Link to publication DOI
	11:30 - 12:00 Full-paper		Selective Regression Testing based on Big Data: Comparing Feature Extraction Techniques NEXTA Khaled Al-SabbaghUniversity of Gothenburg, Miroslaw StaronUniversity of Gothenburg, Regina HebigChalmers \| Gothenburg University, Miroslaw OchodekPoznan University of Technology, Wilhelm MedingEricsson Link to publication DOI
	12:00 - 12:20 Full-paper		Runtime Prioritization with the Classification Tree Method for Test Automation NEXTA Barbara JungExpleo Germany, Peter M. KruseExpleo Group Link to publication DOI

	11:00 - 12:30: Session IIA-MOST at Porto Chair(s): Angelo GargantiniUniversity of Bergamo A-MOST2020 is held as a virtual workshop via Zoom. Contact [email protected] for the details.

	11:00 - 11:30 Full-paper		A Tool for the Automatic Generation of Test Cases and Oracles for Simulation Models Based on Functional Requirements A-MOST Aitor ArrietaMondragon Goi Eskola Politeknikoa, Joseba Andoni AgirreUniversidad Mondragon , Goiuria SagarduiUniversity of Mondragon Link to publication DOI
	11:30 - 12:00 Full-paper		A Model-Based Security Testing Approach for Automotive Over-The-Air Updates A-MOST Shahid MahmoodCoventry University , Alexy FouilladeEcole superieure d’electronique de l’Ouest, Hoang Nga NguyenCoventry University , Siraj Ahmed ShaikhCoventry University, Coventry, UK Link to publication DOI
	12:00 - 12:30 Full-paper		Ontology-based Testing: An Emerging Paradigm for Modeling and Testing Systems and Software A-MOST Franz WotawaTechnische Universitaet Graz, Josip BozicGraz University of Technology (Alumnus), Yihao LiInstitute of Technology, Graz University of Technology Link to publication DOI

	11:00 - 12:30: Session IIITEQS at São João Chair(s): Eduard Paul EnoiuMälardalen University ITEQS 2020 is held as a virtual workshop via Zoom. Contact [email protected] for the details.

	11:00 - 11:30 Full-paper		Prioritizing Scenarios based on STAMP/STPA Using Statistical Model Checking ITEQS Mitsuaki TsujiNara Institute of Science and Technology, Toshinori TakaiNara Institute of Science and Technology, Kazuki KakimotoNara Institute of Science and Technology, Naoki IshihamaJapan Aerospace Exploration Agency, Masafumi KatahiraJapan Aerospace Exploration Agency, Hajimu IidaNara Institute of Science and Technology Link to publication DOI
	11:30 - 12:00 Full-paper		Generating Tests for the Discovery of Security Flaws in Product Variants ITEQS Francisco AraújoLASIGE, Faculdade de Ciências da Universidade de Lisboa, Ibéria MedeirosLaSIGE, Faculdade de Ciências da Universidade de Lisboa, Nuno NevesDI FC UL Link to publication DOI
	12:00 - 12:30 Full-paper		Test Data Generation for False Data Injection Attack Testing in Air Traffic Surveillance Best Paper ITEQS Aymeric CretinFemto-ST Institute, Alexandre VernotteFemto-ST Institute, Antoine ChevrotFemto-ST Institute, Fabien PeureuxInstitut FEMTO-ST (UMR CNRS 6174) and Smartesting S&S, Bruno LegeardFEMTO-ST / DISC Link to publication DOI

	12:40 - 15:00: Session IMutation at Arrábida

	12:40 - 13:05 Day opening		Warm Up Mutation
	13:05 - 13:15 Day opening		Welcome Mutation
	13:15 - 14:30 Talk		Keynote Mutation Mike PapadakisUniversity of Luxembourg, Luxembourg
	14:30 - 14:45 Full-paper		On the impact of timeouts and JVM crashes in Pitest Mutation Thomas LaurentLero & University College Dublin, Fionnuala WallLero and University College Dublin, Anthony VentresqueLero and University College Dublin Link to publication DOI
	14:45 - 15:00 Full-paper		Using mutation testing to measure behavioural test diversity Mutation Francisco GomesChalmers \| University of Gothenburg, Felix DobslawChalmers University of Technology, Robert FeldtChalmers University of Technology Link to publication DOI

	13:00 - 14:00: Opening SessionIWCT at Farfetch (D. Maria)

	13:00 - 13:15 Day opening		Welcome to IWCT IWCT Dimitris SimosSBA Research, Jeff LeiUniversity of Texas at Arlington, Changhai Nie
	13:15 - 14:00 Talk		Keynote: Verifying autonomous systems using ontology-based testing IWCT Franz WotawaTechnische Universitaet Graz

	13:00 - 14:20: Session ITAIC PART at Miragaia

	13:00 - 13:10 Day opening		Opening TAIC PART
	13:26 - 13:53 Talk		Coding Effective Testing Tools Within Minutes – Live! TAIC PART Andreas ZellerCISPA, Germany
	14:10 - 14:20 Live Q&A		Q&A: Coding Effective Testing Tools Within Minutes – Live! TAIC PART

	14:00 - 15:30: Session: Test GenerationNEXTA at D. Luis Chair(s): Serge DemeyerUniversity of Antwerp, Belgium

	14:00 - 14:30 Full-paper		Optimizing the Parameters of an Evolutionary Algorithm for Fuzzing and Test Data Generation NEXTA Ralf GerlichDr. Rainer Gerlich System and Software Engineering, Christian R. PrauseGerman Aerospace Center - Space Administration Link to publication DOI
	14:30 - 15:00 Full-paper		Boundary Value Exploration for Software Analysis NEXTA Felix DobslawChalmers University of Technology, Francisco GomesChalmers \| University of Gothenburg, Robert FeldtChalmers University of Technology Link to publication DOI
	15:00 - 15:20 Short-paper		Test Data Generation for MC/DC Criterion using Reinforcement Learning NEXTA Ján ČegiňFaculty of Informatics and Information Technologies Slovak Technical University, Karol RástočnýFaculty of Informatics and Information Technologies, Slovak University of Technology in Bratislava Link to publication DOI

	14:00 - 15:30: Session IIIA-MOST at Porto Chair(s): Raluca LefticaruUniversity of Bradford A-MOST2020 is held as a virtual workshop via Zoom. Contact [email protected] for the details.

	14:00 - 14:30 Full-paper		Using tabular notation to support Model Based Testing A-MOST Rachid KherraziAkka Technologies Link to publication DOI
	14:30 - 15:00 Full-paper		Model-Based Testing for MAPE-K adaptation control loops A-MOST Paolo ArcainiNational Institute of Informatics , Raffaela MirandolaPolitecnico di Milano , Elvinia RiccobeneComputer Science Dept., University of Milan, Patrizia ScandurraUniversity of Bergamo, Italy Link to publication DOI
	15:00 - 15:30 Full-paper		Conformance Testing in UPPAAL: A diabolic approach A-MOST Florian LorberAalborg University, Emil Jørgensen NjorAalborg University, Nikolaj Isgård SchmidtAalborg University, Sebastian Reidar PetersenAalborg University Link to publication DOI

	14:00 - 15:30: Session IIIITEQS at São João Chair(s): Dragos TruscanÅbo Akademi University ITEQS 2020 is held as a virtual workshop via Zoom. Contact [email protected] for the details.

	14:00 - 15:00 Talk		Security Testing using Artificial Intelligence Methods and Techniques ITEQS Franz WotawaTechnische Universitaet Graz
	15:00 - 15:30 Full-paper		Keywords-based test categorization for Extra-Functional Properties ITEQS Muhammad AbbasRISE Research Institutes of Sweden, Abdul RaufRISE Research Institutes of Sweden, Mehrdad SaadatmandRISE Research Institutes of Sweden, Eduard Paul EnoiuMälardalen University, Daniel SundmarkMälardalen University Link to publication DOI
	15:30 - 15:40 Day closing		Best Paper Award & Closing ITEQS

	14:15 - 14:20: Poster Presentation SessionIWCT at Farfetch (D. Maria)

	14:15 - 14:20 Talk		Toward an Encoding Approach to Interaction-based Test Suite Minimization IWCT Kohei NishinoWaseda University, Takashi KitamuraNational Institute of Advanced Industrial Science and Technology (AIST), Tomoji KishiWaseda University, Cyrille ArthoKTH Royal Institute of Technology Link to publication DOI

	14:20 - 15:10: Test Generation and Combinatorial Testing Applications SessionIWCT at Farfetch (D. Maria)

	14:20 - 14:40 Full-paper		An Automata-Based Generation Method for Combinatorial Sequence Testing of Finite State Machines IWCT Andrea BombardaUniversity of Bergamo, Angelo GargantiniUniversity of Bergamo Link to publication DOI
	14:40 - 14:50 Short-paper		Combinatorial Methods for Explainable AI IWCT Rick KuhnNatl Institute of Standards & Technology, Raghu KackerNational Institute of Standards and Technology, Jeff LeiUniversity of Texas at Arlington, Dimitris SimosSBA Research Link to publication DOI
	14:50 - 15:10 Full-paper		Generation of Invalid Test Inputs from Over-Constrained Test Models for Combinatorial Robustness Testing IWCT Konrad FögenRWTH Aachen University, Horst LichterRWTH Aachen University Link to publication DOI

	14:20 - 15:55: Session IITAIC PART at Miragaia

	14:20 - 14:35 Talk		On Using k-means Clustering for Test Suite Reduction TAIC PART Nour Chetouane, Franz WotawaTechnische Universitaet Graz, Hermann Felbinger, Mihai Nica Link to publication DOI
	14:35 - 14:50 Talk		Prioritization of Test Cases with Varying Test Costs and Fault Severities for Certification Testing TAIC PART Sahin Dirim, Hasan Sozer Link to publication DOI
	14:50 - 15:05 Talk		Test Tools: an illusion of usability? TAIC PART Isabel Evans, Chris Porter, Mark MicallefUniversity of Malta, Julian HartyCommercetest Ltd Link to publication DOI
	15:05 - 15:20 Talk		Towards a unified catalog of attributes to guide industry in software testing technique selection TAIC PART Italo SantosUniversity of São Paulo, Silvana Morita Melo, Paulo Sergio Lopes de SouzaUniversity of São Paulo - USP, Simone do Rocio Senger de SouzaUniversity of São Paulo - USP Link to publication DOI
	15:20 - 15:35 Talk		Data Dynamics for Testing Systems Fast Abstract: Data Dynamics for Testing Systems TAIC PART Julian HartyCommercetest Ltd Link to publication DOI
	15:35 - 15:55 Live Q&A		Q&A TAIC PART

	15:00 - 17:00: Session ICCIW at Infante

	15:00 - 15:30 Day opening		Welcome to CCIW CCIW
	15:30 - 16:00 Talk		Interoperability Challenges in CI/CD Ecosystem CCIW Fatih DegirmenciEricsson Software Technology
	16:00 - 16:30 Talk		Test flakiness reduction of retry reduction? Why not have both? CCIW Stanislaw SwiercFacebook
	16:30 - 17:00 Talk		Continuous Data Analysis for CI CCIW Thomas BachHeidelberg University

	15:15 - 16:30: Session IIMutation at Arrábida

	15:15 - 15:30 Full-paper		SiMut: Exploring Program Similarity to Support the Cost Reduction of Mutation Testing Mutation Alessandro V. PizzoletoFederal University of Sao Carlos, Fabiano FerrariFederal University of São Carlos, Lucas D. DalliloUniversity of Sao Paulo, Jeff OffuttGeorge Mason University Link to publication DOI
	15:30 - 15:45 Full-paper		Predicting Survived and Killed Mutants Mutation Alejandra Duque TorresInstitute of Computer Science, University of Tartu, Natia DoliashviliInstitute of Computer Science, University of Tartu, Dietmar PfahlUniversity of Tartu, Rudolf RamlerSoftware Competence Center Hagenberg Link to publication DOI
	15:45 - 16:00 Full-paper		Fault Types of Adaptive and Context-Aware Systems and Their Relationship with Fault-based Testing Approaches Mutation Bento Rafael SiqueiraFederal University of São Carlos, Fabiano FerrariFederal University of São Carlos, Kathiani E. SouzaFederal University of São Carlos, Daniel S. M. SantibáñezFederal University of São Carlos, Valter Vieira CamargoFederal University of Sergipe, São Cristovão Link to publication DOI
	16:00 - 16:15 Full-paper		MutantDistiller: Using Symbolic Execution for Automatic Detection of Equivalent Mutants and Generation of Mutant Killing Tests Mutation Michael Baer, Norbert Oster, Michael PhilippsenFriedrich-Alexander University Erlangen-Nürnberg (FAU) Link to publication DOI
	16:15 - 16:30 Full-paper		An Approach to Identifying Minimal and Equivalent Mutants Based on Source Code Structure Mutation Claudinei Brito JuniorUniversidade de São Paulo, Vinicius DurelliUniversidade Federal de São João del-Rei, Rafael S. DurelliFederal University of Lavras Lavras, Simone do Rocio Senger de SouzaUniversity of São Paulo - USP, Auri VincenziFederal University of São Carlos, Marcio Eduardo DelamaroUniversidade de São Paulo Link to publication DOI

	15:30 - 16:40: Combinatorial Testing Tools SessionIWCT at Farfetch (D. Maria)

	15:30 - 15:40 Short-paper		On Using Ontologies for Testing Compilers IWCT Yihao LiInstitute of Technology, Graz University of Technology, Franz WotawaTechnische Universitaet Graz Link to publication DOI
	15:40 - 16:00 Full-paper		A Comparison Infrastructure for Fault Characterization Algorithms IWCT Torben FriedrichsRWTH Aachen University, Konrad FögenRWTH Aachen University, Horst LichterRWTH Aachen University Link to publication DOI
	16:00 - 16:20 Full-paper		Avocado: Open-Source Flexible Constrained Interaction Testing for Practical Application IWCT Jan RichterCzech Technical University in Prague, Bestoun S. AhmedKarlstad University, Miroslav BuresCzech Technical University in Prague, Cleber R. Rosa JuniorRed Hat, Inc. Link to publication DOI
	16:20 - 16:40 Full-paper		CAGEN: A fast combinatorial test generation tool with support for constraints and higher-index arrays IWCT Michael WagnerSBA Research, Kristoffer KleineSBA Research, Dimitris SimosSBA Research, Rick KuhnNatl Institute of Standards & Technology, Raghu KackerNational Institute of Standards and Technology Link to publication DOI

	16:00 - 17:30: Session: User-Interface Testing + ClosingNEXTA at D. Luis Chair(s): Kristian WiklundEricsson AB

	16:00 - 16:30 Full-paper		On the Industrial Applicability of Augmented Testing: An Empirical Study NEXTA Michel NassBlekinge Institute of Technology, Emil AlégrothBlekinge Institute of Technology, Robert FeldtChalmers University of Technology Link to publication DOI
	16:30 - 16:50 Full-paper		Session-Based Recommender Systems for Action Selection in GUI Test Generation NEXTA Varun NayakReTest GmbH, Daniel KrausReTest GmbH Link to publication DOI
	16:50 - 17:30 Awards		Award Ceremony -- Best Question Award; Best Presentation Award; Most influential tweet award NEXTA

	16:00 - 17:30: Session IVA-MOST at Porto Chair(s): Florian LorberAalborg University A-MOST2020 is held as a virtual workshop via Zoom. Contact [email protected] for the details.

	16:00 - 16:30 Full-paper		Model-Based Testing of Read Only Graph Queries A-MOST Leen LambersHasso-Plattner-Institut, Universität Potsdam , Sven SchneiderHasso-Plattner-Institut, Universität Potsdam , Marcel WeisgutHasso-Plattner-Institut, Universität Potsdam Link to publication DOI
	16:30 - 17:00 Full-paper		Optimizing decision making in concolic execution using reinforcement learning A-MOST Ciprian PaduraruUniversity of Bucharest , Alin StefanescuUniversity of Bucharest , Miruna Gabriela PaduraruUniversity of Bucharest Link to publication DOI
	17:00 - 17:30 Day closing		Closing A-MOST

	16:45 - 17:30: Session IIIMutation at Arrábida

	16:45 - 17:15 Talk		Brainstorm on mutation for new systems: machine learning systems, smart contract, blockchain Mutation
	17:15 - 17:30 Day closing		Awarding and wrap up Mutation

	16:55 - 17:55: Wrap upIWCT at Farfetch (D. Maria)

	16:55 - 17:55 Day closing		Wrap up (feedback, planning) IWCT

	17:15 - 18:45: Session IICCIW at Infante

	17:15 - 17:45 Talk		Escalating CI/CD for Growing Companies: The Pipelines 2.0 Project CCIW Cristiano CunhaFarfetch
	17:45 - 18:15 Talk		Culprit Finder: Tinderbox Build Breakage Triaging Tool CCIW Shruti HonnungarVMware
	18:15 - 18:45 Talk		Athena: Keeping the build stable automatically CCIW Utsav ShahDropbox

	19:00 - 19:30: Recap DiscussionCCIW at Infante

	19:00 - 19:30 Talk		What are the biggest challenges in large scale CI/CD? CCIW

Sun 25 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

	09:00 - 09:15: Intro & WelcomeResearch Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room +11h Chair(s): João Pascoal FariaFaculty of Engineering, University of Porto and INESC TEC, Rui AbreuFaculty of Engineering, University of Porto, Portugal

	09:00 - 09:15 Day opening		Intro & Welcome Research Papers

	09:15 - 10:45: IT1 - Test Generation & RefactoringIndustry Track at Farfetch (D. Maria) +11h Chair(s): João Pascoal FariaFaculty of Engineering, University of Porto and INESC TEC

	09:15 - 09:45 Talk		Parallelization of Classical Numerical Optimization in Quantum Variational Algorithms Industry Track Marco PistoiaJPMorgan Chase & Co, Peng LiuGoogle, Chun-Fu Richard ChenIBM, Shaohan HuIBM, Stephen WoodIBM Link to publication DOI
	09:45 - 10:15 Talk		SPECMATE: Automated Creation of Test Cases from Acceptance Criteria Industry Track Jannik FischbachQualicen GmbH, Andreas VogelsangUniversity of Cologne, Dominik SpiesQualicen GmbH, Andreas WehrleQualicen GmbH, Maximilian JunkerQualicen GmbH, Dietmar FreudensteinAllianz Deutschland AG Link to publication DOI
	10:15 - 10:45 Talk		Tool Support for Refactoring Manual Tests Industry Track Elodie BernardFEMTO-ST Institute, Univ. Bourgogne Franche-Comté, Sogeti, Julien BotellaSmartesting, Fabrice AmbertFEMTO-ST Institute, Bruno LegeardFEMTO-ST / DISC, Mark UttingUniversity of the Sunshine Coast Link to publication DOI

	09:15 - 10:45: RT1 - Fault Localization and Debugging InfanteResearch Papers at Infante +11h Chair(s): Andreas ZellerCISPA, Germany

	09:15 - 09:45 Talk		Can We Predict the Quality of Spectrum-based Fault Localization? Research Papers Mojdeh GolaghaTechnical University of Munich, Alexander PretschnerTechnical University of Munich, Lionel BriandUniversity of Luxembourg, University of Ottawa Link to publication DOI
	09:45 - 10:15 Talk		Substate Profiling for Enhanced Fault Detection and Localization: An Empirical Study Research Papers Rawad Abou AssiAmerican University of Beirut, Wes MasriAmerican University of Beirut, Chadi TradAmerican University of Beirut Link to publication DOI
	10:15 - 10:45 Talk		More Accurate Dynamic Slicing for Better Supporting Software Debugging Research Papers Xiangyu LiGeorgia Institute of Technology, Alessandro OrsoGeorgia Tech Link to publication DOI

	11:00 - 12:30: RT3 - Testing Deep Learning and Robotic SystemsResearch Papers at Farfetch (D. Maria) +11h Chair(s): Antonio FilieriImperial College London

	11:00 - 11:30 Talk		An Empirical Evaluation of Mutation Operators for Deep Learning Systems Research Papers Gunel JahangirovaUSI Lugano, Switzerland, Paolo TonellaUniversità della Svizzera Italiana (USI) Link to publication DOI
	11:30 - 12:00 Talk		Comparing Offline and Online Testing of Deep Neural Networks: An Autonomous Car Case Study Research Papers Fitash Ul HaqUniversity of Luxembourg, Donghwan ShinUniversity of Luxembourg, Shiva NejatiUniversity of Luxembourg, Lionel BriandUniversity of Luxembourg, University of Ottawa Link to publication DOI
	12:00 - 12:30 Talk		A Study on Challenges of Testing Robotic Systems Research Papers Afsoon AfzalCarnegie Mellon University, Claire Le GouesCarnegie Mellon University, Michael HiltonCarnegie Mellon University, USA, Christopher Steven TimperleyCarnegie Mellon University Link to publication DOI

	11:00 - 12:30: RT2 - Test Generation InfanteResearch Papers at Infante +11h Chair(s): Marcelo d'AmorimFederal University of Pernambuco

	11:00 - 11:30 Talk		Language-Agnostic Generation of Compilable Test Programs Research Papers Patrick KreutzerFriedrich-Alexander University Erlangen-Nürnberg, Stefan KrausFriedrich-Alexander University Erlangen-Nürnberg, Michael PhilippsenFriedrich-Alexander University Erlangen-Nürnberg (FAU) Link to publication DOI
	11:30 - 12:00 Talk		MiMIs: Simple, Efficient, and Fast Bounded-Exhaustive Test Case Generators Research Papers Kyle DeweyCalifornia State University, Northridge, Shant HairapetianUniversity of Oregon, Miroslav GavrilovUniversity of California, Santa Barbara Link to publication DOI
	12:00 - 12:30 Talk		Learning How to Search: Generating Exception-Triggering Tests Through Adaptive Fitness Function Selection Research Papers Hussein AlmullaUniversity of South Carolina, Gregory GayChalmers and the University of Gothenburg Link to publication DOI

	14:00 - 16:00: RT5 - Testing for APIsResearch Papers / Testing Tools Track at Farfetch (D. Maria) +11h Chair(s): José Miguel RojasUniversity of Leicester, UK

	14:00 - 14:30 Talk		QuickREST: Property-based Test Generation of OpenAPI-Described RESTful APIs Research Papers Stefan KarlssonABB AB, Mälardalen University, Adnan CausevicMälardalen University, Daniel SundmarkMälardalen University Link to publication DOI
	14:30 - 15:00 Talk		RESTTESTGEN: Automated Black-Box Testing of RESTful APIs Research Papers Emanuele ViglianisiFBK, Michael DallagoUniversity of Trento, Mariano CeccatoUniversity of Verona Link to publication DOI
	15:00 - 15:30 Talk		Testability Transformations For Existing APIs Research Papers Andrea ArcuriKristiania University College, Norway, Juan Pablo GaleottiUniversity of Buenos Aires Link to publication DOI
	15:30 - 15:45 Talk		CDST: A Toolkit for Testing Cockpit Display Systems Testing Tools Track Hassan SartajQUEST - UAV Dependability Lab, Muhammad Zohaib IqbalNational University of Computer and Emerging Sciences, Muhammad Uzair KhanNational University of Computer and Emerging Sciences Link to publication DOI
	15:45 - 16:00 Talk		Open-source Defect Injection Benchmark Testbed for the Evaluation of Testing Testing Tools Track Miroslav BuresCzech Technical University in Prague, Pavel HeroutUniversity of West Bohemia, Pilsen, CZ, Bestoun S. AhmedKarlstad University Link to publication DOI

	14:00 - 15:00: RT4 - Misc 1Research Papers at Infante +11h Chair(s): Andrea StoccoUniversità della Svizzera italiana (USI)

	14:00 - 14:30 Talk		Determining Method-Call Sequences for Object Creation in C++ Research Papers Thomas BachHeidelberg University, Ralf PannemansSAP, Artur AndrzejakHeidelberg University Link to publication DOI
	14:30 - 15:00 Talk		NodeRacer: Event Race Detection for Node.js Applications Research Papers André T. EndoFederal University of Technology - Paraná (UTFPR), Anders MøllerAarhus University, Denmark Link to publication DOI

	15:00 - 16:00: TeasersPosters Track at Infante +11h Chair(s): Jacques KleinUniversity of Luxembourg, Luxembourg, David LoSingapore Management University

	15:00 - 15:12 Talk		Poster: Agent-based Testing of Extended Reality Systems Posters Track Rui PradaUniversidade de Lisboa, Wishnu PrasetyaUtrecht University, Fitsum KifetewFondazione Bruno Kessler, Frank DignumUmea University, Tanja E. J. VosUniversitat Politècnica de València, Jason LanderGameware, Jean-Yves DonnartThales AVS, Alexandre KazmierowskiThales SIX GTS, Joseph DavidsonGood AI, Pedro FernandesUniversidade de Lisboa Link to publication DOI
	15:12 - 15:24 Talk		Poster: Is Euclidean Distance the best Distance Measurement for Adaptive Random Testing? Posters Track Rubing HuangJiangsu University, Chenhui CuiJiangsu University, Weifeng SunJiangsu University, Dave ToweyUniversity of Nottingham Ningbo China Link to publication DOI
	15:24 - 15:36 Talk		Poster: Performance Testing Driven by Reinforcement Learning Posters Track Mahshid Helali MoghadamRISE Research Institutes of Sweden , Mehrdad SaadatmandRISE Research Institutes of Sweden, Markus BorgRISE Research Institutes of Sweden, Markus BohlinRISE Research Institutes of Sweden, Bjorn LisperMälardalen University Link to publication DOI
	15:36 - 15:48 Talk		Poster: SONAR Testing - Novel Testing Approach Based on Operation Recording and Visualization Posters Track Hiroyuki KirinukiNTT, Toshiyuki KurabayashiNTT, Haruto TannoNTT, Ippei KumagawaNTT Data Link to publication DOI
	15:48 - 16:00 Talk		Poster: Test Case Prioritization Using Error Propagation Probability Posters Track Jeonghyun JooKorea Air Force Academy, Seunghoon YooKorea Air Force Academy, Myunghwan ParkKorea Air Force Academy Link to publication DOI

	16:15 - 17:15: Keynote 1Research Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room Chair(s): João Pascoal FariaFaculty of Engineering, University of Porto and INESC TEC

	16:15 - 17:15 Keynote		One-click formal methods Research Papers Liana HadareanAmazon Link to publication

	20:00 - 20:15: Intro & WelcomeResearch Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room Chair(s): João Pascoal FariaFaculty of Engineering, University of Porto and INESC TEC, Rui AbreuFaculty of Engineering, University of Porto, Portugal

	20:00 - 20:15 Day opening		Intro & Welcome Research Papers

	20:15 - 21:45: IT1 - Test Generation & RefactoringIndustry Track at Farfetch (D. Maria) Chair(s): John MiccoVMware

	20:15 - 20:45 Talk		Parallelization of Classical Numerical Optimization in Quantum Variational Algorithms Industry Track Marco PistoiaJPMorgan Chase & Co, Peng LiuGoogle, Chun-Fu Richard ChenIBM, Shaohan HuIBM, Stephen WoodIBM Link to publication DOI
	20:45 - 21:15 Talk		SPECMATE: Automated Creation of Test Cases from Acceptance Criteria Industry Track Jannik FischbachQualicen GmbH, Andreas VogelsangUniversity of Cologne, Dominik SpiesQualicen GmbH, Andreas WehrleQualicen GmbH, Maximilian JunkerQualicen GmbH, Dietmar FreudensteinAllianz Deutschland AG Link to publication DOI
	21:15 - 21:45 Talk		Tool Support for Refactoring Manual Tests Industry Track Elodie BernardFEMTO-ST Institute, Univ. Bourgogne Franche-Comté, Sogeti, Julien BotellaSmartesting, Fabrice AmbertFEMTO-ST Institute, Bruno LegeardFEMTO-ST / DISC, Mark UttingUniversity of the Sunshine Coast Link to publication DOI

	20:15 - 21:45: RT1 - Fault Localization and Debugging InfanteResearch Papers at Infante Chair(s): Jose CamposUniversity of Lisbon, Portugal

	20:15 - 20:45 Talk		Can We Predict the Quality of Spectrum-based Fault Localization? Research Papers Mojdeh GolaghaTechnical University of Munich, Alexander PretschnerTechnical University of Munich, Lionel BriandUniversity of Luxembourg, University of Ottawa Link to publication DOI
	20:45 - 21:15 Talk		Substate Profiling for Enhanced Fault Detection and Localization: An Empirical Study Research Papers Rawad Abou AssiAmerican University of Beirut, Wes MasriAmerican University of Beirut, Chadi TradAmerican University of Beirut Link to publication DOI
	21:15 - 21:45 Talk		More Accurate Dynamic Slicing for Better Supporting Software Debugging Research Papers Xiangyu LiGeorgia Institute of Technology, Alessandro OrsoGeorgia Tech Link to publication DOI

	22:00 - 23:30: RT3 - Testing Deep Learning and Robotic SystemsResearch Papers at Farfetch (D. Maria) Chair(s): João Pascoal FariaFaculty of Engineering, University of Porto and INESC TEC

	22:00 - 22:30 Talk		An Empirical Evaluation of Mutation Operators for Deep Learning Systems Research Papers Gunel JahangirovaUSI Lugano, Switzerland, Paolo TonellaUniversità della Svizzera Italiana (USI) Link to publication DOI
	22:30 - 23:00 Talk		Comparing Offline and Online Testing of Deep Neural Networks: An Autonomous Car Case Study Research Papers Fitash Ul HaqUniversity of Luxembourg, Donghwan ShinUniversity of Luxembourg, Shiva NejatiUniversity of Luxembourg, Lionel BriandUniversity of Luxembourg, University of Ottawa Link to publication DOI
	23:00 - 23:30 Talk		A Study on Challenges of Testing Robotic Systems Research Papers Afsoon AfzalCarnegie Mellon University, Claire Le GouesCarnegie Mellon University, Michael HiltonCarnegie Mellon University, USA, Christopher Steven TimperleyCarnegie Mellon University Link to publication DOI

	22:00 - 23:30: RT2 - Test Generation InfanteResearch Papers at Infante Chair(s): Corina S. PasareanuCarnegie Mellon University Silicon Valley, NASA Ames Research Center

	22:00 - 22:30 Talk		Language-Agnostic Generation of Compilable Test Programs Research Papers Patrick KreutzerFriedrich-Alexander University Erlangen-Nürnberg, Stefan KrausFriedrich-Alexander University Erlangen-Nürnberg, Michael PhilippsenFriedrich-Alexander University Erlangen-Nürnberg (FAU) Link to publication DOI
	22:30 - 23:00 Talk		MiMIs: Simple, Efficient, and Fast Bounded-Exhaustive Test Case Generators Research Papers Kyle DeweyCalifornia State University, Northridge, Shant HairapetianUniversity of Oregon, Miroslav GavrilovUniversity of California, Santa Barbara Link to publication DOI
	23:00 - 23:30 Talk		Learning How to Search: Generating Exception-Triggering Tests Through Adaptive Fitness Function Selection Research Papers Hussein AlmullaUniversity of South Carolina, Gregory GayChalmers and the University of Gothenburg Link to publication DOI

Mon 26 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

	01:00 - 03:00: RT5 - Testing for APIsResearch Papers / Testing Tools Track at Farfetch (D. Maria) Chair(s): Marcelo d'AmorimFederal University of Pernambuco

	01:00 - 01:30 Talk		QuickREST: Property-based Test Generation of OpenAPI-Described RESTful APIs Research Papers Stefan KarlssonABB AB, Mälardalen University, Adnan CausevicMälardalen University, Daniel SundmarkMälardalen University Link to publication DOI
	01:30 - 02:00 Talk		RESTTESTGEN: Automated Black-Box Testing of RESTful APIs Research Papers Emanuele ViglianisiFBK, Michael DallagoUniversity of Trento, Mariano CeccatoUniversity of Verona Link to publication DOI
	02:00 - 02:30 Talk		Testability Transformations For Existing APIs Research Papers Andrea ArcuriKristiania University College, Norway, Juan Pablo GaleottiUniversity of Buenos Aires Link to publication DOI
	02:30 - 02:45 Talk		CDST: A Toolkit for Testing Cockpit Display Systems Testing Tools Track Hassan SartajQUEST - UAV Dependability Lab, Muhammad Zohaib IqbalNational University of Computer and Emerging Sciences, Muhammad Uzair KhanNational University of Computer and Emerging Sciences Link to publication DOI
	02:45 - 03:00 Talk		Open-source Defect Injection Benchmark Testbed for the Evaluation of Testing Testing Tools Track Miroslav BuresCzech Technical University in Prague, Pavel HeroutUniversity of West Bohemia, Pilsen, CZ, Bestoun S. AhmedKarlstad University Link to publication DOI

	01:00 - 02:00: RT4 - Misc 1Research Papers at Infante Chair(s): Corina S. PasareanuCarnegie Mellon University Silicon Valley, NASA Ames Research Center

	01:00 - 01:30 Talk		Determining Method-Call Sequences for Object Creation in C++ Research Papers Thomas BachHeidelberg University, Ralf PannemansSAP, Artur AndrzejakHeidelberg University Link to publication DOI
	01:30 - 02:00 Talk		NodeRacer: Event Race Detection for Node.js Applications Research Papers André T. EndoFederal University of Technology - Paraná (UTFPR), Anders MøllerAarhus University, Denmark Link to publication DOI

	02:00 - 03:00: TeasersPosters Track at Infante Chair(s): David LoSingapore Management University, Jacques KleinUniversity of Luxembourg, Luxembourg

	02:00 - 02:12 Talk		Poster: Agent-based Testing of Extended Reality Systems Posters Track Rui PradaUniversidade de Lisboa, Wishnu PrasetyaUtrecht University, Fitsum KifetewFondazione Bruno Kessler, Frank DignumUmea University, Tanja E. J. VosUniversitat Politècnica de València, Jason LanderGameware, Jean-Yves DonnartThales AVS, Alexandre KazmierowskiThales SIX GTS, Joseph DavidsonGood AI, Pedro FernandesUniversidade de Lisboa Link to publication DOI
	02:12 - 02:24 Talk		Poster: Is Euclidean Distance the best Distance Measurement for Adaptive Random Testing? Posters Track Rubing HuangJiangsu University, Chenhui CuiJiangsu University, Weifeng SunJiangsu University, Dave ToweyUniversity of Nottingham Ningbo China Link to publication DOI
	02:24 - 02:36 Talk		Poster: Performance Testing Driven by Reinforcement Learning Posters Track Mahshid Helali MoghadamRISE Research Institutes of Sweden , Mehrdad SaadatmandRISE Research Institutes of Sweden, Markus BorgRISE Research Institutes of Sweden, Markus BohlinRISE Research Institutes of Sweden, Bjorn LisperMälardalen University Link to publication DOI
	02:36 - 02:48 Talk		Poster: SONAR Testing - Novel Testing Approach Based on Operation Recording and Visualization Posters Track Hiroyuki KirinukiNTT, Toshiyuki KurabayashiNTT, Haruto TannoNTT, Ippei KumagawaNTT Data Link to publication DOI
	02:48 - 03:00 Talk		Poster: Test Case Prioritization Using Error Propagation Probability Posters Track Jeonghyun JooKorea Air Force Academy, Seunghoon YooKorea Air Force Academy, Myunghwan ParkKorea Air Force Academy Link to publication DOI

	09:00 - 09:30: Most Influential Paper AwardsResearch Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room +11h Chair(s): Luis CruzDeflt University of Technology

	09:00 - 09:15 Awards		Using Mutation to Automatically Suggest Fixes for Faulty Programs Research Papers W. Eric Wong, Vidroha Debroy Media Attached
	09:15 - 09:30 Awards		Searching for a needle in a haystack predicting security vulnerabilities for Windows Vista Research Papers Thomas ZimmermannMicrosoft Research, Nachiappan NagappanMicrosoft Research, USA, Laurie WilliamsNorth Carolina State University Media Attached

	09:30 - 10:30: Keynote 2Research Papers at Plenary Room Chair(s): Luis CruzDeflt University of Technology

	10:45 - 12:15: IT2 - MiscIndustry Track at Farfetch (D. Maria) +11h Chair(s): Luis CruzDeflt University of Technology

	10:45 - 11:15 Talk		EC.LANG - A Language for Specifying Response Time Analyses of Event Chains Industry Track Max FrieseChristian-Albrechts-Universität zu Kiel, Johannes TraubDaimler AG, Dirk NowotkaChristian-Albrechts-Universität zu Kiel Link to publication DOI
	11:15 - 11:45 Talk		Detecting Higher-Order Merge Conflicts in Large Software Projects Industry Track Thorsten WuenscheSAP SE, Artur AndrzejakHeidelberg University, Sascha SchwedesSAP SE Link to publication DOI
	11:45 - 12:15 Talk		Scaling Test Case Generation For Expressive Decision Tables Industry Track Supriya AgrawalTata Consultancy Services Ltd. (TCS), R VenkateshTata Consultancy Services Ltd. (TCS), Ulka ShrotriTata Consultancy Services Ltd. (TCS), Amey ZareTata Consultancy Services Ltd. (TCS), Sagar VermaTata Consultancy Services Ltd. (TCS) Link to publication DOI

	10:45 - 12:15: RT6 - Web TestingResearch Papers at Infante +11h Chair(s): Jose CamposUniversity of Lisbon, Portugal

	10:45 - 11:15 Talk		Fostering the Diversity of Exploratory Testing in Web Applications Research Papers Julien LeveauLaBRI, Xavier BlancLaBRI, Laurent RéveillèreLaBRI, Jean-Rémy FalleriBordeaux INP, Romain RouvoyUniv. Lille / Inria / IUF Link to publication DOI
	11:15 - 11:45 Talk		Dependency-Aware Web Test Generation Research Papers Matteo BiagiolaFondazione Bruno Kessler (FBK), Andrea StoccoUniversità della Svizzera italiana (USI), Filippo RiccaUniversità di Genova, Paolo TonellaUniversità della Svizzera Italiana (USI) Link to publication DOI
	11:45 - 12:15 Talk		Metamorphic Security Testing for Web Systems Research Papers Phu X. MaiUniversity of Luxembourg, Fabrizio PastoreUniversity of Luxembourg, Arda GoknilSnT, University of Luxembourg, Lionel BriandUniversity of Luxembourg, University of Ottawa Link to publication DOI

	10:45 - 12:15: Doctoral Symposium 1Doctoral Symposium at São João Chair(s): Ana PaivaFaculty of Engineering of the University of Porto, Shaukat AliSimula Research Laboratory

	10:45 - 11:15 Talk		Panel 1: From research to industry Doctoral Symposium Goiuria SagarduiUniversity of Mondragon
	11:15 - 11:45 Talk		How Can Software Testing be Improved by Analytics to Deliver Better Apps? Doctoral Symposium Julian HartyCommercetest Ltd Link to publication DOI
	11:45 - 12:15 Talk		Automated verification of compliance of non-functional requirements on mobile applications through metamorphic testing Doctoral Symposium Misael JúniorUniversity of Sao Paulo (USP) Link to publication DOI

	13:45 - 15:15: Journal First 1Journal-First Papers at Farfetch (D. Maria) +11h Chair(s): Mauricio AnicheDelft University of Technology, Netherlands

	13:45 - 14:15 Talk		Modeling Foundations for Executable Model-Based Testing of Self-Healing Cyber-Physical Systems Journal-First Papers Tao MaSimula Research Laboratory, Shaukat AliSimula Research Laboratory, Tao YueNanjing University of Aeronautics and Astronautics Link to publication DOI
	14:15 - 14:45 Talk		Empirical evaluation of mutation-based test case prioritization techniques Journal-First Papers Donghwan ShinUniversity of Luxembourg, Shin YooKorea Advanced Institute of Science and Technology, Mike PapadakisUniversity of Luxembourg, Luxembourg, Doo-Hwan BaeKorea Advanced Institute of Science and Technology Link to publication DOI
	14:45 - 15:15 Talk		Are Unit and Integration Test Definitions Still Valid for Modern Java Projects? An Empirical Study on Open-Source Projects Journal-First Papers Fabian TrautschUniversity of Göttingen, Steffen HerboldUniversity of Göttingen, Jens GrabowskiUniversity of Göttingen Link to publication DOI

	13:45 - 15:15: RT7 - Optimizing TestingResearch Papers at Infante +11h Chair(s): Fabiano FerrariFederal University of São Carlos

	13:45 - 14:15 Talk		Optimizing Mutation Testing by Discovering Dynamic Mutant Subsumption Relations Research Papers Marcio Augusto GuimarãesFederal University of Alagoas (UFAL), Leo FernandesFederal Institute of Alagoas (IFAL), Márcio RibeiroFederal University of Alagoas, Brazil, Marcelo d'AmorimFederal University of Pernambuco, Rohit GheyiFederal University of Campina Grande Link to publication DOI
	14:15 - 14:45 Talk		Massively Parallel, Highly Efficient, but What About the Test Suite Quality? Applying Mutation Testing to GPU Programs Research Papers Qianqian ZhuTU Delft, Andy ZaidmanDelft University of Technology Link to publication DOI Pre-print
	14:45 - 15:15 Talk		STICCER: Fast and Effective Database Test Suite Reduction Through Merging of Similar Test Cases Research Papers Abdullah AlsharifThe University of Sheffield, Gregory KapfhammerAllegheny College, USA, Phil McMinnUniversity of Sheffield Link to publication DOI

	13:45 - 15:15: Doctoral Symposium 2Doctoral Symposium at São João Chair(s): Ana PaivaFaculty of Engineering of the University of Porto, Shaukat AliSimula Research Laboratory

	13:45 - 14:15 Talk		Panel 2: How to get your paper rejected? Doctoral Symposium Jeff OffuttGeorge Mason University
	14:15 - 14:45 Talk		Well-informed Test Case Generation and Crash Reproduction Doctoral Symposium Pouria DerakhshanfarDelft University of Technology Link to publication DOI
	14:45 - 15:15 Talk		Anomaly Analyses to Guide Software Testing Activity Doctoral Symposium Allan MoriUniversity of São Paulo - USP Link to publication DOI

	15:30 - 17:00: RT9 - Empirical Analysis and Program RepairResearch Papers at Farfetch (D. Maria) +11h Chair(s): Corina S. PasareanuCarnegie Mellon University Silicon Valley, NASA Ames Research Center

	15:30 - 16:00 Talk		An Empirical Analysis of Blind Tests Research Papers Kesina BaralGeorge Mason University, Jeff OffuttGeorge Mason University Link to publication DOI
	16:00 - 16:30 Talk		A Family of Experiments to Assess the Impact of Page Object Pattern in Web Test Suite Development Research Papers Maurizio LeottaUniversità di Genova, Matteo BiagiolaFondazione Bruno Kessler (FBK), Filippo RiccaUniversità di Genova, Mariano CeccatoUniversity of Verona, Paolo TonellaUniversità della Svizzera Italiana (USI) Link to publication DOI
	16:30 - 17:00 Talk		Human-In-The-Loop Automatic Program Repair Research Papers Marcel BöhmeMonash University, Australia, Charaka GeethalMonash University, Van-Thuan PhamMonash University Link to publication DOI

	15:30 - 17:00: RT8 - Misc 2Research Papers / Journal-First Papers at Infante +11h Chair(s): Alin StefanescuUniversity of Bucharest

	15:30 - 16:00 Talk		Implementation-induced Inconsistency and Nondeterminism in Deterministic Clustering Algorithms Research Papers Xin YinNew Jersey Institute of Technology, Iulian NeamtiuNew Jersey Institute of Technology, USA, Saketan PatilNew Jersey Institute of Technology, Sean AndrewsNew Jersey Institute of Technology Link to publication DOI
	16:00 - 16:30 Talk		CBR: Controlled Burst Recording Research Papers Oscar CornejoUniversity of Milano Bicocca, Italy, Daniela BriolaUniversity of Milano Bicocca, Daniela MicucciUniversity of Milano Bicocca, Leonardo MarianiUniversity of Milano Bicocca Link to publication DOI
	16:30 - 17:00 Talk		Mahtab: Phase-wise acceleration of regression testing for C Journal-First Papers Shouvick MondalIIT Madras, India, Rupesh NasreIIT Madras, India Link to publication DOI Media Attached

	15:30 - 17:00: Doctoral Symposium 3Doctoral Symposium at São João Chair(s): Shaukat AliSimula Research Laboratory, Ana PaivaFaculty of Engineering of the University of Porto

	15:30 - 16:00 Talk		Panel 3: Why and How to Get a Ph.D.? Doctoral Symposium Lionel BriandUniversity of Luxembourg, University of Ottawa
	16:00 - 16:30 Talk		Toward Automated Assessment of User Experience in Extended Reality Doctoral Symposium Saba Gholizadeh AnsariUtrecht University Link to publication DOI
	16:30 - 17:00 Talk		Source-Codeless Testing for Android Apps Doctoral Symposium Camilo Escobar-VelásquezUniversidad de los Andes Link to publication DOI

	20:00 - 20:30: Most Influential Paper AwardsResearch Papers / Tool Demos Track / Journal-First Papers / Industry Track / Testing Tools Track at Plenary Room Chair(s): João Pascoal FariaFaculty of Engineering, University of Porto and INESC TEC, Rui AbreuFaculty of Engineering, University of Porto, Portugal

	20:00 - 20:15 Awards		Using Mutation to Automatically Suggest Fixes for Faulty Programs Research Papers W. Eric Wong, Vidroha Debroy Media Attached
	20:15 - 20:30 Awards		Searching for a needle in a haystack predicting security vulnerabilities for Windows Vista Research Papers Thomas ZimmermannMicrosoft Research, Nachiappan NagappanMicrosoft Research, USA, Laurie WilliamsNorth Carolina State University Media Attached

	21:45 - 23:15: IT2 - MiscIndustry Track at Farfetch (D. Maria) Chair(s): Rui AbreuFaculty of Engineering, University of Porto, Portugal

	21:45 - 22:15 Talk		EC.LANG - A Language for Specifying Response Time Analyses of Event Chains Industry Track Max FrieseChristian-Albrechts-Universität zu Kiel, Johannes TraubDaimler AG, Dirk NowotkaChristian-Albrechts-Universität zu Kiel Link to publication DOI
	22:15 - 22:45 Talk		Detecting Higher-Order Merge Conflicts in Large Software Projects Industry Track Thorsten WuenscheSAP SE, Artur AndrzejakHeidelberg University, Sascha SchwedesSAP SE Link to publication DOI
	22:45 - 23:15 Talk		Scaling Test Case Generation For Expressive Decision Tables Industry Track Supriya AgrawalTata Consultancy Services Ltd. (TCS), R VenkateshTata Consultancy Services Ltd. (TCS), Ulka ShrotriTata Consultancy Services Ltd. (TCS), Amey ZareTata Consultancy Services Ltd. (TCS), Sagar VermaTata Consultancy Services Ltd. (TCS) Link to publication DOI

	21:45 - 23:15: RT6 - Web TestingResearch Papers at Infante Chair(s): Fabiano FerrariFederal University of São Carlos

	21:45 - 22:15 Talk		Fostering the Diversity of Exploratory Testing in Web Applications Research Papers Julien LeveauLaBRI, Xavier BlancLaBRI, Laurent RéveillèreLaBRI, Jean-Rémy FalleriBordeaux INP, Romain RouvoyUniv. Lille / Inria / IUF Link to publication DOI
	22:15 - 22:45 Talk		Dependency-Aware Web Test Generation Research Papers Matteo BiagiolaFondazione Bruno Kessler (FBK), Andrea StoccoUniversità della Svizzera italiana (USI), Filippo RiccaUniversità di Genova, Paolo TonellaUniversità della Svizzera Italiana (USI) Link to publication DOI
	22:45 - 23:15 Talk		Metamorphic Security Testing for Web Systems Research Papers Phu X. MaiUniversity of Luxembourg, Fabrizio PastoreUniversity of Luxembourg, Arda GoknilSnT, University of Luxembourg, Lionel BriandUniversity of Luxembourg, University of Ottawa Link to publication DOI

Tue 27 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

	00:45 - 02:15: Journal First 1Journal-First Papers at Farfetch (D. Maria) Chair(s): Fabiano FerrariFederal University of São Carlos

	00:45 - 01:15 Talk		Modeling Foundations for Executable Model-Based Testing of Self-Healing Cyber-Physical Systems Journal-First Papers Tao MaSimula Research Laboratory, Shaukat AliSimula Research Laboratory, Tao YueNanjing University of Aeronautics and Astronautics Link to publication DOI
	01:15 - 01:45 Talk		Empirical evaluation of mutation-based test case prioritization techniques Journal-First Papers Donghwan ShinUniversity of Luxembourg, Shin YooKorea Advanced Institute of Science and Technology, Mike PapadakisUniversity of Luxembourg, Luxembourg, Doo-Hwan BaeKorea Advanced Institute of Science and Technology Link to publication DOI
	01:45 - 02:15 Talk		Are Unit and Integration Test Definitions Still Valid for Modern Java Projects? An Empirical Study on Open-Source Projects Journal-First Papers Fabian TrautschUniversity of Göttingen, Steffen HerboldUniversity of Göttingen, Jens GrabowskiUniversity of Göttingen Link to publication DOI

	00:45 - 02:15: RT7 - Optimizing TestingResearch Papers at Infante Chair(s): Corina S. PasareanuCarnegie Mellon University Silicon Valley, NASA Ames Research Center

	00:45 - 01:15 Talk		Optimizing Mutation Testing by Discovering Dynamic Mutant Subsumption Relations Research Papers Marcio Augusto GuimarãesFederal University of Alagoas (UFAL), Leo FernandesFederal Institute of Alagoas (IFAL), Márcio RibeiroFederal University of Alagoas, Brazil, Marcelo d'AmorimFederal University of Pernambuco, Rohit GheyiFederal University of Campina Grande Link to publication DOI
	01:15 - 01:45 Talk		Massively Parallel, Highly Efficient, but What About the Test Suite Quality? Applying Mutation Testing to GPU Programs Research Papers Qianqian ZhuTU Delft, Andy ZaidmanDelft University of Technology Link to publication DOI Pre-print
	01:45 - 02:15 Talk		STICCER: Fast and Effective Database Test Suite Reduction Through Merging of Similar Test Cases Research Papers Abdullah AlsharifThe University of Sheffield, Gregory KapfhammerAllegheny College, USA, Phil McMinnUniversity of Sheffield Link to publication DOI

	02:30 - 04:00: RT9 - Empirical Analysis and Program RepairResearch Papers at Farfetch (D. Maria) Chair(s): Corina S. PasareanuCarnegie Mellon University Silicon Valley, NASA Ames Research Center

	02:30 - 03:00 Talk		An Empirical Analysis of Blind Tests Research Papers Kesina BaralGeorge Mason University, Jeff OffuttGeorge Mason University Link to publication DOI
	03:00 - 03:30 Talk		A Family of Experiments to Assess the Impact of Page Object Pattern in Web Test Suite Development Research Papers Maurizio LeottaUniversità di Genova, Matteo BiagiolaFondazione Bruno Kessler (FBK), Filippo RiccaUniversità di Genova, Mariano CeccatoUniversity of Verona, Paolo TonellaUniversità della Svizzera Italiana (USI) Link to publication DOI
	03:30 - 04:00 Talk		Human-In-The-Loop Automatic Program Repair Research Papers Marcel BöhmeMonash University, Australia, Charaka GeethalMonash University, Van-Thuan PhamMonash University Link to publication DOI

	02:30 - 04:00: RT8 - Misc 2Research Papers / Journal-First Papers at Infante

	02:30 - 03:00 Talk		Implementation-induced Inconsistency and Nondeterminism in Deterministic Clustering Algorithms Research Papers Xin YinNew Jersey Institute of Technology, Iulian NeamtiuNew Jersey Institute of Technology, USA, Saketan PatilNew Jersey Institute of Technology, Sean AndrewsNew Jersey Institute of Technology Link to publication DOI
	03:00 - 03:30 Talk		CBR: Controlled Burst Recording Research Papers Oscar CornejoUniversity of Milano Bicocca, Italy, Daniela BriolaUniversity of Milano Bicocca, Daniela MicucciUniversity of Milano Bicocca, Leonardo MarianiUniversity of Milano Bicocca Link to publication DOI
	03:30 - 04:00 Talk		Mahtab: Phase-wise acceleration of regression testing for C Journal-First Papers Shouvick MondalIIT Madras, India, Rupesh NasreIIT Madras, India Link to publication DOI Media Attached

	09:00 - 10:00: Tool DemosTool Demos Track at Farfetch (D. Maria) +11h Chair(s): Tao YueNanjing University of Aeronautics and Astronautics

	09:00 - 09:12 Talk		Cerberus: an Automated Tool for Continuous Testing Tool Demos Track Antoine CraskeLa Redoute
	09:12 - 09:24 Talk		EvoMaster: Search-Based System Test Generation for RESTful APIs Tool Demos Track Andrea ArcuriKristiania University College, Norway, Juan Pablo GaleottiUniversity of Buenos Aires, Bogdan MarculescuKristiania University College, Norway, Man ZhangKristiania University College, Norway
	09:24 - 09:36 Talk		Quick and Precise Security Testing During Development with Intelligence-Directed DAST Tool Demos Track Takuya IwatsukaNTT, Haruto TannoNTT, Eric SharidanWhiteHat Security, Joseph FeimanWhiteHat Security
	09:36 - 09:48 Talk		Self guided test Automation - Adaptive and Self Healing automation of Cloud native applications Tool Demos Track Mahesh VenkataramanAccenture Solutions, Chinmaya JenaAccenture Solutions, Sunder NochilurAccenture Solutions, Prabir Ghoushal KumarAccenture Solutions
	09:48 - 10:00 Talk		User-Friendly Input Assistance with Web Crawling for Test Script Generation Tool Demos Track Yu YoshimuraNTT, Yu AdachiNTT, Hiroyuki KirinukiNTT, Toshiyuki KurabayashiNTT, Haruto TannoNTT

	09:00 - 10:00: RT10 - Misc 3Research Papers at Infante +11h Chair(s): Thomas DurieuxKTH Royal Institute of Technology, Sweden

	09:00 - 09:30 Talk		A Framework for In-Vivo Testing of Mobile Applications Research Papers Mariano CeccatoUniversity of Verona, Davide CorradiniFondazione Bruno Kessler, Luca Gazzola Università degli Studi di Milano-Bicocca, Fitsum KifetewFondazione Bruno Kessler, Leonardo MarianiUniversity of Milano Bicocca, Matteo OrruUniversity of Milano Bicocca, Paolo TonellaUniversità della Svizzera Italiana (USI) Link to publication DOI
	09:30 - 10:00 Talk		Prioritizing Runtime Verification Violations Research Papers Breno MirandaFederal University of Pernambuco, Igor LimaFederal University of Pernambuco, Owolabi LegunsenCornell University, Marcelo d'AmorimFederal University of Pernambuco Link to publication DOI

	10:00 - 11:00: IT3 - Safety & SecurityIndustry Track at Farfetch (D. Maria) +11h Chair(s): Rui AbreuFaculty of Engineering, University of Porto, Portugal

	10:00 - 10:30 Talk		Generating Avoidable Collision Scenarios for Testing Autonomous Driving Systems Industry Track Alessandro CalòTechnical University of Munich, Paolo ArcainiNational Institute of Informatics , Shaukat AliSimula Research Laboratory, Florian HauerTechnical University of Munich, Fuyuki IshikawaNational Institute of Informatics Link to publication DOI
	10:30 - 11:00 Talk		Checking Security Properties of Cloud Service REST APIs Industry Track Vaggelis AtlidakisColumbia University, Patrice GodefroidMicrosoft Research, USA, Marina PolishchukMicrosoft Research, USA Link to publication DOI

	10:00 - 11:00: Testing toolsTesting Tools Track at Infante +11h Chair(s): Andy ZaidmanDelft University of Technology, René JustUniversity of Washington, USA

	10:00 - 10:15 Talk		Callisto: Entropy-based Test Generation and Data Quality Assessment for Machine Learning Systems Testing Tools Track Sakshi Udeshi, Xingbin JiangSingapore University of Technology and Design, Sudipta ChattopadhyaySingapore University of Technology and Design Link to publication DOI
	10:15 - 10:30 Talk		Run Java Applications and Test Them In-Vivo Meantime Testing Tools Track Antonia BertolinoCNR-ISTI, Guglielmo De AngelisCNR-IASI, CNR-ISTI, Breno MirandaFederal University of Pernambuco, Paolo TonellaUniversità della Svizzera Italiana (USI) Link to publication DOI
	10:30 - 10:45 Talk		AFLNet: A Greybox Fuzzer for Network Protocols Testing Tools Track Van-Thuan PhamMonash University, Marcel BöhmeMonash University, Australia, Abhik RoychoudhuryNational University of Singapore, Singapore Link to publication DOI
	10:45 - 11:00 Talk		ct-fuzz: Fuzzing for Timing Leaks Testing Tools Track Shaobo HeUniversity of Utah, Michael EmmiAmazon Web Services, Gabriela CiocarlieSRI International Link to publication DOI

	11:15 - 12:15: Open Steering Commitee & ICST 2021 PresentationResearch Papers at Plenary Room Chair(s): Shin YooKorea Advanced Institute of Science and Technology

	11:15 - 12:15 Meeting		Open Steering Commitee & ICST 2021 Presentation Research Papers

	13:45 - 14:45: Keynote 3Research Papers at Plenary Room Chair(s): Rui AbreuFaculty of Engineering, University of Porto, Portugal

	13:45 - 14:45 Keynote		SunDew: Systematic Automated Security Testing Research Papers Franjo IvancicGoogle

	20:00 - 21:00: Tool DemosTool Demos Track at Farfetch (D. Maria) Chair(s): Tao YueNanjing University of Aeronautics and Astronautics

	20:00 - 20:12 Talk		Cerberus: an Automated Tool for Continuous Testing Tool Demos Track Antoine CraskeLa Redoute
	20:12 - 20:24 Talk		EvoMaster: Search-Based System Test Generation for RESTful APIs Tool Demos Track Andrea ArcuriKristiania University College, Norway, Juan Pablo GaleottiUniversity of Buenos Aires, Bogdan MarculescuKristiania University College, Norway, Man ZhangKristiania University College, Norway
	20:24 - 20:36 Talk		Quick and Precise Security Testing During Development with Intelligence-Directed DAST Tool Demos Track Takuya IwatsukaNTT, Haruto TannoNTT, Eric SharidanWhiteHat Security, Joseph FeimanWhiteHat Security
	20:36 - 20:48 Talk		Self guided test Automation - Adaptive and Self Healing automation of Cloud native applications Tool Demos Track Mahesh VenkataramanAccenture Solutions, Chinmaya JenaAccenture Solutions, Sunder NochilurAccenture Solutions, Prabir Ghoushal KumarAccenture Solutions
	20:48 - 21:00 Talk		User-Friendly Input Assistance with Web Crawling for Test Script Generation Tool Demos Track Yu YoshimuraNTT, Yu AdachiNTT, Hiroyuki KirinukiNTT, Toshiyuki KurabayashiNTT, Haruto TannoNTT

	20:00 - 21:00: RT10 - Misc 3Research Papers at Infante Chair(s): Luis CruzDeflt University of Technology

	20:00 - 20:30 Talk		A Framework for In-Vivo Testing of Mobile Applications Research Papers Mariano CeccatoUniversity of Verona, Davide CorradiniFondazione Bruno Kessler, Luca Gazzola Università degli Studi di Milano-Bicocca, Fitsum KifetewFondazione Bruno Kessler, Leonardo MarianiUniversity of Milano Bicocca, Matteo OrruUniversity of Milano Bicocca, Paolo TonellaUniversità della Svizzera Italiana (USI) Link to publication DOI
	20:30 - 21:00 Talk		Prioritizing Runtime Verification Violations Research Papers Breno MirandaFederal University of Pernambuco, Igor LimaFederal University of Pernambuco, Owolabi LegunsenCornell University, Marcelo d'AmorimFederal University of Pernambuco Link to publication DOI

	21:00 - 22:00: IT3 - Safety & SecurityIndustry Track at Farfetch (D. Maria) Chair(s): Rui AbreuFaculty of Engineering, University of Porto, Portugal

	21:00 - 21:30 Talk		Generating Avoidable Collision Scenarios for Testing Autonomous Driving Systems Industry Track Alessandro CalòTechnical University of Munich, Paolo ArcainiNational Institute of Informatics , Shaukat AliSimula Research Laboratory, Florian HauerTechnical University of Munich, Fuyuki IshikawaNational Institute of Informatics Link to publication DOI
	21:30 - 22:00 Talk		Checking Security Properties of Cloud Service REST APIs Industry Track Vaggelis AtlidakisColumbia University, Patrice GodefroidMicrosoft Research, USA, Marina PolishchukMicrosoft Research, USA Link to publication DOI

	21:00 - 22:00: Testing toolsTesting Tools Track at Infante Chair(s): René JustUniversity of Washington, USA, Andy ZaidmanDelft University of Technology

	21:00 - 21:15 Talk		Callisto: Entropy-based Test Generation and Data Quality Assessment for Machine Learning Systems Testing Tools Track Sakshi Udeshi, Xingbin JiangSingapore University of Technology and Design, Sudipta ChattopadhyaySingapore University of Technology and Design Link to publication DOI
	21:15 - 21:30 Talk		Run Java Applications and Test Them In-Vivo Meantime Testing Tools Track Antonia BertolinoCNR-ISTI, Guglielmo De AngelisCNR-IASI, CNR-ISTI, Breno MirandaFederal University of Pernambuco, Paolo TonellaUniversità della Svizzera Italiana (USI) Link to publication DOI
	21:30 - 21:45 Talk		AFLNet: A Greybox Fuzzer for Network Protocols Testing Tools Track Van-Thuan PhamMonash University, Marcel BöhmeMonash University, Australia, Abhik RoychoudhuryNational University of Singapore, Singapore Link to publication DOI
	21:45 - 22:00 Talk		ct-fuzz: Fuzzing for Timing Leaks Testing Tools Track Shaobo HeUniversity of Utah, Michael EmmiAmazon Web Services, Gabriela CiocarlieSRI International Link to publication DOI

Wed 28 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

	09:00 - 10:30: Session IToCaMS at Miragaia

	09:00 - 09:15 Talk		Welcome Session ToCaMS
	09:15 - 10:00 Keynote		Keynote: Product Line Testing with pure::variants and Beyond ToCaMS Danilo BeucheLeipzig University
	10:00 - 10:30 Social Event		World Cafe ToCaMS

	09:00 - 11:10: Session IINTUITESTBEDS at São João

	09:00 - 09:10 Day opening		Welcom INTUITESTBEDS
	09:10 - 09:40 Full-paper		Translation from Visual to Layout-based Android Test Cases: a Proof of Concept INTUITESTBEDS Riccardo CoppolaPolitecnico di Torino, Luca ArditoPolitecnico di Torino, Marco TorchianoPolitecnico di Torino, Emil AlégrothBlekinge Institute of Technology Link to publication DOI
	09:40 - 10:10 Full-paper		An Automated Testing Framework For Smart TV apps Based on Model Separation INTUITESTBEDS Bestoun S. AhmedKarlstad University, Angelo GargantiniUniversity of Bergamo, Miroslav BuresCzech Technical University in Prague Link to publication DOI
	10:10 - 10:40 Full-paper		Supporting efficient test automation using lightweight MBT INTUITESTBEDS Elodie BernardFEMTO-ST Institute, Univ. Bourgogne Franche-Comté, Sogeti, Fabrice AmbertFEMTO-ST Institute, Bruno LegeardFEMTO-ST / DISC Link to publication DOI
	10:40 - 11:10 Full-paper		Model-Based Testing of GUI Applications Featuring Dynamic Instanciation of Widgets INTUITESTBEDS Alexandre CannyICS-IRIT, Université Toulouse III Paul Sabatier, Philippe PalanqueICS-IRIT, Université Toulouse III Paul Sabatier, David NavarreICS-IRIT, Université Toulouse III Paul Sabatier Link to publication DOI

	10:00 - 10:05: Session IInSTA at Farfetch (D. Maria)

	10:00 - 10:05 Day opening		Welcome InSTA

	10:05 - 11:05: Session IIInSTA at Farfetch (D. Maria)

	10:05 - 10:25 Full-paper		Techniques to Reach Common Ground about Test Aspect within a Test Team InSTA Tomohiro OdanMamezou Co.,Ltd. Shinjuku-ku, Tokyo, Shizuka BanNPO ASTER Minato-ku, Tokyo, Hiroki IseriNPO ASTER Minato-ku, Tokyo, Kumiko IseriNPO ASTER Minato-ku, Tokyo, Akiharu SatohNPO ASTER Minato-ku, Tokyo Link to publication DOI
	10:25 - 10:45 Full-paper		An Integrated Metamodel of Test Scenario to Conform Automotive Standards InSTA Hidetoshi SuharaVeriserve Corporation, Yasuharu NishiUniversity of Electro-Communications, Tokyo Link to publication DOI
	10:45 - 11:05 Full-paper		Complex Software Testing Analysis using International Standards InSTA Satoshi Masuda, Yasuharu NishiUniversity of Electro-Communications, Tokyo, Kazuhiro SuzukiHitachi, Ltd. Kanagawa Link to publication DOI

	11:00 - 12:30: Session IIToCaMS at Miragaia

	11:00 - 11:30 Full-paper		Towards a Deep Learning Model for Vulnerability Detection on Web Application Variants ToCaMS Ana FidalgoLASIGE, Faculdade de Ciências da Universidade de Lisboa, Ibéria MedeirosLaSIGE, Faculdade de Ciências da Universidade de Lisboa, Paulo AntunesLASIGE, Faculdade de Ciências da Universidade de Lisboa, Nuno NevesDI FC UL Link to publication DOI
	11:30 - 12:00 Full-paper		Test Design with the Classification Tree Method in Presence of Variants ToCaMS Vladimir SchmidtExpleo Germany GmbH, Berlin, Peter M. KruseExpleo Group Link to publication DOI
	12:00 - 12:30 Full-paper		Regression Test Suite Reduction for Cloud Systems ToCaMS Oussama JebbarGina Cody School of Engineering and Computer Science, Concordia University, Montreal, Mohamed Aymen SaiedConcordia University, Ferhat Khendek Concordia University, Maria ToeroeEricsson Inc, Montreal Link to publication DOI

	11:20 - 12:20: Session IIIInSTA at Farfetch (D. Maria)

	11:20 - 11:40 Full-paper		Automated security testing of Android applications for secure mobile development InSTA Francisco PalmaISTAR - Information Sciences and Technologies and Architecture Research Center, Nuno RealistaISTAR - Information Sciences and Technologies and Architecture Research Center, Carlos SerrãoISTAR - Information Sciences and Technologies and Architecture Research Center, Luís NunesISTAR - Information Sciences and Technologies and Architecture Research Center, João OliveiraISTAR - Information Sciences and Technologies and Architecture Research Center, Ana AlmeidaISTAR - Information Sciences and Technologies and Architecture Research Center Link to publication DOI
	11:40 - 12:00 Full-paper		Selenium based Testing Systems for Analytical Data Generation of Website User Behavior InSTA Takamasa TanakaRecruit Sumai Company Ltd, Tokyo, Hidekazu NiiboriRecruit Sumai Company Ltd, Tokyo, Li ShiyingxueRecruit Sumai Company Ltd, Tokyo, Shimpei NomuraRecruit Sumai Company Ltd, Tokyo, Tadayoshi NakaoNomura Research Institute, Ltd. Tokyo, Kazuhiko TsudaUniversity of Tsukuba Tokyo Link to publication DOI
	12:00 - 12:20 Full-paper		Identifying Software Test Architect Skills and Knowledge InSTA Jon D. HagarGrand Software Testing, LLC, Hot Sulphur Springs, CO, Laura HagarGrand Software Testing, LLC, Hot Sulphur Springs, CO Link to publication DOI

	12:00 - 13:00: Session IIINTUITESTBEDS at São João

	12:00 - 13:00 Talk		Testing software: Challenges and hardships of non-traditional testers INTUITESTBEDS Sandeep KuttalThe University of Tulsa

	12:20 - 12:30: Session IVInSTA at Farfetch (D. Maria)

	12:20 - 12:30 Day closing		Wrap up InSTA

	13:00 - 13:50: Session ITestEd at Arrábida

	13:00 - 13:05 Day opening		Welcome TestEd Birgitta Lindström, Jeff OffuttGeorge Mason University
	13:05 - 13:20 Talk		Teaching a Testing Concept (JUnit) with Active Learning TestEd Kesina BaralGeorge Mason University, Paul AmmannGeorge Mason University, USA Link to publication DOI
	13:20 - 13:35 Talk		Teaching Software Testing with Free and Open Source Software TestEd Lin DengTowson University, Josh DehlingerTowson University, Suranjan ChakrabortyTowson University Link to publication DOI
	13:35 - 13:50 Talk		Teaching Software Testing in an Algorithms and Data Structures Course TestEd Andrea ArcuriKristiania University College, Norway Link to publication DOI

	13:00 - 14:30: Tool Demos SessionINTUITESTBEDS at São João

	13:00 - 13:30 Demonstration		Augmented Testing using Scout INTUITESTBEDS Michel NassBlekinge Institute of Technology, Emil AlégrothBlekinge Institute of Technology, Robert FeldtChalmers University of Technology
	13:30 - 14:00 Demonstration		Sequence Mining for Automatic Generation of Software Tests from GUI event traces INTUITESTBEDS Alberto Oliveira, Alípio JorgeDepartment of Computer Science, University of Porto, Ricardo Freitas, Nuno MonizDepartment of Computer Science, University of Porto, Ana PaivaFaculty of Engineering of the University of Porto, Vítor Amorim, Paulo J. Azevedo
	14:00 - 14:30 Demonstration		A Tool for Testing Event-Driven Programs in Processing INTUITESTBEDS Hiroshi HosobeHosei University

	14:00 - 14:45: Session IITestEd at Arrábida

	14:00 - 14:15 Talk		How to Teach Software Testing? Experiences with a Sandwich Approach TestEd Leen LambersHasso-Plattner-Institut, Universität Potsdam Link to publication DOI
	14:15 - 14:30 Talk		A Case-based Approach for introducing Testing Tools and Principles TestEd Frédéric DadeauUniv. Bourgogne Franche-Comté FEMTO-ST Institute/DISC, CNRS, Besançon, Jean-Philippe Gros, Fabien PeureuxInstitut FEMTO-ST (UMR CNRS 6174) and Smartesting S&S Link to publication DOI
	14:30 - 14:45 Talk		Can Learning Formal Specification Be Fun? - Experience and Perspective TestEd Wishnu PrasetyaUtrecht University, Craig LeekUtrecht University, Roan OosenbrugUtrecht University, Petar KosticUtrecht University, Mike de VriesUtrecht University Link to publication DOI

	15:00 - 15:45: Session IIITestEd at Arrábida

	15:00 - 15:15 Talk		Integrating Testing Throughout the CS Curriculum TestEd Sarah HeckmanNC State University, Jessica Young SchmidtNorth Carolina State University, Jason KingNorth Carolina State University Link to publication DOI
	15:15 - 15:30 Talk		A Preliminary Report on Hands-On and Cross-Course Activities in a College Software Testing Course TestEd Upsorn PraphamontripongComputer Science, University of Virginia, Charlottesville, Mark FloryanComputer Science, University of Virginia, Charlottesville, Ryan RitzoComputer Science, University of Virginia, Charlottesville Link to publication DOI
	15:30 - 15:45 Talk		Incorporating Testing Topics in an Object-Oriented Programming Course TestEd Rowland Pitts Link to publication DOI

	16:00 - 17:00: Session IVTestEd at Arrábida

	16:00 - 16:15 Talk		Towards a Learning Environment for Internet of Things Testing with LEGO® MINDSTORMS® TestEd Thomas Auer, Michael FeldererUniversity of Innsbruck Link to publication DOI
	16:15 - 16:30 Talk		Teaching Software Testing with the Code Defenders Testing Game: Experiences and Improvements TestEd Gordon FraserUniversity of Passau, Alessio GambiUniversity of Passau, José Miguel RojasUniversity of Leicester, UK Link to publication DOI
	16:30 - 16:45 Talk		Panel discussion: Tips for online teaching TestEd
	16:55 - 17:00 Day closing		Wrap-up TestEd

Sat 24 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change


Room	9:00		30	10:00	30	11:00	30	12:00	30		13:00	30	14:00			30	15:00		30	16:00	30				17:00	30	18:00		30	19:00	30
Arrábida										Mutation Session I								Mutation Session II					Mutation Session III
D. Luis	NEXTA Welcome + Session: Process Improvement					NEXTA Session: Optimisation							NEXTA Session: Test Generation							NEXTA Session: User-Interface Testing + Closing
Farfetch (D. Maria)											IWCT Opening Session			IWCT Poster Presentation Session	IWCT Test Generation and Combinatorial Testing Applications Session				IWCT Combinatorial Testing Tools Session					IWCT Wrap up
Infante															CCIW Session I							CCIW Session II						CCIW Recap Discussion
Miragaia											TAIC PART Session I				TAIC PART Session II
Porto	A-MOST Session I					A-MOST Session II							A-MOST Session III							A-MOST Session IV
São João		ITEQS Session I				ITEQS Session II							ITEQS Session III							ITEQS

Sun 25 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change


Room	9:00		30	10:00	30	11:00	30	12:00	30	13:00	30	14:00		30	15:00		30	16:00	30	17:00	30	18:00	30	19:00		30	20:00		30	21:00	30	22:00	30	23:00	30	0:00	30
Alfândega													General
Farfetch (D. Maria)		Industry Track IT1 - Test Generation & Refactoring				Research Papers RT3 - Testing Deep Learning and Robotic Systems						Research Papers + Research Papers RT5 - Testing for APIs																Industry Track IT1 - Test Generation & Refactoring				Research Papers RT3 - Testing Deep Learning and Robotic Systems
Infante		Research Papers RT1 - Fault Localization and Debugging Infante				Research Papers RT2 - Test Generation Infante						Research Papers RT4 - Misc 1			Posters Track Teasers													Research Papers RT1 - Fault Localization and Debugging Infante				Research Papers RT2 - Test Generation Infante
Plenary Room	Research Papers + Research Papers + Research Papers + Research Papers + Research Papers Intro & Welcome															Research Papers + Research Papers + Research Papers + Research Papers + Research Papers Keynote 1									Research Papers + Research Papers + Research Papers + Research Papers + Research Papers Intro & Welcome

Mon 26 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change


Room	1:00	30	2:00	30	3:00	30	4:00	30	5:00	30	6:00		30		7:00	30	8:00		30	9:00		30	10:00	30	11:00			30	12:00	30	13:00		30		14:00	30	15:00	30	16:00	30	17:00	30	18:00	30	19:00		30	20:00	30	21:00	30	22:00	30	23:00	30	0:00	30
Alfândega									General
Farfetch (D. Maria)	Research Papers + Research Papers RT5 - Testing for APIs																	Industry Track IT2 - Misc									Journal-First Papers Journal First 1					Research Papers RT9 - Empirical Analysis and Program Repair														Industry Track IT2 - Misc
Infante	Research Papers RT4 - Misc 1		Posters Track Teasers															Research Papers RT6 - Web Testing									Research Papers RT7 - Optimizing Testing					Research Papers + Research Papers RT8 - Misc 2														Research Papers RT6 - Web Testing
Palácio da Bolsa												General
Plenary Room												Research Papers + Research Papers + Research Papers + Research Papers + Research Papers Most Influential Paper Awards		Research Papers Keynote 2																				Research Papers + Research Papers + Research Papers + Research Papers + Research Papers Most Influential Paper Awards
São João												Doctoral Symposium Doctoral Symposium 1									Doctoral Symposium Doctoral Symposium 2					Doctoral Symposium Doctoral Symposium 3

Tue 27 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change


Room	0:00	30		1:00	30	2:00	30	3:00	30	4:00	30	5:00		30	6:00	30	7:00	30		8:00	30	9:00	30	10:00	30	11:00	30	12:00	30	13:00	30	14:00	30	15:00	30	16:00		30	17:00		30	18:00	30	19:00	30	20:00	30	21:00	30	22:00	30	23:00	30	0:00	30
Farfetch (D. Maria)			Journal-First Papers Journal First 1				Research Papers RT9 - Empirical Analysis and Program Repair															Tool Demos Track Tool Demos		Industry Track IT3 - Safety & Security													Tool Demos Track Tool Demos			Industry Track IT3 - Safety & Security
Infante			Research Papers RT7 - Optimizing Testing				Research Papers + Research Papers RT8 - Misc 2															Research Papers RT10 - Misc 3		Testing Tools Track Testing tools													Research Papers RT10 - Misc 3			Testing Tools Track Testing tools
Palácio da Bolsa													General
Plenary Room													Research Papers Open Steering Commitee & ICST 2021 Presentation						Research Papers Keynote 3

Wed 28 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change


Room	2:00	30	3:00	30	4:00	30	5:00	30	6:00	30	7:00			30	8:00		30		9:00		30		10:00		30	11:00		30	12:00	30	13:00	30	14:00	30	15:00	30	16:00	30
Arrábida												TestEd Session I				TestEd Session II				TestEd Session III				TestEd Session IV
Farfetch (D. Maria)												InSTA Session I	InSTA Session II					InSTA Session III				InSTA Session IV
Miragaia												ToCaMS Session I								ToCaMS Session II
São João												INTUITESTBEDS Session I												INTUITESTBEDS Session II			INTUITESTBEDS Tool Demos Session

Sat 24 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change


Room	9:00		15	30	45	10:00		15	30	45	11:00	15	30	45	12:00	15	30		45	13:00		15		30	45	14:00		15		30			45		15:00		15		30			45		16:00	15		30		45			17:00		15	30		45	18:00	15		30	45	19:00	15	30	45
Arrábida																		Mutation Warm Up 12:40 - 13:05			Mutation Welcome 13:05 - 13:15	Mutation Keynote 13:15 - 14:30								Mutation On the impact of timeouts and JVM crashes in Pitest 14:30 - 14:45			Mutation Using mutation testing to measure behavioural test diversity 14:45 - 15:00				Mutation SiMut: Exploring Program Similarity to Support the Cost Reduction of Mu ... 15:15 - 15:30		Mutation Predicting Survived and Killed Mutants 15:30 - 15:45			Mutation Fault Types of Adaptive and Context-Aware Systems and Their Relationshi ... 15:45 - 16:00		Mutation MutantDistiller: Using Symbolic Execution for Automatic Detection of Eq ... 16:00 - 16:15	Mutation An Approach to Identifying Minimal and Equivalent Mutants Based on Sour ... 16:15 - 16:30				Mutation Brainstorm on mutation for new systems: machine learning systems, smart ... 16:45 - 17:15					Mutation Awarding and wrap up 17:15 - 17:30
D. Luis	NEXTA Welcome address and practical arrangements 09:00 - 09:15		NEXTA Test Automation Process Improvement in a DevOps Team: Experience report 09:15 - 09:45		NEXTA Test Automation Challenges for Application Landscape Frameworks 09:45 - 10:05		NEXTA Test Automation Improvement Model - TAIM 2.0 10:05 - 10:25				NEXTA Optimization of automated executions based on integration test configur ... 11:00 - 11:30		NEXTA Selective Regression Testing based on Big Data: Comparing Feature Extra ... 11:30 - 12:00		NEXTA Runtime Prioritization with the Classification Tree Method for Test Aut ... 12:00 - 12:20											NEXTA Optimizing the Parameters of an Evolutionary Algorithm for Fuzzing and ... 14:00 - 14:30				NEXTA Boundary Value Exploration for Software Analysis 14:30 - 15:00					NEXTA Test Data Generation for MC/DC Criterion using Reinforcement Learning 15:00 - 15:20									NEXTA On the Industrial Applicability of Augmented Testing: An Empirical Study 16:00 - 16:30			NEXTA Session-Based Recommender Systems for Action Selection in GUI Test Gene ... 16:30 - 16:50			NEXTA Award Ceremony -- Best Question Award; Best Presentation Award; Most in ... 16:50 - 17:30
Farfetch (D. Maria)																				IWCT Welcome to IWCT 13:00 - 13:15		IWCT Keynote: Verifying autonomous systems using ontology-based testing 13:15 - 14:00						IWCT Toward an Encoding Approach to Interaction-based Test Suite Minimization 14:15 - 14:20	IWCT An Automata-Based Generation Method for Combinatorial Sequence Testing ... 14:20 - 14:40			IWCT Combinatorial Methods for Explainable AI 14:40 - 14:50		IWCT Generation of Invalid Test Inputs from Over-Constrained Test Models for ... 14:50 - 15:10					IWCT On Using Ontologies for Testing Compilers 15:30 - 15:40		IWCT A Comparison Infrastructure for Fault Characterization Algorithms 15:40 - 16:00			IWCT Avocado: Open-Source Flexible Constrained Interaction Testing for Pract ... 16:00 - 16:20		IWCT CAGEN: A fast combinatorial test generation tool with support for const ... 16:20 - 16:40					IWCT Wrap up (feedback, planning) 16:55 - 17:55
Infante																													CCIW Welcome to CCIW 15:00 - 15:30					CCIW Interoperability Challenges in CI/CD Ecosystem 15:30 - 16:00				CCIW Test flakiness reduction of retry reduction? Why not have both? 16:00 - 16:30					CCIW Continuous Data Analysis for CI 16:30 - 17:00					CCIW Escalating CI/CD for Growing Companies: The Pipelines 2.0 Project 17:15 - 17:45					CCIW Culprit Finder: Tinderbox Build Breakage Triaging Tool 17:45 - 18:15			CCIW Athena: Keeping the build stable automatically 18:15 - 18:45				CCIW What are the biggest challenges in large scale CI/CD? 19:00 - 19:30
Miragaia																				TAIC PART Opening 13:00 - 13:10			TAIC PART Coding Effective Testing Tools Within Minutes – Live! 13:26 - 13:53				TAIC PART Q&A: Coding Effective Testing Tools Within Minutes – Live! 14:10 - 14:20		TAIC PART On Using k-means Clustering for Test Suite Reduction 14:20 - 14:35		TAIC PART Prioritization of Test Cases with Varying Test Costs and Fault Severiti ... 14:35 - 14:50			TAIC PART Test Tools: an illusion of usability? 14:50 - 15:05		TAIC PART Towards a unified catalog of attributes to guide industry in software t ... 15:05 - 15:20		TAIC PART Data Dynamics for Testing Systems Fast Abstract: Data Dynamics for Test ... 15:20 - 15:35		TAIC PART Q&A 15:35 - 15:55
Porto	A-MOST Opening 09:00 - 09:10	A-MOST Keynote: Why models? 09:10 - 10:30									A-MOST A Tool for the Automatic Generation of Test Cases and Oracles for Simul ... 11:00 - 11:30		A-MOST A Model-Based Security Testing Approach for Automotive Over-The-Air Updates 11:30 - 12:00		A-MOST Ontology-based Testing: An Emerging Paradigm for Modeling and Testing S ... 12:00 - 12:30											A-MOST Using tabular notation to support Model Based Testing 14:00 - 14:30				A-MOST Model-Based Testing for MAPE-K adaptation control loops 14:30 - 15:00					A-MOST Conformance Testing in UPPAAL: A diabolic approach 15:00 - 15:30									A-MOST Model-Based Testing of Read Only Graph Queries 16:00 - 16:30			A-MOST Optimizing decision making in concolic execution using reinforcement le ... 16:30 - 17:00					A-MOST Closing 17:00 - 17:30
São João			ITEQS Welcome and opening message 09:15 - 09:30	ITEQS Automatic exploratory performance testing using a discriminator neural ... 09:30 - 10:00		ITEQS Performance Evaluation of Container's Shared Volumes 10:00 - 10:30					ITEQS Prioritizing Scenarios based on STAMP/STPA Using Statistical Model Checking 11:00 - 11:30		ITEQS Generating Tests for the Discovery of Security Flaws in Product Variants 11:30 - 12:00		ITEQS Test Data Generation for False Data Injection Attack Testing in Air Tra ... 12:00 - 12:30											ITEQS Security Testing using Artificial Intelligence Methods and Techniques 14:00 - 15:00									ITEQS Keywords-based test categorization for Extra-Functional Properties 15:00 - 15:30				ITEQS Best Paper Award & Closing 15:30 - 15:40

Sun 25 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change


Room	9:00	15	30	45	10:00	15	30	45	11:00	15	30	45	12:00	15	30	45	13:00	15	30	45	14:00	15	30	45	15:00		15			30		45		16:00	15	30	45	17:00	15	30	45	18:00	15	30	45	19:00		15	30	45	20:00	15	30	45	21:00	15	30	45	22:00	15	30	45	23:00	15	30	45
Farfetch (D. Maria)		ICST Industry Track Parallelization of Classical Numerical Optimization in Quantum Variatio ... 09:15 - 09:45		ICST Industry Track SPECMATE: Automated Creation of Test Cases from Acceptance Criteria 09:45 - 10:15		ICST Industry Track Tool Support for Refactoring Manual Tests 10:15 - 10:45			ICST Research Papers An Empirical Evaluation of Mutation Operators for Deep Learning Systems 11:00 - 11:30		ICST Research Papers Comparing Offline and Online Testing of Deep Neural Networks: An Autono ... 11:30 - 12:00		ICST Research Papers A Study on Challenges of Testing Robotic Systems 12:00 - 12:30								ICST Research Papers QuickREST: Property-based Test Generation of OpenAPI-Described RESTful APIs 14:00 - 14:30		ICST Research Papers RESTTESTGEN: Automated Black-Box Testing of RESTful APIs 14:30 - 15:00		ICST Research Papers Testability Transformations For Existing APIs 15:00 - 15:30					ICST Testing Tools Track CDST: A Toolkit for Testing Cockpit Display Systems 15:30 - 15:45		ICST Testing Tools Track Open-source Defect Injection Benchmark Testbed for the Evaluation of Te ... 15:45 - 16:00																				ICST Industry Track Parallelization of Classical Numerical Optimization in Quantum Variatio ... 20:15 - 20:45		ICST Industry Track SPECMATE: Automated Creation of Test Cases from Acceptance Criteria 20:45 - 21:15		ICST Industry Track Tool Support for Refactoring Manual Tests 21:15 - 21:45			ICST Research Papers An Empirical Evaluation of Mutation Operators for Deep Learning Systems 22:00 - 22:30		ICST Research Papers Comparing Offline and Online Testing of Deep Neural Networks: An Autono ... 22:30 - 23:00		ICST Research Papers A Study on Challenges of Testing Robotic Systems 23:00 - 23:30
Infante		ICST Research Papers Can We Predict the Quality of Spectrum-based Fault Localization? 09:15 - 09:45		ICST Research Papers Substate Profiling for Enhanced Fault Detection and Localization: An Em ... 09:45 - 10:15		ICST Research Papers More Accurate Dynamic Slicing for Better Supporting Software Debugging 10:15 - 10:45			ICST Research Papers Language-Agnostic Generation of Compilable Test Programs 11:00 - 11:30		ICST Research Papers MiMIs: Simple, Efficient, and Fast Bounded-Exhaustive Test Case Generators 11:30 - 12:00		ICST Research Papers Learning How to Search: Generating Exception-Triggering Tests Through A ... 12:00 - 12:30								ICST Research Papers Determining Method-Call Sequences for Object Creation in C++ 14:00 - 14:30		ICST Research Papers NodeRacer: Event Race Detection for Node.js Applications 14:30 - 15:00		ICST Posters Track Poster: Agent-based Testing of Extended Reality Systems 15:00 - 15:12	ICST Posters Track Poster: Is Euclidean Distance the best Distance Measurement for Adaptiv ... 15:12 - 15:24			ICST Posters Track Poster: Performance Testing Driven by Reinforcement Learning 15:24 - 15:36		ICST Posters Track Poster: SONAR Testing - Novel Testing Approach Based on Operation Recor ... 15:36 - 15:48		ICST Posters Track Poster: Test Case Prioritization Using Error Propagation Probability 15:48 - 16:00																			ICST Research Papers Can We Predict the Quality of Spectrum-based Fault Localization? 20:15 - 20:45		ICST Research Papers Substate Profiling for Enhanced Fault Detection and Localization: An Em ... 20:45 - 21:15		ICST Research Papers More Accurate Dynamic Slicing for Better Supporting Software Debugging 21:15 - 21:45			ICST Research Papers Language-Agnostic Generation of Compilable Test Programs 22:00 - 22:30		ICST Research Papers MiMIs: Simple, Efficient, and Fast Bounded-Exhaustive Test Case Generators 22:30 - 23:00		ICST Research Papers Learning How to Search: Generating Exception-Triggering Tests Through A ... 23:00 - 23:30
Plenary Room	ICST Research Papers Intro & Welcome 09:00 - 09:15																											ICST Research Papers One-click formal methods 16:15 - 17:15																			ICST Research Papers Intro & Welcome 20:00 - 20:15<

ICST 2020 Program

Filter Program

Program Display Configuration

Sat 24 Oct Times are displayed in time zone: Greenwich Mean Time : Lisbon change

Sun 25 Oct Times are displayed in time zone: Greenwich Mean Time : Lisbon change

Mon 26 Oct Times are displayed in time zone: Greenwich Mean Time : Lisbon change

Tue 27 Oct Times are displayed in time zone: Greenwich Mean Time : Lisbon change

Wed 28 Oct Times are displayed in time zone: Greenwich Mean Time : Lisbon change

Sat 24 Oct Times are displayed in time zone: Greenwich Mean Time : Lisbon change

Mutation

Mutation

Mutation

NEXTA

NEXTA

NEXTA

NEXTA

IWCT

IWCT

IWCT

IWCT

IWCT

CCIW

CCIW

CCIW

TAIC PART

TAIC PART

A-MOST

A-MOST

A-MOST

A-MOST

ITEQS

ITEQS

ITEQS

ITEQS

Sun 25 Oct Times are displayed in time zone: Greenwich Mean Time : Lisbon change

General

Industry Track

Research Papers

Research Papers + Research Papers

Industry Track

Research Papers

Research Papers

Research Papers

Research Papers

Posters Track

Research Papers

Research Papers

Research Papers + Research Papers + Research Papers + Research Papers + Research Papers

Research Papers + Research Papers + Research Papers + Research Papers + Research Papers

Research Papers + Research Papers + Research Papers + Research Papers + Research Papers

Mon 26 Oct Times are displayed in time zone: Greenwich Mean Time : Lisbon change

General

Research Papers + Research Papers

Industry Track

Journal-First Papers

Research Papers

Industry Track

Research Papers

Posters Track

Research Papers

Research Papers

Research Papers + Research Papers

Research Papers

General

Research Papers + Research Papers + Research Papers + Research Papers + Research Papers

Research Papers

Research Papers + Research Papers + Research Papers + Research Papers + Research Papers

Doctoral Symposium

Doctoral Symposium

Doctoral Symposium

Tue 27 Oct Times are displayed in time zone: Greenwich Mean Time : Lisbon change

Journal-First Papers

Research Papers

Tool Demos Track

Industry Track

Tool Demos Track

Industry Track

Research Papers

Research Papers + Research Papers

Research Papers

Sat 24 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

Sun 25 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

Mon 26 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

Tue 27 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

Wed 28 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

Sat 24 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

Sun 25 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

Mon 26 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

Tue 27 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

Wed 28 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

Sat 24 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

Sun 25 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change