Write a Blog >>
ICST 2020
Sat 24 - Wed 28 October 2020 Porto, Portugal

Robotic systems are increasingly a part of everyday life. Characteristics of robotic systems such as interaction with the physical world, and integration of hardware and software components, differentiate robotic systems from conventional software systems. Although numerous studies have investigated the challenges of software testing in practice, no such study has focused on testing of robotic systems. In this paper, we conduct a qualitative study to better understand the testing practices used by the robotics community, and identify the challenges faced by practitioners when testing their systems. We identify a total of 12 testing practices and 9 testing challenges from our participants’ responses. We group these challenges into 3 major themes: Real-world complexities, Community and standards, and Component integration. We believe that further research on addressing challenges described with these three major themes can result in higher adoption of robotics testing practices, more testing automation, and higher-quality robotic systems.

Sun 25 Oct
Times are displayed in time zone: Greenwich Mean Time : Lisbon change

11:00 - 12:30
RT3 - Testing Deep Learning and Robotic SystemsResearch Papers at Farfetch (D. Maria) +11h
Chair(s): Antonio FilieriImperial College London
11:00
30m
Talk
An Empirical Evaluation of Mutation Operators for Deep Learning SystemsDistinguished Paper Award
Research Papers
Gunel JahangirovaUSI Lugano, Switzerland, Paolo TonellaUniversità della Svizzera Italiana (USI)
Link to publication DOI
11:30
30m
Talk
Comparing Offline and Online Testing of Deep Neural Networks: An Autonomous Car Case Study
Research Papers
Fitash Ul HaqUniversity of Luxembourg, Donghwan ShinUniversity of Luxembourg, Shiva NejatiUniversity of Luxembourg, Lionel BriandUniversity of Luxembourg, University of Ottawa
Link to publication DOI
12:00
30m
Talk
A Study on Challenges of Testing Robotic Systems
Research Papers
Afsoon AfzalCarnegie Mellon University, Claire Le GouesCarnegie Mellon University, Michael HiltonCarnegie Mellon University, USA, Christopher Steven TimperleyCarnegie Mellon University
Link to publication DOI
22:00 - 23:30
RT3 - Testing Deep Learning and Robotic SystemsResearch Papers at Farfetch (D. Maria)
Chair(s): João Pascoal FariaFaculty of Engineering, University of Porto and INESC TEC
22:00
30m
Talk
An Empirical Evaluation of Mutation Operators for Deep Learning SystemsDistinguished Paper Award
Research Papers
Gunel JahangirovaUSI Lugano, Switzerland, Paolo TonellaUniversità della Svizzera Italiana (USI)
Link to publication DOI
22:30
30m
Talk
Comparing Offline and Online Testing of Deep Neural Networks: An Autonomous Car Case Study
Research Papers
Fitash Ul HaqUniversity of Luxembourg, Donghwan ShinUniversity of Luxembourg, Shiva NejatiUniversity of Luxembourg, Lionel BriandUniversity of Luxembourg, University of Ottawa
Link to publication DOI
23:00
30m
Talk
A Study on Challenges of Testing Robotic Systems
Research Papers
Afsoon AfzalCarnegie Mellon University, Claire Le GouesCarnegie Mellon University, Michael HiltonCarnegie Mellon University, USA, Christopher Steven TimperleyCarnegie Mellon University
Link to publication DOI