학술논문

Towards Better Trust in Human-Machine Teaming through Explainable Dependability
Document Type
Conference
Source
2023 IEEE 20th International Conference on Software Architecture Companion (ICSA-C) ICSA-C Software Architecture Companion (ICSA-C), 2023 IEEE 20th International Conference on. :86-90 Mar, 2023
Subject
Computing and Processing
Analytical models
Software architecture
Autonomous systems
Medical services
Human in the loop
Teamwork
Behavioral sciences
Human-machine teaming
formal analysis
statistical model checking
explainable AI
Language
ISSN
2768-4288
Abstract
The human-machine teaming paradigm is increasingly widespread in critical domains, such as healthcare and domestic assistance. The paradigm goes beyond human-on-the-loop and human-in-the-loop systems by promoting tight teamwork between humans and autonomous machines that collaborate in the same physical space. These systems are expected to build a certain level of trust by enforcing dependability and exhibiting interpretable behavior. We present emerging results in this direction, with a novel framework aiming at achieving better trust in human-machine teaming leveraging formal analysis, as well as eXplainable AI. We illustrate our approach and the emerging results with an example from the healthcare domain.