A Task-oriented Multimodal Conversational Interface for a CSCW Immersive Virtual Environment

P Barra, AA Cantone, R Francese…�- Proceedings of 22nd�…, 2024 - iris.unisa.it
Proceedings of 22nd European Conference on Computer-Supported Cooperative Work, 2024iris.unisa.it
Abstract In CSCW immersive Virtual Reality environments, users may be uncomfortable
when interacting with a two-dimensional menu. Multimodal conversational interfaces may
enhance the interaction enabling users to communicate with the system in different
modalities. In this paper, we investigate the use of an embodied multimodal chatbot for
improving interaction in a Virtual Reality (VR) environment simulating a working context. In
particular, we adopt a User-Centered Design approach to build a multimodal conversational�…
Abstract
In CSCW immersive Virtual Reality environments, users may be uncomfortable when interacting with a two-dimensional menu. Multimodal conversational interfaces may enhance the interaction enabling users to communicate with the system in different modalities. In this paper, we investigate the use of an embodied multimodal chatbot for improving interaction in a Virtual Reality (VR) environment simulating a working context. In particular, we adopt a User-Centered Design approach to build a multimodal conversational interface, named Muxi, in which a task-oriented voice avatar is enhanced with an interactive board for supporting meeting organization in VR. Users were involved in all the development phases, from task definition to iterative user testing. To assess the usability of the proposed interface, we conducted a controlled experiment involving 32 participants to compare the use of Muxi with a traditional menu-based interface in a CSCW environment. We performed quantitative analysis, concerning efficiency and effectiveness assessment, and qualitative analysis, related to participant cognitive load and perceived usability. Results revealed that our multimodal interface increases usability by greatly alleviating cognitive load and improving user performance, representing a good alternative to a menu-based interface.
iris.unisa.it
Showing the best result for this search. See all results