Multimodal interaction: A review

M Turk�- Pattern recognition letters, 2014 - Elsevier
… unimodal decisions apart from the full multimodal context. In considering the question of …
of multimodal integration. Is the task of multimodal integration to produce a multimodal event, …

Multimodal integration-a statistical view

L Wu, SL Oviatt, PR Cohen�- IEEE Transactions on Multimedia, 1999 - ieeexplore.ieee.org
… recognition performance by evaluating the multimodal recognition probabilities… multimodal
integration process. We evaluate these methods using Quickset, a speech/gesture multimodal

Multimodal deep learning for activity and context recognition

V Radu, C Tong, S Bhattacharya, ND Lane…�- Proceedings of the�…, 2018 - dl.acm.org
… To illustrate this aspect in the context of multimodal sensing … same is the case of context
understanding for indoor localization … used approach in multimodal data integration using a deep …

Rethinking the role of the angular gyrus in remembering the past and imagining the future: the contextual integration model

S Ramanan, O Piguet, M Irish�- The Neuroscientist, 2018 - journals.sagepub.com
… , we present the Contextual Integration Model as a unifying … in terms of multimodal integration
and representation of contextual … scenarios, the Contextual Integration Model holds that the …

[HTML][HTML] Multimodal integration learning of robot behavior using deep neural networks

K Noda, H Arie, Y Suga, T Ogata�- Robotics and Autonomous Systems, 2014 - Elsevier
… For humans to accurately understand the world around them, multimodal integration is …
the integration of sensory-motor time-series data and the self-organization of multimodal fused …

Integrating multimodal information in large pretrained transformers

W Rahman, MK Hasan, S Lee, A Zadeh, C Mao…�- arXiv preprint arXiv�…, 2019 - arxiv.org
… is their non-contextual nature. Recently, contextual language representation models trained
on … We believe that earlier layers allow for better integration of the multimodal information, as …

[PDF][PDF] Multimodal Integration in a Wider Sense

BP P�l�- Robust and Adaptive Information Processing for Mobile�…, 2004 - academia.edu
Integration mechanism of various modality inputs in the context of Multimodal Interfaces is
the main focus of the paper. 1 A framework is presented which aims to develop a statistically …

A contextual multimodal integrator

PP Boda�- …�of the 8th international conference on Multimodal�…, 2006 - dl.acm.org
Context has many interpretations. In our case by context we mean any parameter that can
… paper is the continuation of early efforts on statistical Multimodal Integration [3]. Our primary …

Context-based multimodal input understanding in conversational systems

J Chai, S Pan, MX Zhou, K Houck�- …�Conference on Multimodal�…, 2002 - ieeexplore.ieee.org
… on these meanings, during the multimodal understanding process, a multimodal integrator
… Therefore, we have built a context based multimodal interpreter MIND that applies rich …

[PDF][PDF] Using contextual knowledge to inform a multimodal interactive system

E Harte, R Jarvis�- AARA ACRA, 2008 - Citeseer
Contextually Informed MultiModal Integrator, CIMMI, that fuses speech and symbolic gestures
probabilistically and is informed by contextualContextual knowledge is used to resolve am…