Project Area M: Methodical Bases of the HVA-work space
M9 Temporal Multimodal Information Processing in the HVA Workspace (LSR, LMU)
 
 
  Head: Prof. Dr.-Ing.  Sandra Hirche
Prof. Dr. Hermann Müller
Dr. Zhuanghua Shi
 
  Staff: Dipl.- Ing. Markus Rank
M. Sc. Lihan Chen
M. Sc. Heng Zou
 
  Different processing and communication times for multi-modal data in haptic-visual-auditory (HVA) workspace lead to cross-modal asynchrony and thus to a temporal inconsistent representation. To date there are hardly any results for the influence of temporal inconsistencies on the transparency of the telepresence system and on the coherent perception of the multi-modal integration, especially in the connection with the haptic modality. The aim of this project is to study the temporal multi-modal integration capacity of the human operator. Based on the behavioral results, a human perception model for the cross-modal temporal integration will be created, so that the multi-modal communication protocols and the scheduling of local augmenting measures can be evaluated in a HVA workspace. This may act as guideline for multi-modal telepresence system design. The approach is interdisciplinary and is based on psychophysical methods and systems.