Variation in the temporal window of integration with changing the sound pressure level of a sound stimulus

[摘要] Multisensory information of digital content at appropriate timing offers us enhanced immersion and high-reality presence. For example, when you shoot an object in a game, the gun sound and its vibration holistically and realistically renders the impact of a shooting experience. Multimodal feedback enables us to absorb much more information about the event effectively than only unimodal information, thereby, bringing cognitive merit in learning, discrimination, or reaction speed to external stimuli [1]. Especially for soundrelated tactile sensations, we can not only perceive the object’s texture and weight more in detail but also obtain the cue more to figure out the spatial features and its time variation [2]. Taking advantage of the characteristics of multimodal information, the presentation of a sound-related vibrotactile stimulus in the digital content could help to improve user experience, which may lead users to enhanced high-reality into a given context.

[学科分类] 声学和超声波

[关键词] Auditory-tactile integration;Multimodal;Synchrony perception