The Malleable-Self Experience: Transforming Body Image by Integrating Visual and Whole-body Haptic Stimuli
Audience Award, ACM SIGGRAPH 2024 Emerging Technologies
ABSTRACT
The Malleable-Self Experience comprises the integration of the visual element of virtual reality (VR) with the whole-body haptic sensations of the Synesthesia X1 haptic chair. The goal is to induce a provocative experience that expands one’s understanding of the self by creating a malleable perception of the body image. We explore the effects of visual and whole-body haptic integration on augmenting body image during dynamic transformations of visual representations of the body in VR. We design the plausibility of these perceptual augmentations using a specific sequence of multisensory events: (1) establishing body ownership of a virtual body anchored in the same self-located space as the participant, (2) separating the virtual body to hover above the participant’s physical body, enhanced by accompanying haptic stimuli to increase proprioceptive uncertainty, and (3) transforming the virtual body with integrated visuo-haptic stimuli to sustain perceptual congruency.
KEYWORDS
Malleable-Self Experience, XR(Extended Reality), Synesthesia, Body Ownership Illusions(BOI)
AUTHOR
- Tanner Person, Keio University Graduate School of Media Design
- Nobuhisa Hanamitsu, Enhance Experience Inc.Keio University Graduate School of Media Design
- Danny Hynds, Keio University Graduate School of Media Design
- Sohei Wakisaka, Keio University Graduate School of Media Design
- Kota Isobe, Enhance Experience Inc.
- Leonard Mochizuki, Enhance Experience Inc.
- Tetsuya Mizuguchi, Enhance Experience Inc.Keio University Graduate School of Media Design
- Kouta Minamizawa, Professor, Keio University Graduate School of Media Design
REFERENCE
ACM SIGGRAPH 2024 Emerging Technologies
- https://s2024.siggraph.org/program/emerging-technologies/
- https://s2024.conference-program.org/presentation/?id=gensub_256&sess=sess213
Keio Media Design (KMD)
- https://www.kmd.keio.ac.jp/news/2024/07/kmd-presents-3-projects-at-acm-siggraph-2024-emerging-technologies.html
- https://dl.acm.org/doi/abs/10.1145/3641517.3664385
- https://www.embodiedmedia.org/projects
Enhance Experience Inc.
Synesthesia lab
