Multimodal Interaction with Gaze and Pressure Ring in Mixed Reality

IEEE VR Workshop paper, 2024.

Zhimin Wang, and Jingyi Sun, and Mingwei Hu, and Maohang Rao, and Yangshi Ge, and Weitao Song, and Feng Lu

PDF PPT


Abstract

Controller-free augmented reality devices currently rely on gesture interaction, which can cause arm fatigue and limit hand mobility. This paper proposes a multimodal interaction technique that combines gaze and pressure ring worn on the index finger. The proposed technique eliminates the need for direct hand capturing using the camera, allowing for more flexible hand movements and reducing fatigue. The experiment conducted in this study demonstrates the effectiveness of the pressure ring in enhancing interaction efficiency.

Related Work


Our related work:

Gaze-Vergence-Controlled See-Through Vision in Augmented Reality

Interaction With Gaze, Gesture, and Speech in a Flexibly Configurable Augmented Reality System

Tasks Reflected in the Eyes: Egocentric Gaze-Aware Visual Task Type Recognition in Virtual Reality

Bibtex


@INPROCEEDINGS{wang_VR2024, author={Wang, Zhimin and Sun, Jingyi and Hu, Mingwei and Rao, Maohang and Ge, Yangshi and Song, Weitao and Lu, Feng}, booktitle={2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)}, title={Multimodal Interaction with Gaze and Pressure Ring in Mixed Reality}, year={2024}, volume={}, number={}, pages={839-840}, doi={10.1109/VRW62533.2024.00216}}