Control with Vergence Eye Movement in Augmented Reality See-Through Vision

IEEE VRW, 2022

Zhimin Wang, Yuxin Zhao and Feng Lu

PDF PPT


Abstract

Augmented Reality (AR) see-through vision has become a recent research focus since it enables the user to see through a wall and see the occluded objects. Most existing works only used common modalities to control the display for see-through vision, e.g., button clicking and speech control. However, we use visual system to observe see-through vision. Using an addition interaction channel will distract the user and degrade the user experience. In this paper, we propose a novel interaction method using vergence eye movement for controlling see-through vision in AR. Specifically, we first customize eye cameras and design gaze depth estimation method for Microsoft HoloLens 2. With our algorithm, fixation depth can be computed from the vergence, and used to manage the see-through vision. We also propose two control techniques of gaze vergence. The experimental results show that the gaze depth estimation method is efficient. The difference cannot be found between these two modalities in terms of completion time and the number of successes.

Presentation Video

Related Work


Our related work:

Gaze-Vergence-Controlled See-Through Vision in Augmented Reality

Interaction With Gaze, Gesture, and Speech in a Flexibly Configurable Augmented Reality System

Edge-Guided Near-Eye Image Analysis for Head Mounted Displays

Bibtex


@INPROCEEDINGS{wang_22VR, author={Wang, Zhimin and Zhao, Yuxin and Lu, Feng}, booktitle={2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)}, title={Control with Vergence Eye Movement in Augmented Reality See-Through Vision}, year={2022}, volume={}, number={}, pages={548-549}, doi={10.1109/VRW55335.2022.00125}}