Paper Info
Title
Behind-The-Mask: A Face-Through Head-Mounted Display
Abstract
A head-mounted display (HMD), which is common in virtual reality (VR) systems, normally hides the user's face. This feature prohibits to realize a face-to-face communication, in which two or more users share the same virtual space, or show a participant's face on a surrogate-robot's face when the user remotely connects to the robot through an HMD for tele-immersion. Considering that face-to-face communication is one of the fundamental requirements of real-time communications, and is widely realized and used by many nonVR telecommunication systems, an HMD's face hiding feature is considered to be a serious problem and limits the possibility of VR. To address this issue, we propose the notion of "Face-through HMD" and present a face-capturing HMD configuration called "Behind-the-Mask" with infrared (IR) cut filters and side cameras that can be attached to existing HMDs. As an IR cut filter only reflects infrared light and transmits visible light, it is transparent to the user's eye but reflects the user's face with infrared lights. By merging a prescanned 3D face model of the user with the face image obtained from our HMD, the 3D face model of the user with eyes and mouth movement can be reconstructed. We consider that our proposed HMD can be used in many VR applications.
Year
DOI
Venue
2018
10.1145/3206505.3206544
AVI'18: PROCEEDINGS OF THE 2018 INTERNATIONAL CONFERENCE ON ADVANCED VISUAL INTERFACES
Keywords
Field
DocType
virtual reality, head-mounted display (HMD), face-through HMD, facial image, elecommunication, avatar
Computer vision,Virtual reality,Computer science,Optical head-mounted display,Human–computer interaction,Artificial intelligence,Merge (version control),Robot,Avatar,Infrared cut-off filter,Virtual space
Conference
Citations 
PageRank 
References 
3
0.50
8
Authors
3
Name
Order
Citations
PageRank
Jun Rekimoto14413662.43
Keishiro Uragaki260.93
Kenjiro Yamada330.50