Self representation and interaction in immersive virtual reality

Inserting a self-representation in Virtual Reality is an open problem with several implications for both the sense of presence and interaction in virtual environments. To cope the problem with low cost devices, we devise a framework to align the measurements of different acquisition devices used while wearing a tracked VR head-mounted display (HMD). Specifically, we use the skeletal tracking features of an RGB-D sensor (Intel Realsense d435) to build the user’s avatar, and compare different interaction technologies: a Leap Motion, the Manus Prime haptic gloves, and the Oculus Controllers. The effectiveness of the proposed systems is assessed through an experimental session, where an assembly task is proposed with the three different interaction mediums, with and without the self-representation. Users reported their feeling by answering the User Experience and Igroup Presence Questionnaires, and we analyze the total time to completion and the error rate.