Haptic and visual feedback for manipulation aid in a virtual environment

This paper proposes a new method of object manipulation in a Virtual Environment that uses a visual and haptic feedback based manipulation aid. If the displayed position of the object is constrained on a face of another object in the virtual environment, a user can place the virtual object at a precise position as easily as in a real environment. The visual feedback based manipulation aid constrains the motion of the virtual object as if it were moved in a real environment. Furthermore, in simultaneous correspondence with the visual constraints, the haptic feedback based manipulation aid constrains the motion of the user's hand in the real environment. The proposed method introduces a magnetic metaphor: the user has the sensation of manipulating a virtual object on a rigid surface without using a large and powerful robot arm and the time consuming simulation of detailed physical phenomena. The properties of this manipulation aid based on two kinds of feedback are discussed. Experimental results show the effectiveness of our proposed method.