The benefits of hand tracking in virtual reality

You are here :
Patient using handtracking with the therapeutic virtual reality headset
Patient using handtracking with a therapeutic virtual reality headset


Today, the world of virtual reality continues to develop and offer new features, which allow the user to be immersed in an immersive and imaginary universe. The handtracking is a new technology in virtual reality that gives the possibility to not use the controllers linked to the virtual reality helmet, in order to interact only with his hands.

What is handtracking in virtual reality?

Hand tracking allows to follow the movements, the speed but also the position of the user's hands, reproducing exactly the same gestures and the same actions through the virtual reality headset in real time. A pair of virtual hands is then created and integrated into VR applications so that the hands can be used and seen naturally.

How is handtracking designed?

To do this, the virtual reality helmet has several sensors that identify the shape of the hand, thanks to an artificial intelligence. It will then reproduce the hand with several important points, including the fingertips. More than 40 key points are then detected (about 20 for each hand), in order to reproduce exactly the same movements. The hands are then modeled, which allows the user to move, grab, click on a button or move objects virtually. The experience is intuitive, easy to use and even more immersive.

The advantage of handtracking for patients with upper limb motor disorders

Thanks to this technology, H'ability has imagined a rehabilitation aid for patients who have lost their upper limb motor skills, with the aim of performing fun exercises and reducing pain. The patient is motivated and increases his chances of recovery.

The handtracking makes it possible to be free of any controller or sensor. It makes virtual reality accessible to a larger number of patients, especially those with grip difficulties, cognitive disorders or elderly people who are not used to using controllers.

The patient interacts with the virtual elements simply with his or her hands, thus stimulating movement more naturally. This reinforces the active rehabilitation of the patient in a simple and intuitive way. Thus, handtracking allows to propose an innovative approach in virtual reality, complementary to conventional rehabilitation.

Want to read another article?