The benefits of a controller-free VR headset for rehabilitation

Patient performing a VR rehabilitation exercise with a fine-grip movement

Today, the world of virtual reality continues to develop and offer new functionalities, allowing users to be immersed in an immersive, imaginary universe. Handtracking is a new technology in virtual reality, enabling users to dispense with the joysticks attached to their virtual reality headset, and interact directly with their hands.

What is handtracking in virtual reality?

Hand tracking allows to follow the movements, the speed but also the position of the user's hands, reproducing exactly the same gestures and the same actions through the virtual reality headset in real time. A pair of virtual hands is then created and integrated into VR applications so that the hands can be used and seen naturally.

How is handtracking designed?

To do this, the virtual reality helmet has several sensors that identify the shape of the hand, thanks to an artificial intelligence. It will then reproduce the hand with several important points, including the fingertips. More than 40 key points are then detected (about 20 for each hand), in order to reproduce exactly the same movements. The hands are then modeled, which allows the user to move, grab, click on a button or move objects virtually. The experience is intuitive, easy to use and even more immersive.

The advantage of handtracking for patients with upper limb motor disorders

Thanks to this technology, H'ability has imagined a rehabilitation aid for patients who have lost their upper limb motor skills, with the aim of performing fun exercises and reducing pain. The patient is motivated and increases his chances of recovery.

The handtracking makes it possible to be free of any controller or sensor. It makes virtual reality accessible to a larger number of patients, especially those with grip difficulties, cognitive disorders or elderly people who are not used to using controllers.

The patient interacts with the virtual elements simply with his or her hands, thus stimulating movement more naturally. This reinforces the active rehabilitation of the patient in a simple and intuitive way. Thus, handtracking allows to propose an innovative approach in virtual reality, complementary to conventional rehabilitation.

Want to read another article?