SenseGlove

Augmented Reality (AR) training is rapidly gaining popularity due to increasing labor market shortages and the rising economic importance of cost-effective learning. However, the solutions developed so far for AR training have been limited in the way users interact with digital objects in the AR simulation. There is a significant limitation in the physical feedback given to the user. 

SenseGlove is changing this with a groundbreaking haptic glove. SenseGlove is a pioneering company specializing in the development and production of haptic devices for virtual and augmented reality applications. Based in Delft, the Netherlands and founded in 2015, SenseGlove’s flagship product is the SenseGlove itself, a haptic feedback glove that allows users to experience more realistic and interactive virtual environments. Utilizing cutting-edge haptic technology, the SenseGlove is capable of simulating the sense of touch, providing users with a sense of the shape, texture, and resistance of virtual objects.

As explained earlier, AR technology has the potential to make a significant impact in various markets. However, when looking closely at the underlying technologies, existing solutions and approaches still have limitations. The primary limitation lies in how users interact with digital objects in the AR simulation. 

Currently, interactions are limited to:

• Voice commands from the user that result in (audio)visual feedback
• Simple hand gestures that allow the user to interact with digital objects, again resulting in (audio)visual feedback in the AR environment
• External data systems that can interact with the AR environment and provide additional information and events. Examples of this include Social Brothers’ previously developed projects for Bureau Veritas (Control Room) and Boskalis. Here, Social Brothers developed Remote Inspection using AR, which allows for remote inspection of a ship.
• A controller can be used as a replacement and has the advantage of allowing for multiple forms of interaction and some form of feedback. During interactions, the controller can apply simple vibrations to the user’s hands via the force-feedback principle, further enriching the experience.

Although these are sufficient for basic AR experiences and training, existing solutions lack feedback for the user. However, this physical feedback is essential for learning and therefore the effectiveness of the training. This is why the project partners aim to provide a solution to the problem. Although this problem applies to various industries, the project initially focuses on the medical/healthcare sector due to the significant shortage of medical support staff and other roles within the healthcare system.

The problem statement that the project partners aim to address is as follows: There are no technical (haptic) solutions to realistically interact in an AR environment, which limits the learning effect in physical AR training for healthcare workers.

In order to address the issues presented, a potential solution could be a haptic glove. This technology would allow users to feel and manipulate the digital environment using their own hands. The glove can process motion tracking, force feedback, and tactile feedback signals, effectively integrating the user into the AR environment. The glove’s motors can simulate the physical properties of digital objects, providing a more realistic and engaging experience. However, current haptic solutions are limited to VR and cannot be used in AR.

To overcome these limitations, SenseGlove B.V. and Social Brothers B.V. plan to develop an Immersive Haptic AR Training platform (IHART). The IHART platform aims to provide more realistic and effective AR training by utilizing haptic gloves. The project’s central objective is to create an IHART platform that allows for realistic interaction with digital objects in the AR environment.

In conclusion, the development of a haptic glove has the potential to revolutionize the way users interact with the digital environment, especially in the context of augmented reality (AR). The current generation of haptic solutions is limited to virtual reality (VR), and the project partners SenseGlove B.V. and Social Brothers B.V. seek to address this issue by creating an Immersive Haptic AR Training platform (IHART). The IHART platform aims to provide a more realistic and effective AR training experience through the use of haptic gloves. By simulating the feeling and control of digital objects in the AR environment, the IHART platform can enhance the user’s interaction and overall experience. With the development of IHART, we can look forward to a future where AR training is more immersive and realistic, unlocking new possibilities for learning and development.