The system uses a camera mounted on the glasses to transmit an image of the surrounding space to a miniature computer. Using machine learning algorithms, it recognizes obstacles and people. The device then sends an audio signal every 250 milliseconds that tells the user exactly where to move. The signal can be sent to either the left or right ear.
Scientists also developed special flexible artificial leather pads that attach to the wrists and fingers. They have a separate built-in camera and vibrate when a person approaches an object within 40 to 5 centimeters. The bracelets also vibrate when the user reaches for an object and is prompted to grasp it.
The device was successfully tested. Twenty visually impaired participants tested its capabilities. The new technology was found to increase mobility by 25% compared to a standard cane. The volunteers navigated a 25-meter maze and were able to complete the route faster and more safely.
Another experiment was conducted in an urban environment and in rooms filled with furniture. Eight volunteers participated, and they also confirmed the reliability of the new system in real-world conditions.
One of the advantages of this technology over traditional walking sticks is its range. The walking stick detects obstacles up to 1 meter ahead of the user. The user receives no additional information about the object other than its presence. However, the camera can recognize people, doors, walls, and furniture in advance. This significantly facilitates navigation in large cities and public spaces.
The developers emphasize that this is still an experimental prototype that requires significant improvements. The device is currently bulky, but the researchers plan to reduce its size and weight, for example by integrating the camera into contact lenses. This would make it virtually invisible and convenient for everyday use.
Experts note the uniqueness of the approach: the device combines both audio and tactile signals. However, for widespread implementation, trials with a large number of people of different ages and close collaboration with medical centers and communities of visually impaired people are necessary.
