The essence of the system is that a camera mounted on glasses transmits an image of the surrounding space to a miniature computer. It uses machine learning algorithms to recognize obstacles and people. Then the device informs the user with an audio signal every 250 milliseconds where exactly to move. The signal can be sent to the left or right ear.
Additionally, scientists have developed special flexible pads made of artificial leather that are attached to the wrists and fingers. They have a separate built-in camera and begin to vibrate if a person approaches an object at a distance of 40 to 5 centimeters. The bracelets also vibrate when the user reaches for an object and must grab it.
The device was successfully tested. 20 visually impaired participants tested its capabilities. It turned out that the use of new technology increases the efficiency of movement by 25% compared to a regular cane. Volunteers passed a 25-meter-long labyrinth and were able to overcome the route faster and safer.
Another experiment was conducted in an urban environment and in rooms filled with furniture. It involved 8 volunteers, who also confirmed the reliability of the new system in real conditions.
One of the advantages of this technology over traditional canes is the viewing range. The cane identifies obstacles up to 1 meter ahead of the person. The user does not receive any additional information about the object, except for its presence. But the camera is able to recognize people, doors, walls or furniture in advance. This makes navigation in large cities and public places much easier.
The authors of the development emphasize that this is still an experimental model that requires significant improvements. The device is currently bulky, but the researchers plan to reduce its size and weight, for example, by integrating the camera into contact lenses. This option will become virtually invisible and convenient in everyday life.
Experts note the uniqueness of the approach: the device combines both sound and tactile signals. However, for mass implementation, it is necessary to conduct tests with a large number of people of different ages and closely interact with medical centers and communities of visually impaired people.