Helmets of augmented reality can not only expand the gaming experience of gamers. They want to become surgeons. This system will "see" through the organs and tissues, which will significantly improve the outcome of operations, writes The Financial Express.
The use of this technology is encouraged by the Royal College of London. His staff showed how it is possible to use helmets of augmented reality during an operation to reconstruct a lower limb. Used a headset HoloLens from Microsoft. It creates a mixed reality, allowing the surgeon to interact with holograms or computer-generated objects displayed in front of the eyes. In particular, images with scan results of computed tomography (including the location of bones and key vessels) were superimposed on the patient's leg. It turned out that the surgeon "sees" what is happening inside.
So, the images were broken into bones, muscles, fat tissue and blood vessels. They were loaded into the program for creating three-dimensional models of the foot. These models were then uploaded to another program that transmits images to the headset. She, in turn, imposes a model on the real objects visible to the surgeon. Doctors can work with images using gestures (zoom in, place a label). This, for example, greatly facilitates the restoration of the circulatory system in the leg. The system was successfully tested on five patients with reconstructive operations on their legs.