Surgical training and navigation device based on head-mounted three-dimensional augmented reality (AR) equipment

Abstract

The invention discloses a surgical training and navigation device based on head-mounted three-dimensional augmented reality (AR) equipment. The device comprises a local tracker module, a remote tracker module, a local binocular vision tracking module, a remote binocular vision tracking module, a local image processing module, a remote image processing module, a three-dimensional model scanning module, a three-dimensional model processing module, a three-dimensional path planning module and an AR display module; the remote tracker module and the local tracker module have the same structure, andeach of the remote tracker module and the local tracker module comprises a bracket and LED lamps which are located in the same plane and have three colors; and the local binocular vision tracking module is used for collecting images of the local tracker module and transmitting the images to the local image processing module in real time, the local image processing module is used for extracting three-dimensional space coordinates of the LED lamps of the local tracker module according to the color algorithm, and a real-time track of a local scalpel point is calculated according to a fixed spatial position relationship between the local tracker module and the scalpel point and is recorded.

Description

Technical field [0001] The invention relates to the field of medical equipment, and in particular to a surgical training and operation and navigation device based on a head-mounted three-dimensional augmented reality display device. Background technique [0002] The uneven distribution of medical resources has always been a major challenge to the medical system in China and the world. The distribution of the global medical access and medical quality index (HAQ) is in many developing countries (such as China and India), and there is a wide gap at the local level. The lack of a well-trained surgical team has severely hindered the popularization of low-cost and high-quality surgical care in low- and middle-income countries. Even in developed countries, it is very challenging to provide efficient medical care quickly in resource-limited areas, especially in the event of a disaster or accident. Considering that human resources are one of the most important elements in the health sys...

AI Technical Summary

Problems solved by technology

But these 2D displays don't provide doctors with depth perception

Images