Surgery navigation image display method and system based on augmented reality

Abstract

The embodiment of the invention discloses a surgery navigation image display method and system based on augmented reality. When a mark point on a marker is blocked, a preset algorithm model is adoptedto process a gesture rotation matrix of the marker on a current moment, a three-dimensional space coordinate of the mark point on the marker and three-dimensional space displacement between the markpoint and an initially defined original point to obtain the three-dimensional space coordinate of the original point at the current moment; according to the position relationship between a target object and the initially defined original point and the three-dimensional space coordinate of the original point at the current moment, the position information of the target object at the current momentis obtained; finally, gesture information and position information are used as a pose tracking result of the target object, the pose tracking result is combined with a real scene to generate a surgerynavigation image. By use of the scheme, the position accuracy of a surgery tool in the real scene in the surgery navigation image can be improved.

Description

technical field [0001] The invention relates to the field of augmented reality technology, in particular to a method and system for displaying surgical navigation images based on augmented reality. Background technique [0002] In modern surgery, medical images generated by methods such as nuclear magnetic resonance can distinguish lesions from healthy tissues. On this basis, using tracking technology to track surgical tools and combining tracking information with medical images can generate dynamic real-time surgical navigation images. The surgical navigation image can guide the doctor to adjust the position of the surgical tool in real time during the operation to achieve the purpose of resecting the lesion. Using the augmented reality display method, the surgical navigation image can be directly displayed in the doctor's field of view. [0003] At present, the optical tracking system is mainly used to track the surgical tools in real time. In the optical tracking system,...

AI Technical Summary

Problems solved by technology

[0003] At present, the optical tracking system is mainly used to track the surgical tools in real time. In the optical tracking system, since the reference marker plate corresponding to the world coordinate system remains stationary, it is still difficult to avoid the camera installed on the doctor's head and the The occlusion problem between the reference mark boards fixed on the patient's body makes it impossible to accurately obtain the position information and attitude information of the surgical tool, and thus cannot accurately feed back the surgical navigation image to the user

Images