Augmented reality navigation method and system for minimally invasive total knee replacement surgery

Abstract

Disclosed are an augmented reality navigation method and system for minimally invasive total knee replacement surgery. The method comprises: obtaining a first relationship between a world coordinate system of a virtual space corresponding to a HoloLens application program and a coordinate system of a real scene; matching, on the basis of spatial transformation, an intraoperative knee joint point cloud with a preset 3D model point cloud, to obtain a second relationship between a preoperative medical image spatial coordinate system and a binocular camera coordinate system; and superimposing, according to the first relationship and the second relationship, virtual femur and tibia models and a corresponding surgical guide model under a HoloLens view to realize augmented reality navigation. This method can realize semi-automatic calibration of the HoloLens virtual space coordinate system, and combines image registration technology to accurately superimpose a virtual knee joint anatomical model and the virtual surgical guide model to a corresponding real affected position, thereby providing a doctor with intuitive and accurate intraoperative image guidance.

Description

technical field [0001] The invention relates to the technical field of minimally invasive surgery, in particular to an augmented reality navigation method and system for minimally invasive total knee replacement surgery. Background technique [0002] Knee replacement surgery is to remove the worn-out knee joint surface and replace it with a joint surface made of metal, polyethylene and other materials, so as to relieve pain and improve knee joint function. TKA (Total Knee Arthroplasty, total knee arthroplasty) is an important way to treat knee joint diseases at present. The structure of the knee joint is complex, the operating space is narrow, and there are important blood vessels and nerves around it. Traditional open surgery is likely to cause massive bleeding and various complications. On the contrary, MIS-TKA (Minimally Invasive Total Knee Arthroplasty, minimally invasive total knee arthroplasty) has gradually become the mainstream development trend of TKA surgery due t...

AI Technical Summary

Problems solved by technology

[0005] Existing studies are mainly divided into three categories: one is to directly display the virtual model outside the body of the patient for the doctor's reference only, which is of little significance in actual clinical application; Manually adjust the pose of the virtual model until it coincides with the surgical site, but this method is inconvenient to operate, takes a lot of time, and it is difficult to guarantee the display accuracy; the third is to obtain images through the webcam on HoloLens, using monocular vision and image The recognition technology determines the relationship between the coordinate systems, but because the relative positions of the image acquired by the webcam and the virtual and real scene seen by the person wearing HoloLens are not the same, although the final augmented reality effect is correct in the image acquired by the webcam, However, in the eyes of the wearer of HoloLens, there is a certain deviation between the virtual model and the actual position of the affected part

Images