Augmented reality navigation method for minimally invasive total knee arthroplasty and system thereof

Abstract

The invention discloses an augmented reality navigation method and a system for minimally invasive total knee arthroplasty. The method includes: obtaining a first relationship between a world coordinate system of a HoloLens application program corresponding to a virtual space and a coordinate system of a real scene; matching the knee point cloud and the preset three-dimensional model point cloud according to spatial alternation during operation to obtain a second relationship between a preoperative medical image space coordinate system and a binocular camera coordinate system; and superimposing virtual femur, tibia model and corresponding surgical guide model under Hollens field of vision according to the first relationship and the second relationship so as to realize augmented reality navigation. The method can help realize semi-automatic calibration of Hollens virtual space coordinate system, and combines the image registration technology to accurately superimpose the virtual knee anatomical model and the virtual surgical guide model to a corresponding real affected part location, thus providing doctors with intuitive and accurate intraoperative images guide.

Description

Technical field [0001] The invention relates to the technical field of minimally invasive surgery, in particular to an augmented reality navigation method and system for minimally invasive total knee replacement surgery. Background technique [0002] Knee replacement surgery is to remove the worn knee joint surface of the pad and replace it with a joint surface made of metal, polyethylene and other materials to relieve the patient's pain and improve the function of the knee joint. TKA (Total Knee Arthroplasty, total knee arthroplasty) is currently an important way to treat knee joint diseases. The structure of the knee joint is complex, the operation space is small, and there are important blood vessels and nerves around it. Traditional open surgery is likely to cause hemorrhage and many complications. In contrast, MIS-TKA (Minimally Invasive Total Knee Arthroplasty) has gradually become the mainstream development trend of TKA surgery due to its advantages such as small wounds. ...

AI Technical Summary

Problems solved by technology

[0005] Existing studies are mainly divided into three categories: one is to directly display the virtual model outside the body of the patient for the doctor's reference only, which is of little significance in actual clinical application; Manually adjust the pose of the virtual model until it coincides with the surgical site, but this method is inconvenient to operate, takes a lot of time, and it is difficult to guarantee the display accuracy; the third is to obtain images through the webcam on HoloLens, using monocular vision and image The recognition technology determines the relationship between the coordinate systems, but because the relative positions of the image acquired by the webcam and the virtual and real scene seen by the person wearing HoloLens are not the same, although the final augmented reality effect is correct in the image acquired by the webcam, However, in the eyes of the wearer of HoloLens, there is a certain deviation between the virtual model and the actual position of the affected part

Images