An operation area three-dimensional reconstruction method and system in a microsurgery imaging process

Abstract

The invention discloses an operation area three-dimensional reconstruction method and system in a microsurgery imaging process. The method comprises the following steps: constructing a three-dimensional point cloud data set of a surgical instrument; constructing a convolutional neural network; obtaining a mask image of the surgical instrument in the surgical area according to the pixel-level segmentation image of the surgical instrument in the surgical area; correcting a highlight area in the viewpoint image to obtain a weak highlight or non-highlight operation scene microscopic image; obtaining weak highlight or non-highlight operation scene microscopic images IrL and IrR of the left viewpoint and the right viewpoint of the microsurgery imaging equipment respectively; acquiring depth information of the operation scene, and performing three-dimensional point cloud reconstruction according to the depth information to obtain an operation area three-dimensional point cloud reconstructionresult under the microoperation imaging equipment; recovering point cloud images of all surgical instrument forms in the current surgical area according to the mask pattern of the surgical instrumentin the surgical area and the three-dimensional point cloud data set of the surgical instrument; and constraining a three-dimensional point cloud reconstruction result of the operation area. The problems that the whole image is seriously distorted and the reconstruction effect is poor due to surgical instruments in surgical area three-dimensional reconstruction in the surgical microimaging processare solved.

Description

technical field [0001] The invention relates to the technical field of computer vision, in particular to a method and system for three-dimensional reconstruction of an operation area in the imaging process of microsurgery. Background technique [0002] Microsurgical imaging equipment has been promoted and used in many clinical departments such as ophthalmology, otolaryngology, and neurosurgery. It not only solves the requirement of traditional microsurgery for the surgeon's forced posture, but also enables the surgeon to perform real-time operations on the digital display screen. Surgical operations also provide feasibility for the subsequent development of digital, intelligent and refined surgery. With the development of intelligent and minimally invasive surgery, more and more information is obtained in the process of digitization of surgical scenes. [0003] The existing microsurgical imaging equipment can obtain the 3D reconstruction model of the microsurgical area by m...

AI Technical Summary

Problems solved by technology

[0004] To this end, the present invention provides a method and system for three-dimensional reconstruction of the surgical area in the process of microsurgical imaging, which solves the problem of severe distortion of the entire image caused by surgical instruments in the three-dimensional reconstruction of the surgical area during the surgical microscopic imaging process, and the problem of poor reconstruction effect , improve the overall reconstruction accuracy of the 3D reconstruction of the operation area, and better restore the 3D reconstruction model of the operation area

Images