Multispectral stereoscopic vision endoscope device and image fusion method

Abstract

The invention discloses a multispectral stereoscopic vision endoscope device and an image fusion method, and belongs to the field of medical devices. The multispectral stereoscopic vision endoscope device comprises a light source part, a camera part, an image processing part and a display part. The image fusion method comprises the steps that 1, images are acquired by an endoscope image acquisition unit; 2, Gaussian pyramids and Laplacian pyramids are built separately; 3, all layers except the top layers of the Laplacian pyramids of the near infrared image and the green image are processed andfused; 4, near infrared pyramid top-layer images are subjected to target area segmentation; 5, top-layer green images and the top-layer near infrared images are processed and fused; 6, bottom-layer green images are reconstructed according to the Laplacian pyramids obtained after fusion; 7, the reconstructed green images are combined with other channels to obtain final fusion images; and 8, the two fusion images are processed through an anaglyph shifting method to generate a stereoscopic image pair. According to the method, real three-dimensional structure information is obtained.

Description

technical field [0001] The invention discloses a multispectral endoscope device and an image fusion method, in particular to a multispectral endoscope device and an image fusion method based on binocular stereo vision, and belongs to the field of medical equipment. Background technique [0002] Endoscope is an optical instrument composed of cold light source lens, fiber optic wire, image transmission system, screen display system, etc., which can expand the surgical field of view. The outstanding advantages of endoscope are flexible and easy operation, small surgical incision, mild postoperative reaction, and can improve the doctor's ability to diagnose and treat. Therefore, it has been widely used in clinical diagnosis, treatment, and monitoring of pathogenesis and pathological changes. [0003] Traditional endoscopes observe structural images at the level of tissues and organs, and cannot realize functional imaging of blood vessels, lymphatic vessels, tumors, etc. in the...

AI Technical Summary

Problems solved by technology

[0004] The problem to be solved by the present invention is to overcome the deficiency that the two-dimensional plane images obtained in the working process of the traditional multispectral endoscope cannot reflect the stereoscopic information, and provide a multispectral stereoscopic vision endoscope device and image fusion method, so that the obtained The information reflected in the image is more comprehensive, thereby improving the precision and accuracy of the doctor's operation and reducing the occurrence of mistakes

Images