Virtual endoscope display method based on VR/AR combined digital lung technology

Abstract

The invention discloses a virtual endoscope display method based on a VR / AR combined digital lung technology. The method comprises the following specific steps of: (1) performing thin-layer CT scanning through AI and an image omics technology to obtain CT data; (2) performing segmentation calculation on tissues and organs of the chest and lung through the digital lung technology according to the obtained CT data to construct a lung and bronchus 3D model based on reality; and (3) transmitting the 3D model to an AR endoscope, realizing non-invasive, efficient and safe path planning and virtual roaming of a virtual bronchoscope through a holographic projection technology, or realizing remote real-time guidance and consultation through an Internet 5G technology by the 3D model, and projectingthe 3D model to a computer terminal to share intraoperative operation in real time. By applying the method, abnormal or existing nodules of lung and bronchus structures can be displayed, lesions can be further accurately positioned, preoperative path planning can be realized, certain intraoperative related data parameters can be measured, and assistance can be provided for diagnosis and treatmentof diseases.

Description

technical field [0001] The invention belongs to the field of medical technology, and in particular relates to a virtual endoscope display method based on VR / AR combined digital lung technology. Background technique [0002] AR (Augmented Reality), augmented reality technology is a technology that ingeniously integrates virtual information with the real world. It widely uses various technical means such as multimedia, 3D modeling, real-time tracking and registration, intelligent interaction, and sensing. The generated text, images, 3D models, music, video and other virtual information are simulated and applied to the real world, and the two kinds of information complement each other, thereby realizing the "enhancement" of the real world. [0003] VR (Virtual Reality), virtual reality technology, also known as spiritual technology or artificial environment. The concept was put forward in the early 1980s, which specifically refers to a new means of human-computer interaction c...

AI Technical Summary

Problems solved by technology

However, it does not solve the problem of representing the navigation information of the virtual stereoscopic endoscope corresponding to the stereoscopic endoscope, and does not effectively combine the spatial information of 3D medical images such as CT with the spatial information of the stereoscopic endoscope.

There is also the inability to realize real-time Internet sharing, remote consultation and real-time guidance

Images