Intelligent operation auxiliary system based on virtual reality and augmented reality

Abstract

The invention discloses an intelligent operation auxiliary system based on virtual reality and augmented reality. The intelligent operation auxiliary system comprises a data preprocessing unit (1), a preoperative planning unit (2) and an intranperative auxiliary unit (3), and the data preprocessing unit rebuilds a three-dimensional focus model through an original CT / MRI image; the preoperative planning unit builds a virtual image studio through virtual reality equipment, loads the three-dimensional focus model for a user to go deep inside the lesion organ to make an operation scheme plan, and exports a three-dimensional planning model; the intranperative auxiliary unit calls the three-dimensional planning model through augmented reality equipment to obtain space characteristic points of the three-dimensional planning model, conducts registration and fusion on a real focus part, helps a doctor to recognize a dissection structure, displays an operation scheme decision and quantifies physiological data at the same time at the same time to execute an intranperative plan. The intelligent operation auxiliary system based on the virtual reality and the augmented reality solves the problems that the dissection structure is difficult to recognize and intranperative real-time navigation is lacking, and the success rate of a surgical operation is increased.

Description

technical field [0001] The invention belongs to the field of electronic technology, and further relates to an intelligent operation assistance system, which can be used in medical imaging platforms and operation assistance systems. Background technique [0002] Clinical surgery is an important means of diagnosis and treatment in modern medicine. At present, the implementation plan of complex surgery mainly relies on three-dimensional medical images such as nuclear magnetic resonance and computer tomography to formulate. However, after clinical surgery, due to physiological factors such as blood flow and organ occlusion, the doctor's surgical field of view is relatively limited, and the scene seen during the operation is often bloody and bloody. In addition, the shape of the lesion often changes during the operation, and the vascular structure has complex distortions. Difficult to identify visually. The medical imaging equipment equipped in the operating room is complicated ...

AI Technical Summary

Problems solved by technology

[0008] First, 3D rendering and deformation of the shooting scene can only restore the surface conditions of equipment or lesions, and cannot go deep into the distorted physiological structure to provide physiological information at any angle and in real time;

[0009] Second, users cannot quickly perform human-computer interaction, and it is difficult to achieve real-time and effective navigation during surgery. They can only correct their actions from the information fed back by the machine, which has a certain lag and cannot order the machine to reach the doctor himself. The most desired effect during the operation;

[0010] Third, it only captures the information of simple peripherals such as cameras and surgical equipment, and the auxiliary functions that can be provided are relatively simple, and cannot directly provide quick guidance on the patient's own condition, so that the complete process of preoperative planning, intraoperative operation, and surgical training To some extent there is a fault

Images