Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Intraoperative position navigation system, device and method based on mixed reality

A navigation system and mixed reality technology, applied in the field of surgical simulation, can solve the problems of lack of corresponding systems, devices and methods in application and teaching, and achieve the effects of short anesthesia time, less trauma and quick recovery

Pending Publication Date: 2020-11-27
FIRST PEOPLES HOSPITAL OF YUNNAN PROVINCE +2
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] To sum up, the disadvantages of the existing technology are: the current mixed reality technology cannot be fully applied in surgery, and there is a lack of corresponding systems, devices and methods for intraoperative application and teaching based on mixed reality

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intraoperative position navigation system, device and method based on mixed reality
  • Intraoperative position navigation system, device and method based on mixed reality
  • Intraoperative position navigation system, device and method based on mixed reality

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0045] Such as figure 1 shown

[0046] A mixed reality based intraoperative positional navigation system including:

[0047] Image processing module: used to identify internal organs and blood vessels after importing CT images, and generate three-dimensional images;

[0048] 3D fusion control module: used to deeply fuse the constructed 3D model with real-time collected image data, and dynamically update the display in real time;

[0049] Signal collection module: used to collect video signals and transmit them to the 3D fusion control module;

[0050] Screen recording module: used to record screen recording augmented reality images;

[0051] Computer module: adopts the traditional X64 framework, integrates display, input, and storage, and is used to integrate the functions of each module and realize functional operations;

[0052] Peripheral module: used to connect peripheral devices.

[0053] The above-mentioned intraoperative position navigation system based on mixed real...

Embodiment 2

[0060] An intraoperative navigation device based on a mixed reality intraoperative position navigation system;

[0061] The intraoperative navigation device includes a computer, a high-definition digital camera, an image acquisition card, projection display equipment and peripheral equipment;

[0062] Described computer adopts traditional X64 frame PC / notebook / all-in-one machine, and described high-definition digital camera adopts HDR-CX405 high-definition digital video camera and auxiliary bracket, and described image acquisition card is connected to realize the data transmission of high-definition digital camera and computer, and described projection display The device is a DellP2719H monitor.

Embodiment 3

[0064] An intraoperative location navigation method based on a mixed reality intraoperative location navigation system;

[0065] The intraoperative position navigation method based on the mixed reality intraoperative position navigation system includes the following steps:

[0066] Step 1: Connect and debug the intraoperative position navigation system and the hardware and software equipment in the device;

[0067] Step 2: The image processing module is used to import the CT image to identify the viscera and blood vessels in the cavity, generate a three-dimensional image or directly select the established three-dimensional image model;

[0068] Step 3: Collect the video signals of the corresponding cavity mirror and imaging equipment through the signal acquisition module, and input them into the computer for deep fusion with the acquired 3D model through the 3D fusion control module;

[0069] Step 4: The deeply fused image is dynamically displayed and stored by the computer; ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an intraoperative position navigation system, device and method based on mixed reality. The intraoperative position navigation system comprises an image processing module, a 3Dfusion control module, a signal acquisition module, a screen recording module, a computer and a peripheral module, video signals are acquired through the signal acquisition module and transmitted tothe 3D fusion control module. The 3D fusion control module performs real-time dynamic deep fusion on the three-dimensional model and the image data acquired in real time, the computer module performsdisplay, input and storage, and the screen recording module records an augmented reality image; and according to the intraoperative position navigation system based on mixed reality, intraoperative endoscope signals are deeply fused, data are dynamically reconstructed in real time, so that intraoperative navigation and positioning are achieved, risks and complications are reduced, and meanwhile teaching is conducted through real-time video recording.

Description

technical field [0001] The present invention relates to the technical field of surgery simulation, in particular to an intraoperative position navigation system, device and method based on mixed reality. Background technique [0002] Since the 20th century, minimally invasive surgery technology represented by laparoscopic technology has developed rapidly. Compared with traditional surgery, minimally invasive surgery has the advantages of less trauma, faster recovery, and shorter anesthesia time. Therefore, minimally invasive surgery has been widely used. And development. However, due to the characteristics of minimally invasive surgery itself, doctors can only see the local conditions in the patient's body through the endoscope, which greatly increases the difficulty of surgery for doctors, and the dependence on experience is higher than traditional surgery. For doctors, preoperative planning is very important. [0003] Mixed Reality (MR, MixedReality) refers to a new visu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T19/00G06T7/00G16H30/40A61B34/20A61B34/10A61B34/00
CPCG06T19/006G06T7/0012G16H30/40A61B34/10A61B34/20A61B34/25
Inventor 王峻峰李伟彭方成晋云先洪玉唐继
Owner FIRST PEOPLES HOSPITAL OF YUNNAN PROVINCE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products