Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Gastric cancer TNM staging prediction system based on multi-modal deep learning

A deep learning and prediction system technology, applied in the field of medical artificial intelligence, can solve problems such as insufficient processing tasks, and achieve the effect of reducing the workload of reading images and improving medical interpretability

Pending Publication Date: 2022-03-11
ZHEJIANG UNIV
View PDF2 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] However, in reality, models based on a single modality (e.g., text, image) may not be sufficient for the task

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gastric cancer TNM staging prediction system based on multi-modal deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be noted that the following embodiments are intended to facilitate the understanding of the present invention, but do not limit it in any way.

[0030] A gastric cancer TNM staging prediction system based on multimodal deep learning, comprising a computer memory, a computer processor, and a computer program stored in the computer memory and executable on the computer processor, the computer memory is stored with a data acquisition module, an image Preprocessing module, text preprocessing module, predictive model training module and prediction module. The specific application process of each module is introduced in detail below.

[0031] 1. Data acquisition module

[0032] The desensitized data of 284 patients with gastric cancer in the imaging department of the hospital were collected. In addition to computed tomography (CT) images, the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a gastric cancer TNM staging prediction system based on multi-modal deep learning, which comprises a data acquisition module, an image preprocessing module, a text preprocessing module, a prediction model training module and a prediction module, and the application of the modules comprises the following steps: acquisition and data cleaning of CT image and text data; preprocessing the CT image, extracting mark data, establishing a mask image, and multiplying the mask image with an original image to obtain an effective identification area; performing pre-training on the text data by utilizing XGBoost and LightGBM algorithms in machine learning to obtain a feature importance sequence so as to obtain an effective data sample; and deep learning is performed on the deep and shallow level features of the image and text data, and training is performed by using a convolutional neural network to obtain a classification result of a correct TNM period. Compared with traditional artificial identification, the method has more modal reference bases, has very high identification accuracy, can reduce the business burden of professional doctors, and solves the current situation of unbalanced medical resources in China.

Description

technical field [0001] The invention belongs to the field of medical artificial intelligence, and in particular relates to a gastric cancer TNM staging prediction system based on multimodal deep learning. Background technique [0002] Gastric cancer (GC) has a high incidence in East Asia and remains the fifth most common malignancy and the third leading cause of cancer death worldwide. Accurate tumor local depth invasion (T), local lymph node invasion (N) and distant metastasis (M) are the key to the treatment strategy. In clinical practice, computed tomography (CT) has been widely used in preoperative staging. However, the accuracy of preprocessing staging is not satisfactory. Currently, CT images of gastric cancer are manually evaluated by radiologists. Accurate TNM staging of gastric cancer is an important and challenging task for radiologists. In a recent study, the accuracy of CT for T and N staging was 60%-78% and 56%-75.9%, respectively. The poor resolution of CT...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G16H50/20G16H10/20G06K9/62G06V10/80G06F16/35G06T7/00G06T7/13G16H30/20G06V10/764G06V10/82G06N3/04G06N3/08G06N20/20
CPCG16H50/20G16H10/20G06F16/35G06T7/0012G06T7/13G16H30/20G06N3/08G06N20/20G06T2207/10081G06T2207/30004G06N3/045G06F18/24G06F18/253
Inventor 吴健陈潇俊余日胜沈可人应豪超
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products