Brain CT medical report automatic generation method based on weak supervision attention

Abstract

The invention provides a method for automatically generating a brain CT medical report based on weak supervised attention, relates to the three fields of medical images, computer vision and natural language processing, and designs a weak supervised attention mechanism WGAM to clearly guide an attention model to focus on a focus region so as to improve the accuracy of medical report generation. WGAM is a hierarchical structure and comprises two attention mechanisms of space attention and sequence attention, and the space attention is weakly supervised by a gradient weighted class activation mapping algorithm to obtain a better attention effect. A keyword-driven interactive loop network KIRN is designed as a language generation module to generate a brain CT medical report, a hidden layer state of the language generation module is activated through keyword information containing focus position information, and the accuracy of generating a brain CT image report is improved through dynamic interaction of LSTMword and LSTMsen. According to the method, the work of automatically generating the brain CT medical report is explored for the first time, and effectiveness is achieved.

Description

technical field [0001] The invention relates to three fields of medical images, computer vision and natural language processing. Aiming at the goal of automatically generating brain CT medical reports, a method for automatically generating brain CT medical reports based on weakly supervised attention is designed. Background technique [0002] Nowadays, medical imaging technology is indispensable in actual treatment. Many diseases require patients to take medical images and be diagnosed by doctors before they can be diagnosed and treated. In many countries, radiologists may need to read hundreds of radiology images every day and write up reports of their diagnoses. It takes 5-10 minutes for doctors to diagnose medical images and input the analysis results of each image into the computer, which takes up most of their energy and time. [0003] Among many medical imaging techniques, brain imaging (brain CT) can be used to diagnose many cerebrovascular diseases, such as cerebral...

AI Technical Summary

Problems solved by technology

Therefore, without introducing any prior knowledge, it is extremely difficult to let the model learn to assign greater attention weights to these small lesion regions through the gradient descent method.

Images