Tongue image data analysis method based on strong supervision algorithm and deep learning network

Abstract

The invention discloses a tongue image data analysis method based on a strong supervision algorithm and a deep learning network. According to the method, a YOLO network technology and a Bilinear network technology are combined together; a bounding box of the tongue region is predicted through a YOLO network; then, the image output by the YOLO network is processed by using a Bilinear network; the prediction of the tongue image characteristics is output; finally, the Bilinear network is transplanted into a mobile phone (Iphone and Android) and a server, and the mobile phone is connected with theserver. And the characteristics predicted by the Bilinear network are compared with a built-in symptom database to finish judgment of the tongue image characteristics and symptoms, and finally healthsuggestions and suggestions for the tongue image patient are proposed at the user terminal. The result provides a certain health consultation effect for the user, can help doctors to know and analyzethe condition of the patient to a great extent, and can also be applied and guided in the future life of the patient.

Description

technical field [0001] The invention relates to the field of deep learning networks based on strong supervision algorithms, in particular to a tongue image data analysis method based on strong supervision algorithms and deep learning networks. Background technique [0002] In traditional Chinese medicine, tongue diagnosis refers to a diagnostic method to understand the physiological functions and pathological changes of the human body by observing the changes in the body's tongue quality, tongue coating, and sublingual veins. TCM tongue diagnosis diagnoses patients’ diseases by observing the surface of the tongue. The tip of the tongue corresponds to the heart and lungs, the side of the tongue corresponds to the liver and gallbladder, the middle of the tongue corresponds to the spleen and stomach, and the root of the tongue corresponds to the kidneys. Tongue quality and tongue coating are the main observation objects of TCM tongue diagnosis. Tongue quality refers to the musc...

AI Technical Summary

Problems solved by technology

[0003] Tongue diagnosis is an important part of traditional Chinese medicine diagnosis. The traditional tongue diagnosis only relies on the subjective observation of doctors to draw conclusions, which vary from person to person and from time to time. There is no objective basis, and the diagnosis results will be affected by subjective factors.

And it is impossible to quantitatively analyze the tongue coating and tongue quality, and the diagnosis result is not convincing

At present, tongue image samples are mainly collected through manual observation, which will consume a lot of manpower. In recent years, people have developed different types of tongue image collection and analysis instruments, including small handheld tongue image analyzers, distributed tongue image analysis instrument, integrating sphere tongue image analyzer, etc., and the current medical field has carried out a lot of explorations on the relationship between different systemic diseases and tongue image

Images