Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Eyeball motion segmentation positioning method based on cyclic residual convolutional neural network

A convolutional neural network and eye movement technology, which is applied in neural learning methods, biological neural network models, neural architectures, etc., can solve problems such as inconvenient clinical applications, and achieve the effects of avoiding gradient disappearance, stable technical performance, and deepening network structure

Active Publication Date: 2022-07-01
ZHEJIANG UNIV
View PDF8 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this technology cannot avoid image matching errors, which causes inconvenience in clinical application.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Eyeball motion segmentation positioning method based on cyclic residual convolutional neural network
  • Eyeball motion segmentation positioning method based on cyclic residual convolutional neural network
  • Eyeball motion segmentation positioning method based on cyclic residual convolutional neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] The present invention will be further described below in conjunction with the embodiments.

[0057] The embodiment of the present invention and its implementation process are as follows:

[0058] Step 1: Collect the eye position photos of 207 normal people (414 eyes) who visited the eye center of a hospital from November 2020 to April 2021.

[0059] The subjects included 88 men and 119 women, aged 5 to 60 years, with a mean age of 23.2±12.9 years. A circular marker (red, 10 mm in diameter) was pasted on the subject's forehead. Under the same lighting conditions, a Canon 1500D camera was used to take a photo of a normal person looking at nine eye positions (resolution of 6000×4000 pixels): including the first eye position (looking straight ahead), the second eye position (horizontal to the left) or right gaze, vertical up or down gaze), and third eye position (top right, top left, bottom right, bottom left direction gaze). eye position photo attached figure 1 shown....

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an eyeball motion segmentation positioning method based on a cyclic residual convolutional neural network. Acquiring an eye position picture of a testee, inputting the eye position picture into the first-stage cyclic residual convolutional neural network model, and processing the eye position picture to obtain a rotated eye position picture; inputting the first-stage cyclic residual convolutional neural network model again to obtain a binary mask, cutting to obtain left and right eye detection area pictures, and inputting a second-stage cyclic residual convolutional neural network model to detect to obtain eyelid and cornea masks of the two eyes; obtaining a proportional scale according to the circular mark on the forehead; the eye position image is processed by the eyelid cornea mask to measure the eyeball movement, the pixel distance of the six extraocular muscle functions is obtained, and the actual size value is obtained through conversion. According to the method, the technical performance is stable, the segmentation accuracy is high, eyeball movement can be rapidly and automatically detected, errors caused by manual measurement are avoided in a computer-assisted image processing mode, and therefore the accuracy and objectivity of eye muscle disease diagnosis are improved. The invention also provides possibility for physical examination screening, telemedicine and the like.

Description

technical field [0001] The invention relates to an eye image processing method, in particular to an eye movement segmentation and positioning method based on a cyclic residual convolutional neural network. Background technique [0002] Clinically, accurate assessment of eye movements is very important for the diagnosis of ocular muscle-related diseases, especially noncommon strabismus. The movement of the extraocular muscles is very complex, and the extraocular muscles play a synergistic or antagonistic role. For the convenience of diagnosis, the eye position that can display the main action of an extraocular muscle without combining its secondary actions is specified, which is called the diagnostic eye position. The six diagnostic eye positions correspond to the six extraocular muscles (two horizontal rectus muscles + two vertical rectus muscles + two oblique muscles). In clinical practice, doctors usually use qualitative methods to subjectively judge the degree of hypera...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06V40/18G06V10/22G06V10/26G06V10/82G16H40/20G06N3/04G06N3/08
CPCG06N3/088G16H40/20G06N3/044G06N3/045
Inventor 楼丽霞叶娟王亚奇黄星儒孙一鸣杨泽华
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products