Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Gaze point estimation method and system, storage medium and terminal

A gaze point and gaze direction technology, applied in the field of gaze point estimation, can solve problems such as gaze point prediction errors, achieve the effects of reducing specular reflection, enhancing robustness, and improving estimation accuracy

Inactive Publication Date: 2019-03-01
SHANGHAI TECH UNIV
View PDF4 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, since the gaze direction is usually not perpendicular to the screen, even the same gaze direction error still results in different gaze point prediction errors along different directions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gaze point estimation method and system, storage medium and terminal
  • Gaze point estimation method and system, storage medium and terminal
  • Gaze point estimation method and system, storage medium and terminal

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] Embodiments of the present invention are described below through specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific implementation modes, and various modifications or changes can be made to the details in this specification based on different viewpoints and applications without departing from the spirit of the present invention.

[0046] It should be noted that the diagrams provided in this embodiment are only schematically illustrating the basic idea of ​​the present invention, and only the components related to the present invention are shown in the diagrams rather than the number, shape and shape of the components in actual implementation. Dimensional drawing, the type, quantity and proportion of each component can be changed arbitrarily during actual impleme...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a gaze point estimation method and system, a storage medium and a terminal, comprising the following steps: acquiring binocular images and binocular coordinates from multiple and single angles of view; extracting eye features based on the multi-view and single-view binocular images and the binocular coordinates; training a gaze direction network model based on the eye features of the binocular image of the single angle of view; training a gaze point network model based on eye features of the multi-view binocular images; the acquired binocular images and binocular coordinates are input into the gaze direction network model and the gaze point network model to obtain an estimated gaze direction and gaze point. The gaze point estimation method and system of the invention, the storage medium and the terminal learn the images of the two eyes through the partially shared neural network to obtain the accurate gazing direction and the gazing point, which greatly improvesthe estimation accuracy.

Description

technical field [0001] The present invention relates to the technical field of gaze point estimation, in particular to a gaze point estimation method and system, a storage medium and a terminal. Background technique [0002] Gaze estimation refers to a technology that estimates the direction or position of people's gaze through the information of human eyes or faces. This technique has been widely used in various fields, such as human-computer interaction, visual behavior analysis, and psychological research. Specifically, in human-computer interaction, people can control the movement of the mouse through eyeballs, complete click and page-turning operations by gazing and blinking, and can also be applied to games (such as virtual reality games). In visual behavior analysis, by using an eye tracker developed using gaze estimation technology, one can collect the points of attention of volunteers to analyze the location of their attention (salience). In addition, gaze estimat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/01
CPCG06F3/013
Inventor 高盛华廉东泽
Owner SHANGHAI TECH UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com