The invention discloses a self-adapting sightline
tracking system and a tracking method. A
human eye image is collected to a computer by a
charge coupled device (CCD) camera, and eye
fixation point coordinates can be obtained through steps of image preprocessing,
pupil periphery point extracting,
ellipse fitting and the like. A theoretical model and an experimental device of the self-adapting sightline
tracking system are set up, wherein the theoretical model and the experimental device are combined with
software and hardware and are suitable for the condition that the head rotates, and high-precision sightline tracking under a non-interfering condition for a user is achieved. In order to overcome affection of movements of the head in sightline tracking technology, the self-adapting sightline tracking method based on multi-scale
geometric analysis and faced with the condition of
head moving is utilized. A multi-scale
geometric analysis tool is introduced to the field of sightline tracking, a high-precision detecting
algorithm of image characteristics of human eyes and faces based on Directionlet change is utilized so as to improve detecting efficiency and precision of
human eye edges. A neural network and a
genetic algorithm are combined so as to study the relation of the image characteristics of the human eyes and the faces and nonlinear mapping of eye fixation points and raise a new method of sightline
direction detection.