Head-mounted visual accurate aiming system

Abstract

The invention provides a head-mounted visual accurate aiming system. A visual aiming control technology is fused with a target detection method based on deep learning, so that accurate visual aiming can be carried out. The method comprises the following steps: a human eye detection and fixation point output module obtains real-time fixation point coordinates and sends the real-time fixation pointcoordinates to a data fusion processing module; a deep learning target detection module detects targets in a visual field scene image in real time based on a deep learning target detection model obtained through training, marks the detected targets in the visual field scene image in the form of candidate target boxes and then sends the targets to a head-mounted device; meanwhile, the deep learningtarget detection module sends the bounding box information of each candidate target to the data fusion processing module; and the data fusion processing module obtains the position coordinates of a selected target and the aiming tracking servo control quantity for tracking the selected target according to the received fixation point coordinates and the bounding box information of each candidate target, and controls a servo holder to perform aiming tracking on the selected target.

Description

Technical field [0001] The invention relates to an aiming system, in particular to a system capable of precise visual aiming, and belongs to the technical field of visual aiming of head-mounted devices. Background technique [0002] At present, about 44 eye tracker research and development and production units in the world are developing head-mounted eye movement detection equipment. Among them are the American ASL Applied Science Laboratory, the Canadian SR Institute of Science, the German SMI Sensor Sports Instrument Company and the Tobii eye tracker company in Sweden. These eye movement detection devices can basically collect the corresponding data of the human eye, and apply the collected data to relevant research fields. Domestic related research fields have introduced some desktop and head-mounted eye movement devices to further develop their own eye movement measurement and gaze tracking systems. These eye tracking devices are used in psychology, behavioral science, and ...

AI Technical Summary

Problems solved by technology

[0006] (1) Due to the physiological characteristics of the human eye, in the process of gazing, the human eye trembles, etc., the fixation point data solved also has certain fluctuations, which affects the actual fixation accuracy;

[0007] (2) The actual gaze accuracy of the existing eye-tracking equipment can only reach 0.5°~1°, or even greater than 1°. It is difficult to apply the gaze point data to the servo control of the pan / tilt. Realize the precise control of the servo motion of the pan / tilt;

[0008] (3) The target detection method based on deep learning can accurately detect the target, but for the detection of multiple targets of the same type in the scene, it is not possible to selectively and distinguishably detect a specific target of the same type

Images