32 results about "Selective attention" patented technology

The invention relates to the technical field of video communication, particularly relating to a method for controlling a video code rate based on a vision significance model, wherein the method comprises the following steps: building a significance model for a video image according to the character of the video image and the vision sensing character of human eyes and acquiring a significance areaof a video scene according to the model; improving the existing H.264 frame code rate distribution mechanism according to the size of the significance area of the video scene, and calculating a target bit rate for distributing the current frame; in the macro block-level code rate distribution, building a macro block-level code rate distribution mechanism based on the significance model according to the texture information abundant degree, motion severe degree and significance of a currently coded macro block; and repeating the steps till the current frame is coded completely. According to themethod, the code rate distribution is performed according to a visual selective attention mechanism of the human eyes and the significance of the video scene, the visual coding character of the humaneyes is met, and the high quality of a subjective video image can be acquired under the condition of limited code rate.

The invention discloses a method for predicting visual attention area transfer in gray images, which comprises four steps of: determining leaders, searching followers, calculating significant values and ordering the significant values. The step of determining the leaders is to calculate side potentials of all pixels and determine the leaders in the pixels according to the acquired side potentialsand a threshold value. The step of searching the followers is to determine the followers of each leader in all the pixels according to the connectivity and the similarity to form different areas, wherein each area may comprise more than one leader, but in the actual computer implementation process, the leader following other leaders is regarded as a follower. The step of calculating the significant values is to calculate the obtained areas respectively, and one area corresponds to one significant value. The step of ordering the significant values is to order all the areas according to the magnitude of the significant values and take the front three areas. The method successfully introduces the selective attention function of a human vision system into a computer vision system, and can simulate and predict attention transfer of a human eye view point among different areas.

The invention provides a multi-channel speech enhancement method based on semantic prior selective attention. The method comprises the following steps: picking speech signals from any directions in a reverberant environment by virtue of a multi-microphone array, collecting the multiple paths of speech signals and pre-processing the speech signals; detecting special activation words in the pre-processed speech signals by virtue of an activation word speech recognition model; processing signals which are not cut and include activation word segments, so as to obtain a complete activation word segment; analyzing the activation word segment by virtue of a multi-channel phase difference sound localization method based on reverberation robust, so as to obtain an acoustic wave reaching direction of a target sound source; and enhancing speech in the direction and inhibiting noise from other directions and room reverberation in a remote speak scene, so that enhanced speech in the target direction is obtained. The method provided by the invention is applicable to such occasions as intelligent household electrical appliance, smart home, vehicle-mounted and wearable devices and the like that remote speak type speech input and interaction are required, and the method is especially applicable to complex acoustic noise and interference environment occasions.

A construction method for a deep long short-term memory recurrent neural network acoustic model based on a selective attention principle. Change of an instant function of neurons of an auditory cortex is represented by adding an attention gate (103) unit in the deep long short-term memory recurrent neural network acoustic model, and the attention gate (103) unit is different from other gate units in that: the other gate units correspond to a time sequence on a one-to-one basis, but the attention gate (103) unit shows a short-term plasticity effect, thereby having intervals on the time sequence; extraction of robust features about Cross-talk noise and construction of a robust acoustic model are realized via the recurrent neural network acoustic model obtained by training a large amount of voice data containing the Cross-talk noise, and the purpose of increasing the robustness about the acoustic model can be achieved by restraining the influence of a non-target stream against the extraction of the features; the method can be extensively applied to the field of a plurality of machine learning related to speaker recognition and keyword recognition in voice recognition, human-machine interaction and the like.

A method and apparatus for aiding the vision and motor function of an individual with autism and other complex developmental delays due to the inability to sustain convergence in addition to ocular motor deficiencies. The method allows improved direct midline gaze increasing selective attention with less averted gaze. The method is practiced by the steps of mounting one or more prisms with bases most often nasally of one or both lenses of a pair of glasses. An individual wearing these glasses even while sleeping will awaken to a more normalized and less confusing visual spatial world.

A monitoring device is provided, which includes an inputter configured to receive an input of a plurality of images captured at separate positions and a plurality of sound sources heard at separate positions, a saliency map generator configured to generate a plurality of mono saliency maps for the plurality of images and to generate a dynamic saliency map using the plurality of mono saliency maps generated, a position determinator configured to determine the positions of the sound sources through analysis of the plurality of sound sources, a scan path recognizer configured to generate scan paths of the plurality of images based on the generated dynamic saliency map and the determined positions of the sound sources, and an outputter configured to output the generated scan paths.