3054 results about "Binoculars" patented technology

A binocular viewer, a method of measuring and training vision that uses a binocular viewer and a vision measurement and training system that employs a computer to control the binocular viewer. In one embodiment, the binocular viewer has left and right display elements and comprises: (1) a variable focal depth optical subsystem located in an optical path between the display elements and a user when the user uses the binocular viewer and (2) a control input coupled to the left and right display elements and the variable focal depth optical subsystem and configured to receive control signals operable to place images on the left and right display elements and vary a focal depth of the variable focal depth optical subsystem. In another embodiment, the binocular viewer lacks the variable focal depth optical subsystem, but the images include at least one feature unique to one of the left and right display elements.

An image processing apparatus includes an image input unit that inputs a two-dimensional image signal, a depth information output unit that inputs or generates depth information of image areas constituting the two-dimensional image signal, an image conversion unit that receives the image signal and the depth information from the image input unit and the depth information output unit, and generates and outputs a left eye image and a right eye image for realizing binocular stereoscopic vision, and an image output unit that outputs the left and right eye images. The image conversion unit extracts a spatial feature value of the input image signal, and performs an image conversion process including an emphasis process applying the feature value and the depth information with respect to the input image signal, thereby generating at least one of the left eye image and the right eye image.

A display unit for binocular representation of a multicolor image including a control unit triggering an imaging element such that the imaging element generates in a temporal successive manner the image to be displayed for a first beam path and a second beam path as a first image and second image, respectively. The images are generated in a pre-distorted manner, opposite of the chromatic aberration of the respective beam path, such that the chromatic aberration generated in the respective beam path is compensated when the first and second image is displayed. The display unit includes a switching module which operates in temporal synchrony with the first and second image being generated, such that a user can see the first image only via the first beam path and the second image only via the second beam path.

An augmented reality system in which video imagery of a physical environment is combined with video images output by a game engine by the use of a traveling matte which identifies portions of the visible physical environment by techniques such as Computer vision or chroma keying and replaces them with the video images output by the video game engine. The composited imagery of the physical environment and the video game imagery is supplied to a trainee through a headmounted display screen. Additionally, peripheral vision is preserved either by providing complete binocular display to the limits of peripheral vision, or by providing a visual path to the peripheral vision which is matched in luminance to higher resolution augmented reality images provided by the binocular displays. A software / hardware element comprised of a server control station and a controller onboard the trainee performs the modeling, scenario generation, communications, tracking, and metric generation.

The invention discloses a service robot control platform system and a multimode intelligent interaction and intelligent behavior realizing method thereof. The service robot control platform system comprises a voice control module, a binocular image acquisition module, an RFID (Radio Frequency Identification Device) receiving and transmitting module, a bottom wheel movement module, an obstacle avoidance module and a mechanical arm control module. The multimode intelligent interaction and intelligent behavior realizing method comprises the following steps of: 1, voice interaction; 2, independent navigation and location; 3, mechanical arm control; and face detection and recognition. According to the invention, a robot carries out intelligent interaction and intelligent behaviors, and the capacity of intelligent grabbing of the robot is enhanced. Except for special person recognition, distinguish of a picture face and an actual face is added, thus the influence to a program by the picture face is effectively eliminated. According to the invention, anthropomorphic mechanical arm grabbing is controlled in a specific anthropomorphic path grabbing manner, so that a service mode of the robot is more intelligent and humanized.

The invention relates to a vision measurement, path planning and GNC integrated simulation system for a space robot, which comprises an image processing and pose measuring module 1, a space robot planning and control module 2, a target controller module 3, a system dynamic model module 4, a system 3D geometric model module 7, a binocular camera simulation imaging module 6, a three-dimensional calibration module 5 and the like. The system integrates image processing and pose measurement, GNC algorithm, path planning, control, dynamics and the like, so that the closed-loop simulation and verification of all key algorithms in the process of tracking, approaching and capturing non-cooperative targets by the space robot can be performed on an independent PC. The system does not need to adopt real measurement equipment, a space robot system and targets, and is low in cost, good in safety and flexibility and easy to implement; and the system is good in expandability, and the closed-loop simulation and verification of cameras (installation positions and viewing angles) and space robots (kinematic and dynamic parameters) with different parameters can be implemented by modifying the parameters.

The invention discloses a machine vision and inertial navigation fusion-based mobile robot motion attitude estimation method which comprises the following steps of: synchronously acquiring a mobile robot binocular camera image and triaxial inertial navigation data; distilling front / back frame image characteristics and matching estimation motion attitude; computing a pitch angle and a roll angle by inertial navigation; building a kalman filter model to estimate to fuse vision and inertial navigation attitude; adaptively adjusting a filter parameter according to estimation variance; and carrying out accumulated dead reckoning of attitude correction. According to the method, a real-time expanding kalman filter attitude estimation model is provided, the combination of inertial navigation and gravity acceleration direction is taken as supplement, three-direction attitude estimation of a visual speedometer is decoupled, and the accumulated error of the attitude estimation is corrected; and the filter parameter is adjusted by fuzzy logic according to motion state, the self-adaptive filtering estimation is realized, the influence of acceleration noise is reduced, and the positioning precision and robustness of the visual speedometer is effectively improved.

The invention discloses a parallax optimization algorithm-based binocular stereo vision automatic measurement method. The method comprises the steps of 1, obtaining a corrected binocular view; 2, matching by using a stereo matching algorithm and taking a left view as a base map to obtain a preliminary disparity map; 3, for the corrected left view, enabling a target object area to be a colorized master map and other non-target areas to be wholly black; 4, acquiring a complete disparity map of the target object area according to the target object area; 5, for the complete disparity map, obtaining a three-dimensional point cloud according to a projection model; 6, performing coordinate reprojection on the three-dimensional point cloud to compound a coordinate related pixel map; 7, using a morphology method to automatically measure the length and width of a target object. By adopting the method, a binocular measuring operation process is simplified, the influence of specular reflection, foreshortening, perspective distortion, low textures and repeated textures on a smooth surface is reduced, automatic and intelligent measuring is realized, the application range of binocular measuring is widened, and technical support is provided for subsequent robot binocular vision.

The invention discloses a binocular stereo vision three-dimensional measurement method based on line structured light scanning, which comprises the steps of performing stereo calibration on binocularindustrial cameras, projecting laser light bars by using a line laser, respectively acquiring left and right laser light bar images, extracting light bar center coordinates with sub-pixel accuracy based on a Hessian matrix method, performing light bar matching according to an epipolar constraint principle, and calculating a laser plane equation; secondly, acquiring a line laser scanning image of aworkpiece to be measured, extracting coordinates of the image of the workpiece to be measured, calculating world coordinates of the workpiece to be measured by combining binocular camera calibrationparameters and the laser plane equation, and recovering the three-dimensional surface topography of the workpiece to be measured. Compared with a common three-dimensional measurement system combininga monocular camera and line structured light, the binocular stereo vision three-dimensional measurement method avoids complicated laser plane calibration. Compared with the traditional stereo vision method, the binocular stereo vision three-dimensional measurement method reduces the difficulty of stereo matching in binocular stereo vision while ensuring the measurement accuracy, and improves the robustness and the usability of a visual three-dimensional measurement system.

In the three-dimensional display, a two-dimensional display section generates a two-dimensional display image based on an image signal, and a lens array converts the wavefront of the display image light from the two-dimensional display section into a wavefront having a curvature which allows the display image light to focus upon a focal point where an optical path length from an observation point to the focal point is equal to an optical path length from the observation point to a virtual object point, so a viewer can obtain information about an appropriate focal length in addition to information about binocular parallax and a convergence angle. Therefore, consistency between the information about binocular parallax and a convergence angle and the information about an appropriate focal length can be ensured, and a desired stereoscopic image can be perceived without physiological discomfort.

The invention provides a calibration method for a binocular stereo measurement system, and belongs to the technical field of measurement and test. The invention adopts a plane calibrating board having a characteristic dot array with an accurate given distance between the centers of two characteristic dots; the calibrating board is shot from more than three angles; initial values of the intrinsic and extrinsic parameters of two cameras are solved by using the linear method under a pinhole model; the distortion effect is considered; the intrinsic and extrinsic parameters of the two cameras are taken as optimization variables for a first optimization; the space coordinates of the centers of the characteristic dots on the calibrating board are taken as optimization variables for a second optimization; the translation vector between the cameras is scaled to the ratio of the calculated distance to the given accurate distance, thus getting a calibration result of the parameters; the result of the second optimization is got by using the intrinsic parameters and the relative attitude parameters of the two cameras. Considering the influence of the geometrical errors of the calibrating board, the method reduces the manufacturing, measurement and calibration requirement of the calibrating board and gets calibration result of high precision.

The invention discloses a three-dimensional enhancing realizing method for multi-viewpoint free stereo display, which comprises the following steps: 1) stereoscopically shooting a natural scene by using a binocular camera; 2) extracting and matching a characteristic point of an image of a main camera, generating a three-dimensional point cloud picture of the natural scene in real time, and calculating a camera parameter; 3) calculating a depth image corresponding to the image of the main camera, drawing a virtual viewpoint image and a depth image thereof, and performing hollow repairing; 4) utilizing three-dimensional making software to draw a three-dimensional virtual model and utilizing a false-true fusing module to realize the false-true fusing of the multi-viewpoint image; 5) suitably combining multiple paths of false-true fused images; and 6) providing multi-viewpoint stereo display by a 3D display device. According to the method provided by the invention, the binocular camera is used for stereoscopically shooting and the characteristic extracting and matching technique with better instantaneity is adopted, so that no mark is required in the natural scene; the false-true fusing module is used for realizing the illumination consistency and seamless fusing of the false-true scenes; and the multi-user multi-angle naked-eye multi-viewpoint stereo display effect is supplied by the 3D display device.

A camera module (170) includes a miniature scanning mirror (120), lens elements (163a to 163d) corresponding to thin lateral lens slices, and a short, wide imaging sensor (165). As the scanning mirror (120) pivots to scan a scene, the imaging sensor (165) captures successive image segments. Multiple image segments are stitched together by software running on a digital processor to provide a complete image. The assembly of lens elements (163a to 163d) may include moveable elements to allow variable focus, variable magnification and image stabilization, and may utilize refraction, reflection, diffraction and / or planar optical elements. The camera module (170) may be less than 5 millimeters thick while allowing long focal length lenses and increased light collecting area. Other embodiments include a switchable scan mirror with two apertures and a dual-camera system that provides binocular images and video.

The invention belongs to the technical field of video monitoring and in particular relates to a human-computer interaction device and a human-computer interaction method adopting human-eye tracking in the video monitoring. The device comprises a non-invasive facial eye image video acquisition unit, a monitoring screen, an eye tracking image processing module and a human-computer interaction interface control module, wherein the monitoring screen is provided with infrared reference light sources around; and the eye tracking image processing module separates out binocular sub-images of a left eye and a right eye from a captured facial image, identifies the two sub-images respectively and estimates the position of a human eye staring position corresponding to the monitoring screen. The invention also provides an efficient human-computer interaction way according to eye tracking characteristics. The unified human-computer interaction way disclosed by the invention can be used for selecting a function menu by using eyes, switching monitoring video contents, regulating the focus shooting vision angle of a remote monitoring camera and the like to improve the efficiency of operating videomonitoring equipment and a video monitoring system.

The invention discloses a vision-inertia integrated SLAM (Simultaneous Localization and Mapping) method based on a genetic algorithm. The method comprises the following steps: integrating a vision navigation coordinate system with an inertia navigation coordinate system, and calibrating parameters of a binocular camera so as to solve a three-dimensional space coordinate according to an image pixel coordinate; independently calculating by inertia navigation; calculating by vision navigation; integrating vision navigation information with inertia navigation information by using an extended Kalman filter, and building a system filter model; and observing global feature point road signs by using the binocular camera by taking localization locality into account, carrying out data association on map features based on the genetic algorithm, and feeding extended state vectors back to a filter. The method is capable of carrying out long-time and high-accuracy localization; the genetic algorithm is added for improving the data association of the map, so that the simultaneous mapping accuracy is greatly improved.

A binocular head mounted display includes a frame, right and left displays, an alignment sensor, and a control system. The right and left displays display right and left images to a user and are mounted to the frame. The alignment sensor includes a first laser source mounted proximate to one of the right or left displays and a first photo-detector array mounted opposite the first laser source and proximate to an opposite one of the right or left displays. The first alignment sensor is mounted to measure misalignment between the right and left displays due to deformation of the frame about one or more rotational axes and to generate a signal that is indicative of the misalignment. The control system is coupled to the alignment sensor to receive the signal and to calculate the misalignment based at least in part upon the signal.

The invention discloses a distance measuring method applying a binocular visual parallax error distance-measuring principle. By means of adopting different base length to adapt to requirements on measurement accuracy of different distance measuring ranges, the distance measuring method is applicable to precise size measurement for short distance and small parts. On the basis of a conventional binocular measuring method, a pair of cameras which are provided with parallel optical axes and positioned side by side are adopted to make two random to-be-measured visualized points in two images into a plane vertical to the two optical axes, depth values of the two to-be-measured points are obtained via a inversely proportional relationship between binocular visual parallax error and depth, distances from the two to-be-measured points to an optic center and angles among the two to-be-measured points and an optical center connection line can be determined according to the depth value of the to-be-measured points and focal length of the cameras, and then the actual distance between the two points can be determined via the cosine law. Compared with conventional methods, the distance measuring method applying the binocular visual parallax error distance-measuring principle has the advantages of simplicity in operation, strong practicability, high precision and easiness in popularization and use.

The invention provides a visual ranging-based simultaneous localization and map construction method. The method includes the following steps that: a binocular image is acquired and corrected, so that a distortion-free binocular image can be obtained; feature extraction is performed on the distortion-free binocular image, so that feature point descriptors can be generated; feature point matching relations of the binocular image are established; the horizontal parallax of matching feature points is obtained according to the matching relations, and based on the parameters of a binocular image capture system, real space depth is calculated; the matching results of the feature points of a current frame and feature points in a world map are calculated; feature points which are wrongly matched with each other are removed, so that feature points which are successfully matched with each other can be obtained; a transform matrix of the coordinates of the feature points which are successfully matched with each other under a world coordinate system and the three-dimension coordinates of the feature points which are successfully matched with each other under a current reference coordinate system is calculated, and a pose change estimated value of the binocular image capture system relative to an initial position is obtained according to the transform matrix; and the world map is established and updated. The visual ranging-based simultaneous localization and map construction method of the invention has low computational complexity, centimeter-level positioning accuracy and unbiased characteristics of position estimation.

The invention discloses a train operation fault automatic detection system and method based on binocular stereoscopic vision, and the method comprises the steps: collecting left and right camera images of different parts of a train based on a binocular stereoscopic vision sensor; achieving the synchronous precise positioning of various types of target regions where faults are liable to happen based on the deep learning theory of a multi-layer convolution neural network or a conventional machine learning method through combining with the left and right image consistency fault (no-fault) constraint of the same part; carrying out the preliminary fault classification and recognition of a positioning region; achieving the synchronous precise positioning of multiple parts in a non-fault region through combining with the priori information of the number of parts in the target regions; carrying out the feature point matching of the left and right images of the same part through employing the technology of binocular stereoscopic vision, achieving the three-dimensional reconstruction, calculating a key size, and carrying out the quantitative description of fine faults and gradually changing hidden faults, such as loosening or playing. The method achieves the synchronous precise detection of the deformation, displacement and falling faults of all big parts of the train, or carries out the three-dimensional quantitative description of the fine and gradually changing hidden troubles, and is more complete, timely and accurate.

An optical relay device, comprising a light-transmissive substrate shaped as a structure having an apex section, a right section and a left section being separated from the right section by an air gap. The optical relay device further comprises at least two input optical elements located at the apex section, a right output optical element located at the right section, and a left output optical element located at the left section. The substrate and the optical elements are designed and constructed such that light is redirected by the input optical elements, propagates via total internal reflection in the direction of at least one of the sections, and redirected out of the substrate by at least one output optical element.

The invention discloses a multi-sensor fusion-based autonomous obstacle avoidance unmanned aerial vehicle system and a control method. The system includes an environment information real-time detection module which carries out real-time detection on surrounding environment through adopting a multi-sensor fusion technology and transmits detected information to an obstacle data analysis processing module, the obstacle data analysis processing module which carries out environment structure sensing construction on the received information of the surrounding environment so as to determine an obstacle, and an obstacle avoidance decision-making module which determines an obstacle avoidance decision according to the output result of the obstacle data analysis processing module, so as to achieve obstacle avoidance of an unmanned aerial vehicle through the driving of power modules which is performed by a flight control system. According to the multi-sensor fusion-based autonomous obstacle avoidance unmanned aerial vehicle system and the control method of the invention, binocular machine vision systems are arranged around the body of the unmanned aerial vehicle, so that 3D space reconstruction can be realized; and an ultrasonic device and a millimeter wave radar in an advancing direction are used in cooperation, so that an obstacle avoidance method is more comprehensive. The system has the advantages of high real-time performance of obstacle detection, long visual detection distance and high resolution.

A general purpose image and visual effects display apparatus, with associated methods, which is comprised of an array of independently angled reflective or refractive elements wherein the varying angle pattern of each element across said array is designed to reflect or refract specifically designed as well as fortuitously located existing colors, in precisely determined patterns, to make apparent to specific viewing or receiving locations a wide range of complex emergent visual and other effects. In some embodiments very high resolution and high color fidelity image display is possible. In other embodiments moving images akin to video can be displayed, using no electronics or moving parts. In other embodiments true binocular 3D images can be displayed directly to viewers, without the need for special 3D viewing glasses. Many of the embodiments and methods are applicable to non-visible light and other reflectable wave-based phenomena.

The invention relates to the technical field of human-machine interaction and provides a human-machine interaction method and a human-machine interaction system based on binocular stereoscopic vision. The human-machine interaction method comprises the following steps: projecting a screen calibration image to a projection plane and acquiring the calibration image on the projection surface for system calibration; projecting an image and transmitting infrared light to the projection plane, wherein the infrared light forms a human hand outline infrared spot after meeting a human hand; acquiring an image with the human hand outline infrared spot on the projection plane and calculating a fingertip coordinate of the human hand according to the system calibration; and converting the fingertip coordinate into a screen coordinate according to the system calibration and executing the operation of a contact corresponding to the screen coordinate. According to the invention, the position and the coordinate of the fingertip are obtained by the system calibration and infrared detection; a user can carry out human-machine interaction more conveniently and quickly on the basis of touch operation of the finger on a general projection plane; no special panels and auxiliary positioning devices are needed on the projection plane; and the human-machine interaction device is simple in and convenient for mounting and using and lower in cost.

The invention belongs to the field vehicle active safety, and particularly discloses a detection method and system, based on laser radar and binocular camera, for a pedestrian in front of vehicle. The method comprises the following steps: collection data of the front of the vehicle through the laser radar and the binocular camera; respectively processing the data collected by the laser radar and the binocular camera, so as to obtain the distance, azimuth angle and speed value of the pedestrian relative to the vehicle; correcting the information of the pedestrian through a Kalman filter. The method comprehensively utilizes a stereoscopic vision technology and a remote sensing technology, integrates laser radar and binocular camera information, is high in measurement accuracy and pedestrian detection accuracy, and can effectively reduce the occurrence rate of traffic accidents.

Systems for three-dimensional viewing and projection aimed at full-color flat-screen binocular stereoscopic viewing without the use of eyeglasses for the viewer. According to the invention, light emanating from a display or projected thereat presenting a left image and a right image is directed only to the appropriate left or right eyes of at least one viewer using various combinations of light polarizing layers and layers of light rotating means.

An autonomous obstacle avoidance and navigation method for unmanned aerial vehicle (UAV)-based field search and rescue provided by the invention includes global navigation based on GPS signals and anautonomous obstacle avoidance and navigation algorithm based on binocular vision and ultrasound. First, a UAV carries out search under the navigation of GPS signals according to a planned path. Aftera target is found, the autonomous obstacle avoidance and navigation algorithm based on binocular vision and ultrasound is adopted. A binocular camera acquires a disparity map containing depth information. The disparity map is re-projected to a 3D space to get a point cloud. A cost map is established according to the point cloud. The path is re-planned using the cost map to avoid obstacles. When there is no GPS signal, a visual inertial odometry (VIO) is used to ensure that the UAV flies according to the planned path, and an ultrasonic sensor is used to detect and avoid obstacles below the UAVto approach the rescued target. UAV autonomous obstacle avoidance and navigation in a field search and rescue scene is realized.

An optical system for transmitting a stereoscopic image to a right eye and a left eye of a user is disclosed. The system comprises an optical relay device, having a light-transmissive substrate, an input grating, a left output grating and a right output grating. The optical relay device is designed and constructed such that light is diffracted by the input grating, propagates within the light-transmissive substrate via total internal reflection, and diffracted out of the light-transmissive substrate by at least one of the left and right output gratings. The system further comprises an image generating system, optically coupled to the input grating and configured for providing collimated light constituting a left-eye image and a right-eye image wherein the left-eye image is parallactically related to the right-eye image. In various exemplary embodiments of the invention the left-eye image and the right-eye image are spectrally modulated according to different spectral maps, selected to provide different optical information to different eyes.