3112 results about "Stereo image" patented technology

The invention, exemplified as a single lens stereo optics design with a stepped mirror system for tracking the eye, isolates landmark features in the separate images, locates the pupil in the eye, matches landmarks to a template centered on the pupil, mathematically traces refracted rays back from the matched image points through the cornea to the inner structure, and locates these structures from the intersection of the rays for the separate stereo views. Having located in this way structures of the eye in the coordinate system of the optical unit, the invention computes the optical axes and from that the line of sight and the torsion roll in vision. Along with providing a wider field of view, this invention has an additional advantage since the stereo images tend to be offset from each other and for this reason the reconstructed pupil is more accurately aligned and centered.

The present invention discloses methods of digitally converting 2D motion pictures or any other 2D image sequences to stereoscopic 3D image data for 3D exhibition. In one embodiment, various types of image data cues can be collected from 2D source images by various methods and then used for producing two distinct stereoscopic 3D views. Embodiments of the disclosed methods can be implemented within a highly efficient system comprising both software and computing hardware. The architectural model of some embodiments of the system is equally applicable to a wide range of conversion, re-mastering and visual enhancement applications for motion pictures and other image sequences, including converting a 2D motion picture or a 2D image sequence to 3D, re-mastering a motion picture or a video sequence to a different frame rate, enhancing the quality of a motion picture or other image sequences, or other conversions that facilitate further improvement in visual image quality within a projector to produce the enhanced images.

The present invention provides a system (method and apparatus) for creating photorealistic 3D models of environments and / or objects from a plurality of stereo images obtained from a mobile stereo camera and optional monocular cameras. The cameras may be handheld, mounted on a mobile platform, manipulator or a positioning device. The system automatically detects and tracks features in image sequences and self-references the stereo camera in 6 degrees of freedom by matching the features to a database to track the camera motion, while building the database simultaneously. A motion estimate may be also provided from external sensors and fused with the motion computed from the images. Individual stereo pairs are processed to compute dense 3D data representing the scene and are transformed, using the estimated camera motion, into a common reference and fused together. The resulting 3D data is represented as point clouds, surfaces, or volumes. The present invention also provides a system (method and apparatus) for enhancing 3D models of environments or objects by registering information from additional sensors to improve model fidelity or to augment it with supplementary information by using a light pattern projector. The present invention also provides a system (method and apparatus) for generating photo-realistic 3D models of underground environments such as tunnels, mines, voids and caves, including automatic registration of the 3D models with pre-existing underground maps.

A medical robotic system provides 3D telestration over a 3D view of an anatomical structure by receiving a 2D telestration graphic input associated with one of a pair of stereoscopic images of the anatomical structure from a mentor surgeon, determining a corresponding 2D telestration graphic input in the other of the pair of stereoscopic images using a disparity map, blending the telestration graphic inputs into respective ones of the pair of stereoscopic images, and providing the blended results to a 3D display so that a 3D view of the telestration graphic input may be displayed as an overlay to a 3D view of the anatomical structure to an operating surgeon.

A technique for enhancing audio signals generated from compressed digital audio files is described. The technique uses a Bass Maximizer module, a Harmonic Exciter module and a Quasi Stereo module. The Bass Exciter module enhances the intensity, depth and punch of the bass audio content by creating harmonic sequences from low frequency components contained in the original input signal. The Harmonic Exciter module adds to the treble audio content of the original input signal by generating harmonic series from the high frequency components contained in the input signal. The Quasi Stereo Module creates a stereo image of the enhanced input signal by adding and subtracting delayed and filtered versions of the enhanced input signal with itself to create left and right channeled stereo-like outputs. The technique provides a useful tool to regenerate from an audio signal more pleasant and joyful sounds.

An image-guided ultrasound system may include an ultrasound probe, a display configured to communicate with the ultrasound probe to receive ultrasound signals to display images from the ultrasound probe, and an imaging device that may be attached to or integral with the ultrasound probe and configured to communicate with the display to display information derived from images from the imaging device. The imaging device may include a stabilization assembly, an imaging device assembly physically coupled to the stabilization assembly, a plurality of light-sensitive devices physically coupled to the stabilization assembly, and a memory unit physically coupled to the imaging device assembly, the memory unit configured to store calibration or usage information for the image-guided ultrasound system.

Disclosed herein is a reconfigurable platform management apparatus for a virtual reality-based training simulator, which enables a device platform to be reconfigured to suit various work environments and to fulfill various work scenario requirements of users. The reconfigurable platform management apparatus for a virtual reality-based training simulator includes an image output unit for outputting a stereoscopic image of mixed reality content that is used for work training of a user. A user working tool unit generates virtual sensation feedback corresponding to sensation feedback generated based on a user's motion to the outputted stereoscopic image when working with an actual working tool. A tracking unit transmits a sensing signal obtained by sensing a user's motion working tool unit to the image output unit and the user working tool unit.

A method of producing a stereo image of a (real or simulated) scene using at least one (real or simulated) camera, which creates the impression of being a 3D image when viewed on a display by a user, wherein the depth of the scene is mapped onto a maximum perceived depth of the image on the display, and the maximum perceived depth is chosen to provide comfortable viewing for the user.

There is disclosed a depth information generation apparatus capable of acquiring high-precision depth information within a short computation time. A depth information generation apparatus of this invention generates depth information at the capture position of a reference image from the reference image, and at least one peripheral image that forms a stereo image pair with the reference image, and has a high-speed stereo processor (30) for generating depth information at high speed from the reference image and peripheral image, and a high-precision stereo processor (40) for generating high-precision depth information. A motion detector (20) detects a motion in an image, and instructs an image composition unit (50) to select the output from the high-speed stereo processor (30) for a portion with a large motion, and the output from the high-precision stereo processor (40) for other portions. The image composition unit (50) composites the outputs from the high-speed stereo processor (30) and high-precision stereo processor (40) in accordance with an instruction from the motion detector (20), and outputs a depth map as final depth information.

Systems and methods for stereo imaging with camera arrays in accordance with embodiments of the invention are disclosed. In one embodiment, a method of generating depth information for an object using two or more array cameras that each include a plurality of imagers includes obtaining a first set of image data captured from a first set of viewpoints, identifying an object in the first set of image data, determining a first depth measurement, determining whether the first depth measurement is above a threshold, and when the depth is above the threshold: obtaining a second set of image data of the same scene from a second set of viewpoints located known distances from one viewpoint in the first set of viewpoints, identifying the object in the second set of image data, and determining a second depth measurement using the first set of image data and the second set of image data.

A method and apparatus are provided for correcting for optical misalignment of the dual (left and right) images produced by a stereo electronic endoscope, or of the corresponding dual images produced by coupling electronic imaging devices to each of two monocular teaching ports of a stereo optical endoscope. The stereo image alignment technique comprises electronically capturing the video image data of the dual images, and subsequently processing that data electronically to correct for optical alignment errors. The method involves digitizing the electronic data and digitally performing the equivalent of vertical image shift, and / or image size change, and / or image rotation as required to correct for any visual image misalignment.

A surgical instrument is inserted through a guide tube. The surgical instrument exits at an intermediate position of the guide tube and is oriented to be substantially parallel to the guide tube's longitudinal axis as it exits. A stereoscopic image capture component is on the guide tube between the intermediate position and the guide tubers distal end. The image capture component's field of view is generally perpendicular to the guide tube's longitudinal axis. The guide tube is jointed to allow the image capture component to be moved. The surgical instruments and the guide tube are telemanipulatively controlled.

The present invention relates to an apparatus and a method for processing three-dimensional (3D) image data of a portable terminal, and particularly, to an apparatus and a method for enabling contents sharing and reproduction (playback) between various 3D devices using a file structure for effectively storing a 3D image obtained using a plurality of cameras, and a stored 3D related parameter, and sharing and reproduction between various 3D devices are possible using a file structure for effectively storing a 3D image (for example, a stereo image) obtained using a plurality of cameras, and a stored 3D related parameter.

The present disclosure relates to systems, methods, and tools for tool tracking using image-derived data from one or more tool located reference features. A method includes: directing illuminating light from a light source onto a robotic surgical tool within a patient body, wherein the tool includes a plurality of primitive features having known positions on the tool, and wherein each feature includes a spherical reflective surface; capturing stereo images of the plurality of primitive features when the tool is within the patient body, wherein the stereo images are captured by an image capture device adjacent the illumination source so that the illumination light reflected from the imaged primitive features toward the image capture device substantially aligns with spherical centers of the surfaces of the imaged primitive features, and determining a position for the tool by processing the stereo images so as to locate the spherical centers of the imaged primitive features by using the reflected light.

An aerial reconnaissance camera and method provides for generating a first image of the terrain of interest with the camera pointing angle oriented or rotated about an azimuthal axis some angular amount (theta1) to a first, typically forward orientation, i.e., forward of a cross-line of flight direction. An image is obtained of the ground at this orientation. Then the camera is rotated about the azimuthal axis to new angular value (theta2), which will typically be aft of the cross line of flight direction. An image is generated at this value. The camera is then rotated back to the value of theta1, and a second image in the forward orientation is generated. The camera is then rotated again to the value of theta2 and another image in the aft orientation is generated. This process of rotating the camera about the azimuthal axis and generating images in forward and aft orientations continues over and over. Eventually, as the aircraft flies past the terrain of interest, any given location in the terrain of interest will have been imaged from two different perspectives-forward and aft. The motion of the aircraft during the interim in combination with the values of theta1 and theta2 provide the high baseline for the stereo image pairs. By selection of suitable values for the angular separation of theta1 and theta2 (such as theta1=+10 degrees and theta2=-10 degrees) the result will be pairs of images of the terrain of interest having a large baseline, producing truly high aspect stereo images from a single camera. The method also works in a similar fashion by rotation back and forth about the pitch axis and imaging the terrain in forward oblique and aft oblique orientations.

The present invention relates to a face recognition and / or iris recognition system and method using a mobile device equipped with a stereo camera, which acquire a stereo image of a user's face using at least two cameras or a method corresponding thereto and, even when the size of the stereo image is varied according to distance, correct the size of the stereo image. The stereo camera uses a single-focus lens with a long depth of focus to acquire a focused iris image over a wider range. When the user is not located at a position suitable for iris recognition, a message is sent to the user such that an iris image suitable for recognition is acquired. Furthermore, an iris image correction process according to distance is performed to prevent recognition rate from decreasing even when the size of the iris image is changed.

An imaging apparatus includes: a plurality of imaging elements; a plurality of solid lenses that form images on the plurality of imaging elements; a plurality of optical axis control units that control the directions of the optical axes of light that is incident to each of the plurality of imaging elements; a plurality of video processing units that convert photoelectric converted signals output from each of the plurality of imaging elements to video signals; a stereo image processing unit that, by performing stereo matching processing based on the plurality of video signals converted by the plurality of video processing units, determines the amount of shift for each pixel, and generates compositing parameters in which the shift amounts that exceed the pixel pitch of the plurality of imaging elements are normalized to the pixel pitch; and a video compositing processing unit that generates high-definition video by compositing the video signals converted by the plurality of video processing units, based on the compositing parameters generated by the stereo image processing unit.

A 2D / 3D switchable display system having a selector for selecting a two-dimensional (2D) or a three-dimensional (3D) image processing path; a first processor for processing image data through the two-dimensional image processing path; a second processor, independent of the first processor, for processing image data through the three dimensional image processing path; a first set of at least three emitters having corresponding first wavelengths; a second set of at least three emitters having corresponding second wavelengths; and a controller that during a 2D operation activates both first and second sets of emitters to present a single image, while during a 3D operation activates the first set of emitters to present a first image having one half of stereo image information and activates the second set of emitters to present a second image having a second half of stereo image information.

A multiple path stereoscopic projection system is disclosed. The system comprises a polarizing splitting element configured to receive image light energy and split the image light energy received into a primary path and a secondary path, a reflector in the secondary path, and a polarization modulator or polarization modulator arrangement positioned in the primary path and configured to modulate the primary path of light energy. A polarization modulator may be included within the secondary path, a retarder may be used, and optional devices that may be successfully employed in the system include elements to substantially optically superimpose light energy transmission between paths and cleanup polarizers. The projection system can enhance the brightness of stereoscopic images perceived by a viewer. Static polarizer dual projection implementations free of polarization modulators are also provided.

An autostereoscopic multi-user display comprising a sweet-spot unit which is directionally controlled by a tracking and image control device (160), wherein an illumination matrix (120) is provided with separately activatable illuminating elements (11 . . . 56), in addition to an imaging device used to alternatingly image active illuminating elements, for making expanded sweet spots (SRI / SR2) visible to various eye positions (EL1 / ERI, EL2 / ER2) of viewers observing alternating images or a stereoscopic image sequence on a transmissive image matrix (140) with the aid of directed beams (B1R . . . B5L). According to the invention, the imaging device comprises an imaging matrix (110) provided with a plurality of lens elements (111 115) whose focal length is small in order to image the active illuminating elements in an enlarged manner onto the sweet spots (SRI / SR2), and a field lens (171), which follows the imaging matrix (110), in order to keep the distances of the activated illuminating elements between adjacent beams (B1, B2,B4, B5) as constant as possible and in order to assist selection of the directions (D1. . . D5) with the illumination matrix (120) for the beams.

This invention provides a method of combining two standard video streams, into one standard video stream, in such a way that it can be encoded efficiently, and that it can enhance the TV viewing experience by presenting Stereoscopic 3D imagery, dual-view display capability, panoramic viewing, and user interactive “pan-and-scan”. The video standards for High Definition Video are used, which are governed by the ATSC and SMPTE standards bodies. Having a dual stream of standard video, which occupies now a single stream of standard video, provides a means to use the standard installed base of equipment for recording, transmission, playback and display.

A system of linked digital cameras for an image capture system is disclosed. A first and second digital camera can be linked to capture a first images and a second image that are used to form a stereo image. A first data port on the first digital camera and a second data port on the second digital camera intercommunicate data between each other when the cameras are linked. The data can include the first and second image data, camera control data, and camera synchronization data. After capturing the first and second images, the image from one of the cameras can be transferred to the other camera so that both the first and second images reside in the other camera. The system allows a user who wishes to capture stereo images the ability to do so with out having to purchase two digital cameras. A compatible digital camera can be borrowed from another user for the purpose of stereo image capture. After the stereo image is captured, the user transfers both images to his camera and returns the borrowed camera. The cameras can be equipped with viewfinders that allow a user of the cameras to view the image being captured in stereo. The viewfinders can be adjustable to accommodate variations in user interpupillary distance. A digital camera operating system (OS) can be customized to enable stereo image capture, image data handling, image processing, and camera control for the linked digital cameras.

Two stereo images are created by splitting a single image into two images using a field of view dividing splitter. The two images can be displayed side by side so that they can be viewed directly using stereopticon technology, heads-up display, or other 3-D display technology, or they can be separated for individual eye viewing. The two images focus on one imager such that the right image appears on the right side of the monitor and the left image appears on the left side of the monitor. The view of the images is aimed to converge at a given object distance such that the views overlap 100% at the object distance. Measurement is done with at least one onscreen cursor.

Methods and systems to process stereo images and video information, and, in particular, to methods and devices to transfer and / or transform stereo content to decrease eye fatigue of a user during viewing of 3D video. The methods and systems can compute an initial map of disparity / depth for stereo images from 3D video, smooth a depth map, change depth perception parameters according to the estimation of eye fatigue, and generate new stereo image according to the depth perception parameters.

A 2D / 3D switchable display system having a selector for selecting a two-dimensional (2D) or a three-dimensional (3D) image processing path; a first processor for processing image data through the two-dimensional image processing path; a second processor, independent of the first processor, for processing image data through the three dimensional image processing path; a first set of at least three emitters having corresponding first wavelengths; a second set of at least three emitters having corresponding second wavelengths; and a controller that during a 2D operation activates both first and second sets of emitters to present a single image, while during a 3D operation activates the first set of emitters to present a first image having one half of stereo image information and activates the second set of emitters to present a second image having a second half of stereo image information.

The present invention makes it possible to perform transmission of stereo image data between devices in a favorable manner. A source device (disc player 210) receives E-EDID from a sink device (television receiver 250) via DDC of an HDMI cable 350. This E-EDID contains information on 3D image data transmission modes that can be supported by the sink device. On the basis of the information on 3D image data transmission modes from the sink device, the source device selects a predetermined transmission mode from among the 3D image data transmission modes that can be supported by the sink device. The sink device transmits 3D image data in the selected transmission mode to the sink device. For the convenience of processing in the sink device, the source device transmits information on the transmission mode for the 3D image data transmitted, to the sink device by using an AVI InfoFrame packet or the like. The sink device processes the 3D image data received from the source device in accordance with its transmission mode, thereby obtaining left eye and right eye image data.

A two-dimensional image is displayed and a grey level image is drawn on said two-dimensional image defining a depth map. A stereo image pair is generated based on the depth map and an anaglyph image of the stereo image pair is displayed. Edits of the depth map are displayed by anaglyph image. A plurality of projection frames are generated based on the depth map, and interlaced and printed for viewing through a micro optical media. Optionally, a layered image is extracted from the two-dimensional image and the plurality of projection frames have an alignment correction shift to center the apparent position of the image. A measured depth map is optionally input, and a stereo pair is optionally input, with a depth map calculated based on the pair. The user selectively modifies the calculated and measured depth map, and the extracted layers, using painted grey levels. A ray trace optionally modifies the interlacing for optimization to a particular media.

In the three-dimensional display, a two-dimensional display section generates a two-dimensional display image based on an image signal, and a lens array converts the wavefront of the display image light from the two-dimensional display section into a wavefront having a curvature which allows the display image light to focus upon a focal point where an optical path length from an observation point to the focal point is equal to an optical path length from the observation point to a virtual object point, so a viewer can obtain information about an appropriate focal length in addition to information about binocular parallax and a convergence angle. Therefore, consistency between the information about binocular parallax and a convergence angle and the information about an appropriate focal length can be ensured, and a desired stereoscopic image can be perceived without physiological discomfort.

A scanning camera with a rotating drum has one or more sensors characterized by a non-radial optical axis. With two sensors on opposite sides of the drum and facing in substantially the same direction, stereoscopic recording of a panorama is accomplished as the drum rotates. The adjustment of convergence between stereoscopic viewpoints is described that improves the viewing and interpretation of stereoscopic images. Rapid rotation of the scanning camera produces panoramic motion picture recording, with the final frame speed dependent on the sensitivity and speed of the sensor, the resolution desired, and the capabilities of the recording device. The preferred embodiment employs rotating fisheye lenses for a substantially full-sphere field of view. Additional sensors in the same arrangement are used to increase resolution and light sensitivity through multiplexed or additive recording of the image data. Recording image information using film, either internal or external to the camera drum, is also described as a cost-effective alternative to digital media storage.