2409 results about "2d images" patented technology

The present invention provides a structured-light based system for providing a 3D image of at least one object within a field of view within a body cavity, comprising: a. An endoscope; b. at least one camera located in the endoscope's proximal end, configured to real-time provide at least one 2D image of at least a portion of said field of view by means of said at least one lens; c. a light source, configured to real-time illuminate at least a portion of said at least one object within at least a portion of said field of view with at least one time and space varying predetermined light pattern; and, d. a sensor configured to detect light reflected from said field of view; e. a computer program which, when executed by data processing apparatus, is configured to generate a 3D image of said field of view.

A system, apparatus and method of obtaining data from a 2D image in order to determine the 3D shape of objects appearing in said 2D image, said 2D image having distinguishable epipolar lines, said method comprising: (a) providing a predefined set of types of features, giving rise to feature types, each feature type being distinguishable according to a unique bi-dimensional formation; (b) providing a coded light pattern comprising multiple appearances of said feature types; (c) projecting said coded light pattern on said objects such that the distance between epipolar lines associated with substantially identical features is less than the distance between corresponding locations of two neighboring features; (d) capturing a 2D image of said objects having said projected coded light pattern projected thereupon, said 2D image comprising reflected said feature types; and (e) extracting: (i) said reflected feature types according to the unique bi-dimensional formations; and (ii) locations of said reflected feature types on respective said epipolar lines in said 2D image.

The present invention discloses methods of digitally converting 2D motion pictures or any other 2D image sequences to stereoscopic 3D image data for 3D exhibition. In one embodiment, various types of image data cues can be collected from 2D source images by various methods and then used for producing two distinct stereoscopic 3D views. Embodiments of the disclosed methods can be implemented within a highly efficient system comprising both software and computing hardware. The architectural model of some embodiments of the system is equally applicable to a wide range of conversion, re-mastering and visual enhancement applications for motion pictures and other image sequences, including converting a 2D motion picture or a 2D image sequence to 3D, re-mastering a motion picture or a video sequence to a different frame rate, enhancing the quality of a motion picture or other image sequences, or other conversions that facilitate further improvement in visual image quality within a projector to produce the enhanced images.

A system and methods for accessing 2D digital images and 3D geometric models over a network (preferably the Internet) and transforming and composing that media along with 2D digital image and 3D geometric model media, acquired by other means, into enhanced 2D image and 3D model representations for virtual reality visualization and simulation is disclosed. Digital images and models from a network and other sources are incorporated and manipulated through an interactive graphical user interface. A photogrammetric media processing engine automatically extracts virtual sensor (camera) and geometric models from imagery. Extracted information is used by a reconstruction processor to automatically and realistically compose images and models. A rendering system provides real-time visualization and simulation of the constructed media. A client-server processing model for deployment of the media processing engine system over a network is disclosed.

We describe a road vehicle contact-analogue head up display (HUD) comprising: a laser-based virtual image generation system to provide a 2D virtual image; exit pupil expander optics to enlarge an eye box of the HUD; a system for sensing a lateral road position relative to the road vehicle and a vehicle pitch or horizon position; a symbol image generation system to generate symbology for the HUD; and an imagery processor coupled to the symbol image generation system, to the sensor system and to said virtual image generation system, to receive and process symbology image data to convert this to data defining a 2D image for display dependent on the sensed road position such that when viewed the virtual image appears to be at a substantially fixed position relative to said road; and wherein the virtual image is at a distance of at least 5 m from said viewer.

A method and apparatus for the block-based compression of light-field images. Light-field images may be preprocessed by a preprocessing module into a format that is compatible with the blocking scheme of a block-based compression technique, for example JPEG. The compression technique is then used to compress the preprocessed light-field images. The light-field preprocessing module reshapes the angular data in a captured light-field image into shapes compatible with the blocking scheme of the compression technique so that blocking artifacts of block-based compression are not introduced in the final compressed image. Embodiments may produce compressed 2D images for which no specific light-field image viewer is needed to preview the full light-field image. Full light-field information is contained in one compressed 2D image.

Systems and methods for 2D image and spatial data capture for 3D stereo imaging are disclosed. The system utilizes a cinematography camera and at least one reference or “witness” camera spaced apart from the cinematography camera at a distance much greater that the interocular separation to capture 2D images over an overlapping volume associated with a scene having one or more objects. The captured image date is post-processed to create a depth map, and a point cloud is created form the depth map. The robustness of the depth map and the point cloud allows for dual virtual cameras to be placed substantially arbitrarily in the resulting virtual 3D space, which greatly simplifies the addition of computer-generated graphics, animation and other special effects in cinemagraphic post-processing.

A 2-dimensional (2D) / 3-dimensional (3D) image display device generates 2D or 3D image data according to an input image signal and displays them on a display unit. The display unit includes a display panel for displaying an image in response to the 2D or 3D image data and an optical element layer operative during first and second driving modes in accordance with the 3D and 2D image data. A controller converts the optical element layer to be in the first driving mode in a first period before a 3D image signal is displayed when the input image signal changes from a 2D image signal to the 3D image signal, and converts the optical element layer to be in the second driving mode in a second period after the 2D image signal is displayed when the input image signal changes from the 3D image signal to the 2D image signal.

A system and method for the imaging management of a 3D space where various substantially real-time scan images have been acquired is presented. In exemplary embodiments according to the present invention, a user can visualize images of a portion of a body or object obtained from a substantially real-time scanner not just as 2D images, but as positionally and orientationally located slices within a particular 3D space. In such exemplary embodiments a user can convert such slices into volumes whenever needed, and can process the images or volumes using known image processing and / or volume rendering techniques. Alternatively, a user can acquire ultrasound images in 3D using the techniques of UltraSonar or 4D Ultrasound. In exemplary embodiments according to the present invention, a user can manage various substantially real-time images obtained, either as slices or volumes, and can control their visualization, processing and display, as well as their registration and fusion with other images, volumes and virtual objects obtained or derived from prior scans of the body or object of interest using various modalities.

The present invention provides a method of generating a pseudo-3D user-adapted avatar by using artificial intelligence based on a method of converting a 2D image to the pseudo-3D image having visual and partial functions of a 3D model, and a method of performing a coordination simulation by applying the pseudo-3D coordination image generated by applying total clothes coordination information derived from the artificial intelligence to a user-adapted avatar. The pseudo-3D user-adapted avatar is generated by receiving primary size information and deriving secondary size information from an algorithm by using the primary size information. The pseudo-3D user-adapted avatar image suitable to the user's body shape is generated from the 2D standard avatar image. The pseudo-3D coordination image is generated, from the standard 2D image by using coordination-related information, by an artificial intelligence algorithm, and in response to a corrected pseudo-3D user-adapted avatar image, the generated pseudo-3D coordination image is displayed.

Spatio-temporal light field cameras that can be used to capture the light field within its spatio temporally extended angular extent. Such cameras can be used to record 3D images, 2D images that can be computationally focused, or wide angle panoramic 2D images with relatively high spatial and directional resolutions. The light field cameras can be also be used as 2D / 3D switchable cameras with extended angular extent. The spatio-temporal aspects of the novel light field cameras allow them to capture and digitally record the intensity and color from multiple directional views within a wide angle. The inherent volumetric compactness of the light field cameras make it possible to embed in small mobile devices to capture either 3D images or computationally focusable 2D images. The inherent versatility of these light field cameras makes them suitable for multiple perspective light field capture for 3D movies and video recording applications.

A system creates a visually (e.g., color) coded 3D image that depicts 3D vascular function information including transit time of blood flow through the anatomy. A system combines 3D medical image data with vessel blood flow information. The system uses at least one repository for storing, 3D image data representing a 3D imaging volume including vessels, in the presence of a contrast agent and 2D image data representing a 2D X-ray image through the imaging volume in the presence of a contrast agent. An image data processor uses the 3D image data and the 2D image data in deriving blood flow related information for the vessels. A display processor provides data representing a composite single displayed image including a vessel structure provided by the 3D image data and the derived blood flow related information.

Objects within two-dimensional (2D) video data are modeled by three-dimensional (3D) models as a function of object type and motion through manually calibrating a 2D image to the three spatial dimensions of a 3D modeling cube. Calibrated 3D locations of an object in motion in the 2D image field of view of a video data input are computed and used to determine a heading direction of the object as a function of the camera calibration and determined movement between the computed 3D locations. The 2D object image is replaced in the video data input with an object-type 3D polygonal model having a projected bounding box that best matches a bounding box of an image blob, the model oriented in the determined heading direction. The bounding box of the replacing model is then scaled to fit the object image blob bounding box, and rendered with extracted image features.

The present invention is directed to a system and method for interactive and iterative reconstruction in a manner that helps to reduce computational requirements by generating a model from a subset of the available data, and then refining that model using additional data. Example embodiments directed to scene reconstruction, reconstruct a 3D scene from a plurality of 2D images of that scene by first generating a model of the 3D scene from a subset a of the 2D images. The model can then be refined using specific characteristics of each image in the subset that are calculated using the other images in the subset. The model is further refined using images not in the original subset.

The present invention relates to a method for determining an imaging direction of an imaging apparatus (10), such as an x-ray apparatus, with a radiation source or an imaging source (12) that emits an imaging beam (14) to an imaging detector (16) along a beam path, comprising the steps of imaging an object (18) from a first direction to obtain a first 2D image; providing 3D reference data, for example a generic or statistical 3D model or an earlier obtained 3D data set, of the imaged object (18); performing a 2D / 3D matching of the first 2D image with the 3D reference data to determine a position of an imaging plane (20, 22, 24) of the first 2D image relative to the 3D reference data; and determining the imaging direction of the imaging apparatus (10) relative to the object (18) based on the position of the imaging plane (20, 22, 24) relative to the 3D reference data, as well as to a navigation system for computer-assisted surgery comprising the imaging system of the preceding claim; a tracking system (11), such as optical or IR tracking means; detection devices (13, 15) such as e.g. radiopaque markers (13) detectable by the imaging system and markers (15) detectable by the tracking system (11) attachable to an object (18), wherein the navigation system is adapted to detect a position of the object (18) based on the detection devices (13, 15), in order to generate detection signals and to supply the detection signals to the computer (17) such that the computer can determine point data on the basis of the detection signals received; a calibration object such as a patient body or a phantom bearing detection devices for calibrating the navigation system.

An example-based 2D to 3D image conversion method, a computer readable medium therefor, and a system are provided. The embodiments are based on an image database with depth information or with which depth information can be generated. With respect to a 2D image to be converted into 3D content, a matched background image is found from the database. In addition, graph-based segmentation and comparison techniques are employed to detect the foreground of the 2D image so that the relative depth map can be generated from the foreground and background information. Therefore, the 3D content can be provided with the 2D image plus the depth information. Thus, users can rapidly obtain the 3D content from the 2D image automatically and the rendering of the 3D content can be achieved.

Disclosed herein are an apparatus and method for creating 3D content for an Oriental painting. The apparatus includes a 2D image analysis unit, a 3D information extraction unit, a content creation unit, and a 3D content conversion unit. The 2D image analysis unit receives previous knowledge information, and analyzes 2D information about at least one of an empty space, light and shading, and a composition of an image of the Oriental painting based on the previous knowledge information. The 3D information extraction unit extracts 3D information about at least one of a distance, a depth, a viewpoint, and a focus of the Oriental painting image. The content creation unit creates content for the Oriental painting image based on the analysis information and the 3D information. The 3D content conversion unit converts the content for the Oriental painting image into 3D content based on the 3D information.

Provided are an apparatus and method for processing a light field image that is acquired and processed using a mask to spatially modulate a light field. The apparatus includes a lens, a mask to spatially modulate 4D light field data of a scene passing through the lens to include wideband information on the scene, a sensor to detect a 2D image corresponding to the spatially modulated 4D light field data, and a data processing unit to recover the 4D light field data from the 2D image to generate an all-in-focus image.

Approaches to three-dimensional (3D) data reconstruction are presented. The 3D data comprises 2D images. In some embodiments, the 2D images are directionally interpolated to generate directionally-interpolated 3D data. The directionally-interpolated 3D data are then segmented to generate segmented directionally-interpolated 3D data. The segmented directionally-interpolated 3D data is then meshed. In other embodiments, a 3D data set, which includes 2D flow images, is accessed. The accessed 2D flow images are then directionally interpolated to generate 2D intermediate flow images.

An image transmitting apparatus and method and an image receiving apparatus and method, the image receiving apparatus including a decoder receiving and decoding an image signal including image data and an image characteristic parameter which contains information indicating whether the image data represents a two-dimensional (2D) image or a three-dimensional (3D) image, an image characteristic parameter detector receiving the decoded image signal and extracting and interpreting the image characteristic parameter from the decoded image signal, and a display unit receiving the image characteristic parameter from the image characteristic parameter detector and displaying the image data received from the decoder according to the image characteristic parameter, to display a 2D image and a 3D image in various fields, such as a 3D image broadcast, etc., that can be shown on a digital broadcast standard system.

A system and method for recognizing instances of classes in a 2D image using 3D class models and for recognizing instances of objects in a 2D image using 3D class models. The invention provides a system and method for constructing a database of 3D class models comprising a collection of class parts, where each class part includes part appearance and part geometry. The invention also provides a system and method for matching portions of a 2D image to a 3D class model. The method comprises identifying image features in the 2D image; computing an aligning transformation between the class model and the image; and comparing, under the aligning transformation, class parts of the class model with the image features. The comparison uses both the part appearance and the part geometry.

A method and apparatus for performing 2D to 3D registration includes an initialization step and a refinement step. The initialization step is directed to identifying an orientation and a position by knowing orientation information where data images are captured and by identifying centers of relevant bodies. The refinement step uses normalized mutual information and pattern intensity algorithms to register the 2D image to the 3D volume.