Binaural horizontal perspective hands-on simulator

Abstract

The present invention hands-on simulator system discloses a three dimension display system comprising a three dimensional horizontal perspective display and a 3-D audio system such as binaural simulation to lend realism to the three dimensional display. The three dimensional display system can futher comprise a second display, together with a curvilinear blending display section to merge the various images. The multi-plane display surface can accommodate the viewer by adjusting the various images and 3-D sound according to the viewer's eyepoint and earpoint locations. The present invention hands-on simulator system can project horizontal perspective images into the open space and a peripheral device that allow the end user to manipulate the images with hands or hand-held tools.

Description

[0001] This application claims priority from U.S. provisional applications Ser. No. 60 / 576, 187 filed Jun. 1, 2004, entitled “Multi plane horizontal perspective display”; Ser. No. 60 / 576,189 filed Jun. 1, 2004, entitled “Multi plane horizontal perspective hand on simulator”; Ser. No. 60 / 576, 182 filed Jun. 1, 2004, entitled “Binaural horizontal perspective display”; and Ser. No. 60 / 576,181 filed Jun. 1, 2004, entitled “Binaural horizontal perspective hand on simulator” which are incorporated herein by reference. This application is related to co-pending application Ser. No. 11 / 098,681 filed Apr. 4, 2005, entitled “Horizontal projection display”; Ser. No. 11 / 098,685 filed Apr. 4, 2005, entitled “Horizontal projection display”, Ser. No. 11 / 098,667 filed Apr. 4, 2005, entitled “Horizontal projection hands-on simulator”; Ser. No. 11 / 098,682 filed Apr. 4, 2005, entitled “Horizontal projection hands-on simulator”; “Multi plane horizontal perspective display” filed May 27, 2005; “Multi pla...

AI Technical Summary

Benefits of technology

The present invention is about a system that uses a personal computer to create a realistic and immersive experience for the viewer. The system includes multiple display surfaces, one of which shows a three-dimensional perspective image. The other surfaces can display two-dimensional or three-dimensional central perspective images. The display surfaces can also blend together to create a curved display. The system has different camera positions to ensure the viewer's eye is always in the proper position to perceive the illusion. The display can be manually or automatically adjusted based on the viewer's position. The system also includes audio to make the experience more realistic. The viewer can interact with the images using a computer mouse, trackball, joystick, or tablet. The system can also project the images into the open space and allow the viewer to manipulate them with their hands or tools.

Problems solved by technology

Ever since humans began to communicate through pictures, they faced a dilemma of how to accurately represent the three-dimensional world they lived in.

Sculpture was used to successfully depict three-dimensional objects, but was not adequate to communicate spatial relationships between objects and within environments.

However, the fact that there are a number of other types of perspectives is not well known.

Viewing the images at angle different from 90° would result in image distortion, meaning a square would be seen as a rectangle when the viewing surface is not perpendicular to the line of vision.

This is done because it is computationally expensive for the computer's hardware to generate the enormous number of 3D objects in a typical 3D application, the majority of which the end-user is not currently focused on.

3D central perspective projection, though offering realistic 3D illusion, has some limitations is allowing the user to have hands-on interaction with the 3D display.

Horizontal perspective images offer realistic three dimensional illusion, but are little known primarily due to the narrow viewing location (the viewer's eyepoint has to be coincide precisely with the image projection eyepoint), and the complexity involving in projecting the two dimensional image or the three dimension model into the horizontal perspective image.

Further, with much experience in viewing three dimensional depth cues from perpendicular images, viewers can tolerate significant amount of distortion generated by the deviations from the camera point.

In contrast, the creation of a horizontal perspective image does require much manipulation.

Making a horizontal drawing requires much effort and very time consuming.

Images