System, method and computer program product for real-time alignment of an augmented reality device

Abstract

A system including a structure attachable to a surface in a real world environment, the structure establishing a known location and orientation of the structure, a docking element, as part of the structure, to secure an augmented reality device in a stationary position for alignment of the augmented reality device with the real world environment and with a parallel virtual environment, and a processor operable to perform the alignment by resetting the inertial navigation system of the augmented reality device to the known location when docked in the docking element and aligning the location and orientation of the virtual representation of the augmented reality device in the parallel virtual environment so that the parallel virtual environment in the augmented reality device overlaps the real world environment. A method and computer software produce are also disclosed.

Description

BACKGROUND[0001]Embodiments relate to aligning an inertial navigation system with a real-world environment and a parallel virtual-world environment. Motion calibration of the inertial navigation system of a head mounted display within these environments is also provided,[0002]A head-mounted display, such as a helmet-mounted display or eyeglass-mounted display (abbreviated herein as an “HMD” and “HMDs” when referring to a plurality) is a display device worn on the head of an individual that has one or more small display devices located near one eye or, more commonly, both eyes of the individual, user, or wearer. HMDs may be monocular (where one eye has a view screen), biocular (where both eyes see the same scene on the same screen), or binocular (where each eye has an individual view screen).[0003]Some HMDs display only simulated (computer-generated) images, as opposed to real-world images and, accordingly are often referred to as “virtual reality” or immersive HMDs. Other HMDs super...

AI Technical Summary

Benefits of technology

This patent is about a system, method, and computer software code for aligning an augmented reality inertial navigation system. The system includes a structure that attaches to a surface in a real world environment and a docking element to secure an augmented reality device in a stationary position. The system also includes a processor to align the augmented reality device with the real world environment and a parallel virtual environment. The method involves establishing a known location and orientation of a calibration location post and providing the known location and orientation to the augmented reality device when it is attached to the post. The computer software code is a computer software program that initiates the acquisition of information about the current location and orientation of the calibration or location post and detects when an augmented reality device is attached to the post. The code also calibrates the augmented reality device to align the virtual environment with the real world environment of the device with respect to the current location and orientation of the post.

Problems solved by technology

However, the gyroscopes can drift and the accelerometer can lose accuracy, resulting in errors with respect to position, velocity, and orientation.

Though the errors may at first be small, depending on the use of the HMD, such errors could have significant consequences.

Furthermore, the errors may expand over time.

Additionally, the height of the user may also affect the user's ability to properly register to an external environment viewable through the HMD.

If multiple users utilize the same HMD, the device may only be calibrated for one of the users, thus making the HMD not effective for the other users.

However, the same is not true when an HMD is being used away from the sterile facility, more specifically when the HMD is being used in the field, or in an operational setting.

When in the operational setting, as an error may occur and possibly expand, or multiple users may need to use the HMD, but without an ability to align, refresh or adjust the HMD in real-time, the user may simply cease using the HMD.

Images