95 results about "Ar system" patented technology

An AR system both identifies and visually tracks parts for a user by maintaining spatial awareness of the user's pose and provides instructions to the user for the use of those parts. Tracking the identified parts, both inside and outside the current Field of View (FOV), and any missing parts for use with the current instruction improves the effectiveness and efficiency of both novice and experienced user alike.

Systems and methods for measuring overlay error in a video-based augmented reality enhanced surgical navigation system are presented. In exemplary embodiments of the present invention the system and method include providing a test object, creating a virtual object which is a computer model of the test object, registering the test object, capturing images of control points on the test object at various positions within an augmented reality system's measurement space, and extracting positions of control points on the test object from the captured images, calculating the positions of the control points in virtual image, and calculating the positional difference of positions of corresponding control points between the respective video and virtual images of the test object. The method and system can further assess if the overlay accuracy meets an acceptable standard. In exemplary embodiments of the present invention a method and system are provided to identify the various sources of error in such systems and assess their effects on system accuracy. In exemplary embodiments of the present invention, after the accuracy of an AR system is determined, the AR system may be used as a tool to evaluate the accuracy of other processes in a given application, such as registration error.

An AR system both identifies and visually tracks parts for a user by maintaining spatial awareness of the user's pose and provides instructions to the user for the use of those parts. Tracking the identified parts, both inside and outside the current Field of View (FOV), and any missing parts for use with the current instruction improves the effectiveness and efficiency of both novice and experienced user alike.

An augmented reality (AR) system and method for remotely sharing an AR service is provided. The AR system includes a plurality of client devices and a host device. The AR system allows information related to a marker and information related an AR object to be shared between client devices participating in an AR session, which may be separated by a reference distance, through a host device. Accordingly, an AR service may be shared between the client devices.

A VR / AR system, method, architecture includes an augmentor that concurrently receives and processes real world image constituent signals while producing synthetic world image constituent signals and then interleaves / augments these signals for further processing. In some implementations, the real world signals (pass through with possibility of processing by the augmentor) are converted to IR (using, for example, a false color map) and interleaved with the synthetic world signals (produced in IR) for continued processing including visualization (conversion to visible spectrum), amplitude / bandwidth processing, and output shaping for production of a set of display image precursors intended for a HVS.

An augmented reality (AR) system for generating and displaying an enhanced situation visualization (ESV) is provided. The AR system may include an ESV computing device, a user computing device operated by a user and a reference database. The user computing device may transmit a reference request message to the ESV device, the reference request message including an image representative of a current view of a user. The ESV computing device may determine a subject of the image, retrieve reference information associated with the subject from the reference database, and determine situation information specific to the subject. The reference and situation information may be displayed on the user computing device to provide an ESV of the subject. The ESV may be used for insurance-related activities, such as handling, adjusting, and / or generating homeowner's insurance claims, and / or for instructional guidance.

This disclosure provides systems, methods and apparatus for manipulating virtual objects in a virtual reality (VR) environment. In some implementations, an augmented reality (AR) system determines an orientation of a physical object in the real-world space based at least in part on images or video of the physical object captured by an image capture device, and generates a virtual object representative of the physical object based at least in part on the orientation and the at least one detected feature. The AR system detects movement of the physical object in the real-world space based at least in part on the captured images or video, and manipulates the virtual object based at least in part on the detected movements of the physical object. In some aspects, the AR system can determine the orientation and detect movement of the physical object without receiving control signals or communications from the physical object.

The invention discloses a mechanical equipment visual interaction and equipment real-time monitoring system and method based on augmented reality, and the system consists of four modules: an equipmentdata module, an AR system server module, a mobile application end module, and a real equipment scene module. The equipment data module collects and summarizes mechanical equipment state parameter data, and transmits data to the AR system server module through a wireless network. Model processing and data superposing work is completed in the AR system server. An equipment AR virtual scene is constructed, corresponding scene contents are sent to the AR virtual scene according to the requirements of a mobile application terminal module. A scene image and a graphic identification code of a real equipment scene are shot by a camera of a mobile application terminal, to match a tracking identifier, provide man-machine interaction, render the scene, and output an AR image. According to the invention, through augmented reality interaction management of production field equipment, the difficulty and error source of daily operation are reduced, and the operation quality and efficiency of the equipment in a production environment are improved.

The invention discloses a convolutional neural network and user habitual behavior analysis combination-based AR system gesture identification method. The method comprises the following steps of 1, collecting user habitual gesture images: randomly providing a group of gestures by a user, taking the group of the gestures as standard gestures, collecting images of the group of the gestures, and marking the images as a standard group; according to a gesture model graph of the standard group, establishing corresponding actual tag types; setting different tag types for triggering corresponding specified functions of an AR system; 2, detecting gesture region images: performing gesture region image detection on gesture images of the standard group, a training sample group and a test sample group to realize segmentation of skin color and non skin color regions in the images; and 3, realizing gesture feature identification by a convolutional neural network: designing a convolutional neural network preliminary structure model, training, testing and adjusting the convolutional neural network model by using sample data, and directly inputting a binary image to the convolutional neural network.The gesture identification accuracy is relatively high and the additional device cost is relatively low.

An augmented reality (AR) system for generating and displaying a pre-disaster Enhanced Situation Visualization (ESV) is provided. The AR system may include an ESV computing device, a user computing device operated by a user and a reference database. The user computing device may transmit a reference request message to the ESV device, the reference request message including an image and / or GPS location of a property. The ESV computing device may determine the subject of the image is the property, retrieve reference information including peril maps associated with the property from the reference database, and determine situation information specific to the subject. The reference and situation information including a loss estimate may be displayed on the user computing device to provide an ESV of the property. The ESV may be used for insurance-related activities, such as handling, adjusting, and / or generating an insurance policy, premium, and / or discount, and / or generating insurance-related recommendations.

The invention claims an augmented reality three-dimensional tracking registration method based on LINE-MOD template matching. depth information is introduced, so that LINE- MOD template matching method can complete object identification and matching under any scale. And on the basis of an Improved LINE MOD template matching, through matching of the current view angle image and offline different view angle reference views, a key frame closest to the current view angle and a pose corresponding to the key frame are obtained. And the pose of the part is accurately estimated by using an interpolation method through the topological relation between the reference views. The method is superior to the texture-free target object tracking and pose estimation precision proposed by the Hinterstostat onthe ACCV, the real-time performance of the algorithm is good, and the tracking and registering requirements of the AR system can be well met.

A method and system for calibration of an augmented reality (AR) device's position and orientation based on a robot's positional configuration. A conventional visual calibration target is not required for AR device calibration. Instead, the robot itself, in any pose, is used as a three dimensional (3D) calibration target. The AR system is provided with a CAD model of the entire robot to use as a reference frame, and 3D models of the individual robot arms are combined into a single object model based on joint positions known from the robot controller. The 3D surface model of the entire robot in the current pose is then used for visual calibration of the AR system by analyzing images from the AR device camera in comparison to the surface model of the robot in the current pose. The technique is applicable to initial AR device calibration and to ongoing device tracking.

A method for authorizing use of Augmented Reality (AR) information includes acquiring information regarding a location at which the AR information is to be provided, authorizing a user to use the AR information, creating attribute information including the AR information, the location information, and authority information, and transmitting the attribute information to an AR system. The AR system can register the attribute information, and can provide the AR information only to authorized users. An apparatus to authorize use of Augmented Reality (AR) information includes a location information acquiring unit, an authorization unit to authorize a user to use the AR information, and an AR information processor to create attribute information. The attribute information is transmitted to an AR system as a request for the AR system to register the attribute information so the AR system provides the AR information only to authorized users.

Existing search methods / systems are often generic and sometimes offer no user specific information. Disclosed herein are methods and systems for providing personalized, interactive, and intelligent search information. In particular, intelligent analysis for better interpreting and understanding user input and interactive user feedback concerning both search query quality and search result qualityare provided to improve search quality and user experience, especially for accurate and intelligent searches in an interactive system (e.g., in an AR system).

The invention discloses an intelligent AR (Augmented Reality) system with low power consumption and intelligent AR glasses. The intelligent AR system comprises a detection unit, a control unit and an execution unit, and is characterized in that control for each component is realized through the control unit, so that functional hardware, which does not need to operate, is enabled to stay at a sleep state, the power consumption is greatly reduced, and the consumption of electric energy is effectively reduced; user behaviors and environmental circumstances are detected through the detection unit so as to enable corresponding components to get into an operating state, so that the intelligent level is improved, only slight manual control is required, and the probability of misoperation of a user is greatly reduced; and a purpose of electricity saving is achieved through the intelligent AR system, so that the endurance can also be ensured under the condition that a battery is manufactured to be smaller, and the weight of the battery is reduced. The glasses further comprise a touch control portion and a touch control unit, adjustment for a display module, an audio module and a camera shooting module is realized, the user is enabled to simply adjust corresponding components to adapt to the state thereof, and thus the user experience is further enhanced.

An AR system that leverages a pre-generated 3D model of the world to improve rendering of 3D graphics content for AR views of a scene, for example an AR view of the world in front of a moving vehicle.By leveraging the pre-generated 3D model, the AR system may use a variety of techniques to enhance the rendering capabilities of the system. The AR system may obtain pre-generated 3D data (e.g., 3D tiles) from a remote source (e.g., cloud-based storage), and may use this pre-generated 3D data (e.g., a combination of 3D mesh, textures, and other geometry information) to augment local data (e.g., apoint cloud of data collected by vehicle sensors) to determine much more information about a scene, including information about occluded or distant regions of the scene, than is available from the local data.

An augmented reality (AR) system for generating AR-based profiles using an AR computing device and an AR display device is provided. The AR system is configured to detect a consumer computing device located at a predefined distance from the AR display device, and transmit an electronic request message to an electronic computer application stored on the consumer computing device. The AR system is also configured to receive an electronic response message from the consumer computing device, wherein the electronic response message includes AR consumer data, and retrieve, from a database, an AR-based profile associated with the consumer based on the AR consumer identifier. The AR system is further configured to transmit the AR-based profile in the form of AR data to the AR display device, and display the AR data on a display screen of the AR display device.

The application provides an augmented reality display device comprising a projection source module (10) and an optical path module, wherein the projection source module (10) comprises a projection source (12), the projection source (12) has a curved light outgoing surface (12a), virtual image light (VL) is projected out of the projection source (12) via the curved light outgoing surface (12a), and the optical path module comprises a beamsplitter (20) and a reflector (60), wherein the virtual image light (VL) projected out of the projection source module (10) is incident on the beamsplitter (20), reflected by the beamsplitter (20) onto the reflector (60), reflected by the reflector (60), and then transmitted through the beamsplitter (20), entering a human eye (E) eventually. The application also provides a wearable augmented reality system comprising the augmented reality display device and a projection source module for the augmented reality display device.

The invention discloses an AR system for an intelligent workshop and a work method of the system. The AR system is realized on the basis of an intelligent workshop management system; the intelligent workshop management system comprises an onsite data server, and the onsite data server collects or controls the network to collect data of networked devices in the workshop in real time via a digital workshop; the AR system comprises an AR system server communicated with the onsite data server, a portable AR viewfinders connected with the AR system server via an AR system service network, and networked AR interaction terminals which form complete system data input and AR image output by pairing the unique portable AR viewfinder according to an identity identification of the corresponding networked device. The system is more intelligent and has more functions, a worker can know the working condition of devices in the workshop at any time and place conveniently, and the system and method aresuitable for a random intelligent workshop.

The embodiment of the invention is suitable for the technical field of information, and provides an augmented reality display method and device for an indoor environment, and terminal equipment, and the method comprises the steps: collecting the network signal information of a current position; based on the network signal information, determining a positioning area of a current user in an indoor environment by adopting a preset prediction model; acquiring an environment image of the positioning area; identifying a target image matched with the environment image of the positioning area, whereinthe target image has corresponding position information; generating a virtual object to be displayed based on the position information; and performing augmented reality display on the virtual object.The problem that an AR system in the prior art cannot directly perform LBS-based related services in an indoor environment is solved, the cost of constructing the AR system is reduced, and the availability of the AR system is improved.

The invention relates to an AR display system based on a transparent OLED vehicle window and a scenery collection and display method, and the method comprises the following steps: integrating an augmented reality display system on the transparent OLED vehicle window, and enabling the transparent OLED vehicle window to be provided with an augmented reality key and a one-key viewing scenery key; sending out a control signal by a train control room, and allowing the transparent OLED window to start work to play video information and text information; when the key is used as an augmented reality key, allowing the transparent OLED vehicle window to receive first input acting on any position on the transparent OLED vehicle window, responding to the first input, controlling the camera to acquirea preview image in a user participation process in real time, determining a virtual object and supplementary information in the preview image, and triggering to open an augmented reality function according to the virtual object and supplementary information so as to perform augmented reality processing on the preview image. According to the invention, a brand-new AR system platform for real-time interaction of users is provided for rail transit, more abundant travel experience is brought to people in the riding process, and the sense of science and technology is increased for trains.

The invention discloses a method for realizing children auxiliary education by using AR. An AR system is formed by a virtual scene system and a perceptual management system. The virtual scene system firstly designs and produces a virtual scene, forms a scene change according to user perception input and sends a scene change to a user as a feedback. The perceptual management system includes a perceptual feedback process and a perceptual capture process. The virtual scene system carries out a transmission to the perceptual management system through a perceptual feedback process, the perceptual management system carries out a transmission to children eyes through a perceptual feedback process, children transmit the perceptual capture process to the virtual scene system through controlling anAR device, a helmet type display is used by AR eyes and is in a virtual reality system to enhance reality. According to the method for realizing children auxiliary education by using AR, static text and picture reading materials can be three-dimensional through the AR technology, the interaction and interest of reading are improved, and thus the fun of learning of the children is improved.

The invention discloses an AR technology-based intelligent inspection system and method for a transformer substation machine room. The system comprises a data processing transmission end and an AR terminal, the data processing transmission end comprises a 5G base station, an MEC edge cloud, an electric power 5G core network and an electric power cloud; information collected by the AR terminal is transmitted to the MEC edge cloud through a 5G network and is processed by an intelligent AR system in the MEC edge cloud, and the processing result is transmitted back to the AR terminal for information display. The AR terminal comprises a remote assistance module, a positioning module, an equipment state recognition module, a data management module and an intelligent inspection module; the collected information is transmitted to the data management module, and the data management module specifies an inspection plan is specified in combination with electric power inspection operation regulations according to the collected information and historical data information. the AR technology is used, data calculation is completed through the cloud, data transmission is completed through 5G, network delay can be reduced, data storage capacity and calculation and analysis capacity are provided, labor and time cost is effectively saved, and the work efficiency and the electric power safety production level are improved.

The invention discloses a coordinate transformation method for displaying detection information in an AR system. The coordinate transformation method comprises the steps: determining a human eye observation position and a position where an interested target is located; carrying out coordinate transformation on the real position of the interested target to the position where the projection of the interested target on the AR display equipment is located; and transforming the position coordinates of the interested target on the AR display device to the coordinates of the interested target on theAR projection device. The technical problems that an AR system lacks accurate calculation of position coordinates, dislocation occurs when virtual information and real information are overlapped at the same time, and the sense of reality of the virtual information is reduced are solved. Accurate position coordinate transformation calculation is realized; and the image display position of the AR system can be automatically adjusted by combining the technology for positioning viewer's eyes in real time, and the virtual projection on the AR display equipment can be matched with the accurate position of the target in the real scene in the visual field of the viewer, so that the technical effect of seamless fusion of reality and reality is realized.

The invention discloses a multifunctional auxiliary audio-visual method which comprises the following steps: acquiring first voice signals acquired by voice acquisition modules in at least three audio-visual acquisition systems, and acquiring video signals acquired by video acquisition modules of the at least three audio-visual acquisition systems; acquiring a second voice signal acquired by a voice acquisition module in an audio-visual AR system; analyzing the first voice signal and the second voice signal, and comparing the high-frequency component ratio of the first voice signal with a preset threshold to obtain an analysis result; processing the first voice signal and the second voice signal according to the analysis result to obtain a processing result; and controlling an AR display module in the audio-visual AR system to display the processing result. According to the invention, the voice signals acquired by the voice acquisition modules are processed and a processing result is displayed through a sound source positioning and voice-text conversion technology, so that the problem that hearing impaired people cannot hear danger warning of a visual blind area or cannot talk withpeople is solved.

An embodiment of the invention discloses a data processing method, a control terminal, an AR terminal, an AR system and a storage medium. The data processing method comprises the steps of: transmitting a photographing instruction to the AR terminal after the connection with the AR terminal in the AR system is built; receiving original image data sent by the AR terminal; calling a first shooting device to collect image data based on a target format and shooting parameters corresponding to the AR terminal; replacing the image data with the original image data, and calling a first ISP module fordata processing to obtain processed data; after establishing connection between the AR terminal and a control terminal in the AR system, receiving a shooting instruction sent by the control terminal;determining shooting parameters, and calling a second shooting device to collect original image data based on the target format and the shooting parameters; and sending the original image data to thecontrol terminal so as to complete data processing through using a first ISP module of the control terminal.

An augmented reality (AR) system for production-tuning of parameters for a visual tracking robotic picking system. The robotic picking system includes one or more robots configured to pick randomly-placed and randomly-oriented parts off a conveyor belt and place the parts in an available position, either on a second moving conveyor belt or on a stationary device such as a pallet. A visual tracking system identifies position and orientation of the parts on the feed conveyor. The AR system allows picking system tuning parameters including upstream, discard and downstream boundary locations to be visualized and controlled, real-time robot pick / place operations to be viewed with virtual boundaries, and system performance parameters such as part throughput rate and part allocation by robot to be viewed. The AR system also allows virtual parts to be used in simulations, either instead of or in addition to real parts.

Systems, apparatuses, and methods for hiding latency for wireless virtual reality (VR) and augmented reality (AR) applications are disclosed. A wireless VR or AR system includes a transmitter rendering, encoding, and sending video frames to a receiver coupled to a head-mounted display (HMD). In one scenario, the receiver measures a total latency required for the system to render a frame and prepare the frame for display. The receiver predicts a future head pose of a user based on the total latency. Next, a rendering unit at the transmitter renders, based on the predicted future head pose, a new frame with a rendered field of view (FOV) larger than a FOV of the headset. The receiver rotates the new frame by an amount determined by the difference between the actual head pose and the predicted future head pose to generate a rotated version of the new frame for display.

Embodiments herein describe AR systems that provide occluded AR content to a user while maintaining the perspective of the user. In one embodiment, the AR system includes an optical cloak that contains a mask display device and an AR display device and one or more focusing elements for focusing light captured from the user's environment. As the light enters the optical cloak, the mask display device occludes a portion of the user's view to generate a black silhouette. The AR system then combines AR content displayed by the AR display device with the image of the environment such that the location of the AR content overlaps with the location of the black silhouette. Furthermore, the spacing and characteristics of the focusing elements is set to maintain the perspective of the user as the light passes through the optical cloak.

Provided is near field maneuvering for AR-devices using image tracking. The invention relates to an augmented reality (AR)-system intended and configured for use in the field of at least one of metrology, geodesy, and civil engineering. The AR-system comprises a permanent marker having a defined pose relative to a coordinate system; an AR-device having a camera and a processing unit, wherein the AR-device is configured to visually detect and identify the permanent marker and determine a relative pose between the AR-device and the permanent marker; a temporary marker having a coded design and an undefined pose relative to the coordinate system and the permanent marker, wherein the AR-device is configured to visually detect and identify the temporary marker by the coded design, determine a relative pose between the permanent marker and the temporary marker, defining a pose of the temporary marker relative to the coordinate system based on the determined relative pose between the permanent marker and the temporary marker, and determine a relative pose between the AR-device and the temporary marker.