189results about How to "Strong sense of immersion" patented technology

The invention discloses a mining operation multi-operation realization method based on virtual reality and augmented reality, and belongs to the technical field of the virtual reality and the augmented reality. The method comprises two patterns including the virtual reality and the augmented reality. Under a virtual reality scene, the selection and the replacement of a material and a material in the virtual reality scene can be realized, scene exploration is realized, the model can be moved and placed at will, a video is embedded, a two-dimensional code is generated, and a trigger realizes natural interaction, voice interaction and the like; under an augmented reality scene, the model can be selected, voice is played, the operation dynamics of the model can be demonstrated, and the rotation stopping, screen capture and function expansion of the model can be controlled; and under two patterns, various interaction ways of voice control, gesture control and keyboard mouse control can be realized. The method is applied to the virtual simulation application scene of the mining operation, can be used for training mine lot mining workers and students of the mining engineering specialty, reducing training capital and improving the skills of workers and provides an advanced and quick meaning for guiding production construction and science and technology studies.

The invention relates to a 3D virtual community construction method based on panoramic and real image and geographic information. The method comprises the following steps: establishing a virtual community structure; establishing a virtual community display platform through three procedures, including the first procedure of creating a virtual space based on a scene display outer curtain, creating a virtual ground and setting a wandering mode of a user on the virtual ground; the second procedure of adding a 3D entity on the virtual ground and the third procedure of synchronizing the virtual space and the geographic information of the real world; obtaining a virtual community based on panoramic and real image and geographic information; and enabling the environmental interaction of users in the virtual community and the interaction of a current user and other users. The inventive method increases the virtual community scene construction efficiency, improves the realistic effect, ensures the scene of the virtual community consistent to the scene of the real community, allows the user in the virtual space to not only enjoy the environment of the real world but also know the current geographical location, and enhances the realistic effect of the virtual community.

The invention relates to a fire-fighting and rescuing command computer simulation training system. The fire-fighting and rescuing command computer simulation training system comprises a guide and scheduling controlling room, a simulation training controlling room, an observation and discussing controlling room and a database server; the guide and scheduling controlling room and the observation and discussing controlling room are connected with the simulation training controlling room and the database server respectively through a computer network. According to the fire-fighting and rescuing command computer simulation training system, the vision, hearing and touch integrated scene dynamic virtual environment of fire hazards or other hazards can be generated, the virtual environment fidelity is high, the immersion feeling is high, and interaction is good; users in different geographical areas and at different physical locations can share one virtual hazard scene in a real-time synchronization mode, and the users can be in interaction with various objects in the virtual environment through an input device.

The invention provides a BIM based virtual reality displaying method and system. The BIM based virtual reality displaying method comprises the steps of 1 generating a BIM building model; 2 transmitting the BIM building model to a display helmet worn by an observer; 3 utilizing a sensor installed on the display helmet to obtain observation information of a user and transmitting the observation information of the user to the BIM building model and enabling the BIM building model to receive the observation information of the user; 4 updating BIM building model data according to the observation information of the observer and repeating the step 2 to continue to execute the steps. By means of the BIM based virtual reality displaying method, required building information can be only locally displayed at the viewing angle of the observer, the burden of an image processing device is reduced, the field requirement is low, and the method is not limited by environment and enables the observer to have strong immersion and to be personally on the scene.

The invention discloses a decoration effect display method based on a panoramic platform. The method comprises: S1, taking two-dimensional photographs of a room in all directions and conducting mosaicking on the two-dimensional photographs to obtain a panoramic photograph; S2, according to the two-dimensional photographs and the panoramic photograph, generating a three-dimensional model of the room; S3, converting the three-dimensional model to a virtual reality (VR) scene model and displaying the VR scene model in a VR wearable device; S4, sending decoration instructions according to the VR scene model, and decorating on the basis of the three-dimensional model; and S5, updating the VR scene model in real time according to the decorated three-dimensional model, at the same time displaying the updated VR scene model in the VR wearable device. The method can realize the decoration effect display based on the panoramic platform, and the displayed decoration effect has high fidelity and the sense of immersion, so as to provide users with more real virtual reality.

The invention provides a wide-range high-precision matched digital channel three-dimensional visualization method. For a scene graph technology-based channel scene organization method and an incremental component-based similar model modeling method, a wide-range channel terrain which accords with earth curvature change and is completely matched with an electronic chart is established, a k-crossing tree structure scene graph of a channel scene three-dimensional entity model is established, and the channel scene three-dimensional entity model which has the characteristics of wide ranges of three dimension, dynamic and scene, irregular entity and the like is organized, expressed, multiplexed and parallelly quickly developed; and based on a dynamic data configuration technology, a database paging scheduling policy is combined, and the wide-range channel three-dimensional entity model is subjected to high-precision matching, dynamic management and real-time smooth drawing. By the method, wide-range channel high-precision and high-efficiency three-dimensional visualization is realized, and inland water transportation boatmanship training and the visualization construction of Yangtze River digital channels are promoted.

The invention discloses a construction method of a panoramic / realistic hybrid reality platform, which comprises the following specific steps: acquiring panoramic picture data, geographic information data and other original data required for constructing a hybrid reality platform, and storing in a data storage unit of a data management background; then, creating a hybrid reality panoramic / realistic display curtain, creating a virtual ground and adding 3D entities to construct a hybrid reality space based on panoramic pictures; and finally, synchronizing the hybrid reality space with the geographic information of the real world. By organically combining the real scene with the 3D entities in the virtual space, the invention enables users to have strong space reality feeling and immersion feeling in the process of roaming in the hybrid reality space.

The invention discloses an upper limb training system based on monocular video human body action sensing. The upper limb training system comprises a computer and a video camera, wherein the video camera performs video data transmission with the computer, and is used for capturing the human body movement and transmitting the video data through a USB (Universal Serial Bus); the computer is used for receiving the video data, analyzing the video data, completing the hand moving trace tracking and identifying the gesture action according to the tracking result; and the computer is also used for realizing the interaction with a game platform, obtaining a training evaluation parameter and feeding the training evaluation parameter to a user. The training system has the advantages that a quantitative evaluation system is used; the training initiative of a user can be aroused; the defects of the existing training measure are overcome; and the upper limb training system can be applied to communities and families. The immersion feeling of the virtual reality technology of the training system is strong; the interestingness of the training process and the enthusiasm of the user are enhanced; and meanwhile, the safety of the user in the training process is improved by the virtual reality technology.

The invention relates to an immersive three-dimensional rendering projection system and method for a moving view point on a curved screen. The method is based on an immersive three-dimensional rendering projection system for a moving view point on a curved screen. The method comprises the following steps: acquiring user information: tracking user's head position and posture information, and estimating user's binocular positions and sight direction; setting three-dimensional rendering parameters: according to the estimated user's binocular positions and sight direction, adjusting a three-dimensional camera in real time to perform three-dimensional rendering of the moving view point on the parameters; performing dynamic parallax adjustment: performing post processing on the parallax of the rendered three-dimensional image according to the relative position relation between the user and the screen and the geometric shape information of the projection screen, so that the user views comfortable and correct three-dimensional images at his position; optimizing user perception: for user's head posture and eyeball movement, further optimizing the image respectively after the dynamic parallax adjustment; and projecting a three-dimensional scene: watching a virtual roaming three-dimensional scene by the user wearing a pair of three-dimensional glasses.

The embodiment of the invention provides an augmented reality-based information providing method and device, equipment and a storage medium. The method comprises the steps of obtaining a scene image of a reality scene collected by an image collection device; according to the scene image, obtaining to-be-displayed augmented reality AR content and a display target of the AR content in the scene image; fusing the AR content with the display target so as to provide the fused content for the user; wherein the AR content is determined by the following modes: identifying a scene image to obtain scene information of the scene image; and determining AR content corresponding to the scene information based on the scene information. Based on the scheme provided by the embodiment of the invention, the information associated with the scene where the user is located can be provided for the user, and the information is displayed to the user based on the AR technology, so that the immersion of the user is effectively improved, and the actual application requirement can be better met.

The invention discloses a digital Bianzhong-of-Marquis-Yi-of-Zeng interactive system based on immersive virtual reality equipment. The digital Bianzhong-of-Marquis-Yi-of-Zeng interactive system is achieved through a head-mounted display, a stereo headphone, wireless control handles, laser locators, a computer and matched virtual reality software. The stereo headphone is connected with the head-mounted display, the matched virtual reality software is installed in the computer, and the wireless control handles and the laser locators are interacted with the head-mounted display. Through the head-mounted display, a visitor can directly observe a Bianzhong at a first-person perspective of the visitor, and the immersion feeling is higher; the visitor can also freely walk in virtual scenes in cooperation with the laser locators, the Bianzhong is observed from any position angle, and the observation mode is more natural. The wireless control handles are matched with the laser locators, the visitor can be interacted with the Bianzhong in the virtual scenes, and the interactive mode is simple and natural.

The invention discloses a method for visualizing a three-dimensional environmental map in a virtual reality system. The method includes: S1, acquiring and controlling real environment data of an environment where a target locates; S2, constructing a corresponding three-dimensional environmental map according to the real environment data acquired in real time; S3, acquiring updating incremental data of the three-dimensional environmental map at specified period intervals to obtain increment map data; S4, transmitting the increment map data acquired in real time to a control end, and displaying in the virtual reality system to realize visualization of the three-dimensional environmental map. The method is capable of realizing visualization of the three-dimensional environmental map in the virtual reality system and has the advantages of simplicity in realizing method, low realizing cost, small needed communication bandwidth, flexibility in application environments, good realizing effect and the like.

The invention relates to a construction method of a dual-mode three-dimensional terrain stereo environment, belonging to the field of the electronic technology of computer graphics. The method generates a stereo auxiliary image stereo landscape based on an orthographic stereopair and a dual-mode three-dimensional stereo environment organically combining virtual three-dimensional geographical landscapes based on DEM (digital elevation model) and orthoimage through a unified data organization mode by use of the basic data such as orthoimage, stereo auxiliary image, DEM and the like, and realizes the linkage roaming, seamless switching and information interconnection of two three-dimensional environments under the drive of data scheduling and landscape roaming engines; and a user can perform basic information inquiry and space analysis operation in the two landscapes. Through the invention, the constructed dual-mode three-dimensional terrain environment has the characteristics of flexible interaction, vivid effect, strong immersion, high measurement precision, diverse information acquisition and expression modes and the like.

The invention provides an interconversion method of a sequence frame and a panorama, and relates to the technology of display of virtual reality and virtual images. The method comprises the steps of storing the sequence frame for displaying automatic roam effect and a 360-degree panorama file of a swf format under the created working directory; building a correspondence relationship between the sequence frame file and the 360-degree panorama file; implementing a conversion interface by flex; adding a button for triggering the conversion interface to a front page; triggering the button to convert the sequence frame and the 360-degree panorama. With the adoption of the method, the problem of failure of roam of 360-degree panorama display can be solved, and meanwhile, the problem of blockage caused by that unity 3D needs a large space of an internal memory can be solved; the automatic roam effect is achieved; the sense of reality is improved; the interaction performance is high; the manufacturing cost is relatively low; the method is applied to network.

The invention discloses a handmade product and virtual reality experience system and a method based on a mobile terminal. The system comprises a handmade subsystem, a position and object recognition subsystem, a storyline generation subsystem and a scene generation and roaming subsystem, wherein the handmade subsystem is configured to generate an expanded drawing for a handmade product according to a model and providing a teaching video; the position and object recognition subsystem is configured to recognize and output names and coordinates of multiple objects with the handmade product included in a physical world; the storyline generation subsystem is configured to edit the showing order and the lines of the model; and the scene generation and roaming subsystem is configured to generatea corresponding scene according to the names and the coordinates of the object, generate a corresponding storyline according to the lines of the storyline and use a virtual scene and a plot generatedthrough experience of a virtual reality device to realize interaction.

The invention relates to an aeronautical equipment repair assistance system based on hybrid reality and a method for using the same. By using a head-mounted hybrid reality device to build a repair assistance system, and the system includes a login management identity authentication module for login authentication, a holographic three-dimensional model display module for demonstration, an image, audio and video presentation module used to explain the operation, a holographic three-dimensional animation superimposing display module for superimposing a reality and a virtual scene, a gesture recognition interaction processing module and a speech recognition interaction processing module for gesture interaction and speech interaction, a two-dimensional code and image recognition module for scanning and matching database feature information, and an operation record module for uploading and saving maintenance records. The invention has the advantages of simple operation, easy access to maintenance personnel, updating maintenance data, intuitively displaying maintenance operation, recording maintenance process in detail, facilitating enterprise traceability management, and greatly improving maintenance efficiency of aeronautical equipment.

The invention discloses a virtual assembly method based on Leap Motion and cooperation in a local area network, and belongs to the technical field of multi-person gesture cooperation virtual assembly.Based on the cooperative technology in the local area network, the virtual assembly method takes Leap Motion as main hardware equipment to perform virtual assembly of multi-person cooperative gesturecontrol on industrial parts. The virtual assembly method comprises the steps that firstly, on the basis of importing a built assembly part three-dimensional model, Leap Motion is used for detecting palm gestures, and related assembly input gestures are collected and recognized; pickup of an assembly part is achieved through light tracking and rigid body collision detection; and based on a local area network cooperative technology, cooperative splitting and assembling in a networked virtual scene are realized.

The invention discloses an electronic map tour guide method special for tourist attractions, and the method comprises the following steps: collecting basic data of the tourist attraction, and establishing a tourist attraction plane map and an associated AR scene; scanning the scenic spot plane map, and obtaining an associated AR scene for interface display; performing adaptive matching on the gesture operation and AR scene interface editing content; selecting a touring route and / or scenic spot calibrated in the AR scene through gesture operation, obtaining a real-time people stream monitoringvideo corresponding to the route and / or scenic spot, and planning the touring route; driving to a target scenic spot in the scenic spot according to the planned touring route; and selecting a calibration scenic spot corresponding to a target scenic spot in the AR scene through gesture operation, and obtaining introduction information of the corresponding target scenic spot for playing and displaying. The AR tour guide map brought by the live-action can be provided for tourists, so that the tourists can select routes and scenic spots after checking the live-action of the routes and the scenic spots, and scenic spot explanation with parallel characters, sounds and images is provided for the tourists.

The invention discloses a cerebral stroke upper limb rehabilitation training method and system. The method comprises the steps of establishing a virtual rehabilitation training scene; collecting dynamic data of coordinates of hands of a patient, processing the dynamic data and position information of a hand gesture object, recognizing gestures of the hands according to a processing result, and making the gestures of the hands interact with the scene to complete a designated gesture of rehabilitation training; displaying the gestures of the hands in the virtual reality rehabilitation training scene in real time through a virtual reality helmet. According to the cerebral stroke upper limb rehabilitation training method and system, the coordinates of the hands are collected through a somatosensory controller, not only is the price low, but also the precision is high, there is no need to conduct calibration in advance, the content of the scene is interesting, immersion of a virtual realitydevice is high, thus the patient obtain stimulation continuously during rehabilitation training, and accordingly the patient can persist rehabilitation training in the long term.

The invention provides a robot teleoperation system and method based on electromagnetic force feedback and augmented reality. The system comprises a natural control module and a natural feedback module. After fusing gesture text and voice text of an operator, the natural control module extracts a robot control instruction through an inference method to guide a virtual robot in moving, and a true remote robot copies movement of the virtual robot based on data sent by the internet. The natural feedback module comprises electromagnetic force feedback and vision feedback, through the electromagnetic force feedback, the operator can sense the force of the robot, and through the vision feedback, the operator can obverse the virtual robot in any direction. The system is adopted for remotely operating the robot, the stress condition and task execution process of the robot can be sensed in real time, the high immersion sense is achieved, the operation efficiency and accuracy are improved, and the system and method are suitable for non-professional operators and have universality, operability and a wide application range.

The invention discloses a contact lens type optical system and a head-mounted display equipped with the same. The contact lens type optical system is arranged between an image generating unit and human eyes, and comprises a lens, a light split assembly, a quarter-wave plate assembly and a polarization filter, wherein the lens is used for forming a preset focal length for light information of an image generated by the image generating unit; the light split assembly is used for enabling target light to enter an image receiver after passing through the lens back and forth for many times, and comprises a first light spliter located between the lens and the image generating unit and a second light spliter located between the lens and the human eyes; the quarter-wave plate assembly is used for adding a quarter wavelength of phase for transmission light; the polarization filter is used for shielding stray light from entering the image receiver, and the lens, the light split assembly, the quarter-wave plate assembly and the polarization filter are fitted together to form a contact lens. The head-mounted display comprises the contact lens type optical system and the image generating units arranged on the same optical axis. The contact lens type optical system and the head-mounted display equipped with the same, disclosed by the invention, have the characteristics of compactness, small volume, light weight, large field angle, large exit pupil diameter and good imaging quality.

Disclosed are a smart grid visualization platform and a demonstration control method. The smart grid visualization platform comprises a plurality of projectors, a player used for controlling the projectors to project images, a performance controller, a network switch, a DMX signal distributor, a serial port wizard, a remote controller, a dimmer box, a touch controller, a main control computer, a touch display and a main control display, a demonstration projection screen is arranged in front of the projectors, and the network switch, the DMX signal distributor and the serial port input wizard are connected with the performance controller. The multi-state based visualization display platform realizes interactive scene fusing visualization technologies such as interactive multimedia, dynamic smart interaction and virtual reality, shows technologies features of related links of a power grid friendly and visually, allows audiences to integrate into immersive smart grid and ecocity showing to have a strong sense of immersion, and is rich and varied in smart grid visualization display forms, high in interaction and novel and vivid in display concept.

The invention relates to the field of the multimedia technology, and discloses a multi-frame fusion display method based on the 3D technology, and storage equipment. The multi-frame fusion display method comprises steps: presetting 3D display scenes, wherein the 3D display scenes include more than two display windows; obtaining more than two to-be-displayed data sources from an application of the same terminal, respectively rendering different data sources to different virtual screens, and displaying virtual screen display results obtained after rendering on different display windows in the 3D display scenes; or displaying the different data sources on the different display windows in the 3D display scenes through different coordinate systems. According to the multi-frame fusion display method based on the 3D technology, different display effects of the display windows can be realized through setting of different 3D display scenes, the display modes and effects of the data sources are no longer single, the to-be-displayed data sources are fused into the 3D scenes, the display of the data sources is more vivid, stronger immersion is achieved, the browse is more convenient, and the display is more diversified and vivid.

The invention discloses an immersive virtual reality screen projection system, which includes a projection screen and projection equipment. The projection screen includes a top screen, a vertical screen and a ground screen sequentially connected from top to bottom, and the top screen, vertical screen and ground screen are jointly formed. A three-dimensional viewing space, the projection equipment includes a first projection group, a second projection group and a third projection group, the first projection group includes the first projector projected on the floor screen, and the second projection group includes the first Two projectors, the third projection group includes a third projector projecting on the ceiling. In the present invention, the top screen, the vertical screen and the ground screen are connected as an integrated screen, and the screen is bent or bent as a whole to form a three-dimensional and grand viewing space, and each area on the projection screen is correspondingly equipped with a corresponding The projection group is used to form a balanced and complete projection picture. When the audience walks or stands on the ground, they are surrounded by images, so that the audience has a strong sense of presence and immersion, effectively improving the audience's viewing experience.

The present invention provides a story machine interactive play method. The problems are solved that a current story machine play mode is bad in user immersion, cannot generation interaction with the story machine and has no education meaning, etc. The method comprises the following steps: reading system initialization information, and playing story audio stored in the story machine; the story audio is about to play at a selection node or an interaction node, performing selection prompting or interaction prompting and performing detection; if it is detected there is a selection button operation or audio operation after the starting of the selection prompting, going on performing playing of the story audio according to the options of the button operation; if it is detected there is no a selection button operation or audio operation after the starting of the selection prompting, performing shutdown prompting, and detecting whether there is the selection button operation or not; if there is the selection button operation, going on playing the story audio; and if there is no the selection button operation, finishing all the motions and closing the system. The story machine interactive play method adds the interaction frequency of the story machine and users to allow the users to add the immersion, increase the story machine education meaning and allow the story machine to improve the practicality and to be suitable for popularization and application.

The invention relates to a 3D intelligent building control system and method, and belongs to interactive remote control technology. The 3D intelligent building control system comprises an environment monitoring module, an intelligent glass module, an intelligent electric appliance control module, a light control module, a security control module, a central control module and a control terminal, wherein the central control module is connected with the environment monitoring module, the intelligent glass module, the intelligent electric appliance control module, the light control module and the security control module. The system is characterized by also comprising a 3D display and control module, and the 3D display and control module is connected with the central control module and the control terminal. The system and method have the advantages that an interaction interface with good immersion is provided, targets and sub systems are controlled in real time, cross-platform operation is realized, more selections are provided for users, and the method is especially suitable for intelligent building control systems.

The invention discloses a method for carrying out crystal macromolecule three-dimensional visualization by adopting an augmented reality technology. The method comprises the following steps: 1) establishing a spatial structure database for crystal macromolecule according to the spatial structure data of the crystal macromolecule; 2) establishing a visualization model according to the obtained three-dimensional spatial structure data of the crystal macromolecule under the environment of open GL; 3) realizing the crystal macromolecule three-dimensional visualization on the basis of the augmented reality; and 4) further developing and realizing the functions of information inquiry and reconstruction of the crystal macromolecule under the condition of enhancing the display. According to the method for carrying out crystal macromolecule three dimensional visualization by adopting augmented reality technology, carrying out an interaction with the crystal macromolecule by researchers is allowed, and carrying out reconstruction to an original structure of the crystal macromolecule on the basis of research need has important significance to teaching experiment and scientific research, and is helpful to improve teaching experiment level and quality and efficiency of the scientific research.

Provided is an immersion-type self-adaptive pose virtual surgery training platform, comprising four parts of an upper display component, a middle console component, a lower support component and a side support component, and the like. The upper display component, which is designed according to ergonomics, fits a human facial structure and is adapted to human brains with different sizes by adjusting the size of the observation center space via a button, so that the human brains fit well with the platform and the sense of immersion in enhanced. The pose can be adjusted in the self-adaptive way, so that the surgery operation training can be conducted with the appropriate pose, thereby improving the degree of comfort and reducing the fatigue. The whole surgery training process is observed via an external 3D display of the upper display component, so as to evaluate the training effect. The platform of the invention may be used for simulating the operation process of various surgeries, such as brain surgeries, liver surgeries, kidney surgeries, breast surgeries and the like, enables intern doctors or medical college students to conduct the surgery training in the repeated, damage-free and convenient manner, and solves the problems of long training period, low efficiency, high cost, lack of training objects which may occur during traditional surgeon training.

The invention provides a spherical image processing method and device and a server. The spherical image processing method comprises the following steps: acquiring a spherical image, and determining the sphere center of the spherical image; determining a viewpoint when the user watches the spherical image, wherein the viewpoint is located at any point except the sphere center in a sphere space surrounded by the spherical image; determining a pixel expansion area and a pixel contraction area on the spherical image according to the sphere center and the viewpoint; and performing image processingon the spherical image, wherein the image processing comprises performing pixel expansion processing on the image in the pixel expansion region and performing pixel contraction processing on the imagein the pixel contraction region. According to the invention, local enlargement and local reduction are carried out according to the actual view of the viewpoint, so that the user can obtain the viewing experience similar to the near-to-far small-zoom change of the object actually viewed in the real world.