90results about How to "Augmented reality effect" patented technology

The invention provides a head-mounted display device, which comprises a shell and a group of optical system arranged in the shell. The optical system comprises an image display screen, an optical magnifying lens group and a reflecting and transmitting lens, wherein the image display screen is located above the optical magnifying lens group; and the reflecting and transmitting lens is located below the optical magnifying lens group. The optical path of the optical system is that image optical information emitted by the image display screen is transmitted via the optical magnifying lens group and then reflected to a human eye by the reflecting and transmitting lens; and the environment optical information outside the head-mounted display device is transmitted to the human eye via the reflecting and transmitting lens. According to the head-mounted display device provided by the invention, the structure is simple, wearing is comfortable, and a user can conveniently enjoy the visual experience with the enhanced realistic effect.

The invention provides a reality augmenting method and system based on a wearable device. The reality augmenting method based on the wearable device comprises the steps that images, at multiple angles, of an object to be virtualized are obtained through shooting by means of the wearable device; a three-dimensional virtual model of the object to be virtualized is established according to the images, at the multiple angles, of the object to be virtualized, wherein the three-dimensional virtual model has the initial overall dimension; the initial overall dimension of the three-dimensional virtual model is corrected, so that a target overall dimension of the three-dimensional virtual model is obtained; the three-dimensional virtual model with the target overall dimension is superposed into a selected real scene, so that a virtual-real fusion image is obtained. According to the reality augmenting method and system based on the wearable device, the dimension of the three-dimensional virtual model can be modified freely by a user according to the preference of the user and is better superposed into the real scene, in this way, the reality augmenting effect is improved, and cost is quite low.

The invention provides a head-mounted type device used in cooperation with a mobile terminal. The head-mounted type device used in cooperation with the mobile terminal comprises a mask, a leans bracket, a shell and a set of optical system installed between the lens bracket and the shell. The mask is connected with one end of the lens bracket, the shell is connected with the other end of the lens bracket, and a containing groove is formed in the lens bracket and used for containing the mobile terminal. The optical system comprises a total reflector, an optical magnifying lens set and a reflecting and transmitting lens, the optical magnifying lens set and the reflecting and transmitting lens are installed in a lens cone structure, and the lens cone structure is fixedly connected with the shell and the lens bracket. According to an optical path of the optical system, optical information emitted by a display screen of the mobile terminal is reflected to the optical magnifying lens set by the total reflector, transmitted by the optical magnifying lens set and then reflected to the human eyes by the reflecting and transmitting lens; optical information outside the head-mounted type device is transmitted to the human eyes through the reflecting and transmitting lens. The head-mounted type device used in cooperation with the mobile terminal is simple in structure and comfortable to wear, and a user can conveniently enjoy the visual experience with the enhanced realistic effect.

The invention discloses a technology for restoring a depth image and combining virtual and real scenes based on a GPU (Graphic Processing Unit). The technology mainly comprises the following steps: (1), collecting the depth image and a colourized image; (2), performing down-sampling of the images so as to ensure real-time restoring speed; (3), segmenting the colourized image by using a QuickShift algorithm, wherein the specific algorithm is realized by using a CUDA (Compute Unified Device Architecture) based on GPU operation; (4), processing a segmented block lacking of depth data by utilizing the segmentation result of the colourized image; registering the Kinect depth image and colourized image at first; filling a deleted region by using an average depth value of the region if the depth data exists in the region; and filling by using the average depth value of a neighbourhood region if all depth information in the region is deleted; and (5), performing up-sampling of the images. According to the invention, the bug restoring problem of the Kinect depth images is solved in combination with an image sampling technology and a CUDA technology based on the QuickShift algorithm and the GPU operation; on this basis, virtual objects and real objects are superposed, so that shading between virtual objects and the real objects is realized; and thus, realistic interaction is enhanced.

The application relates to the technical field of information display and discloses information display equipment and an information display method, which are used for realizing a three-dimensional display image for simultaneously and correctly displaying binocular parallax and focusing information. The information display equipment comprises a space light modulator, a first optical grating, an optical waveguide and a second optical grating, wherein the space light modulator is used for transmitting a holographic three-dimensional light field to the first optical grating, wherein the holographic three-dimensional light field corresponds to at least two focal planes; the first optical grating is used for deflecting the holographic three-dimensional light field transmitted by the space light modulator so as to lead the holographic three-dimensional light field to be propagated and enter the optical waveguide along a first direction; the optical waveguide is used for receiving the holographic three-dimensional light field from the first optical grating and propagating the holographic three-dimensional light field in the optical waveguide; the second optical grating is used for deflecting the holographic three-dimensional light field propagated in the optical waveguide so as to lead the holographic three-dimensional light field to be spread out of the optical waveguide along a second direction and lead a user to see the holographic three-dimensional image corresponding to the holographic three-dimensional light field after the eyes of a user receive the holographic three-dimensional light field spread out along the second direction.

The invention discloses an information processing device and an information processing method. The information processing device comprises a display unit with a preset light transmittance; an object determination unit is equipped to determine at least one object at one side of the information processing device; an additional information acquisition unit is equipped to acquire additional information corresponding to the at least one object; an additional information position determination unit is equipped to determine the display position of the additional information on the display unit; and a display processing unit is equipped to display the additional information in the display unit based on the display position.

The invention discloses a character recognition based mobile augmented reality reading method.The method includes steps: 1, a mobile device acquires a shot original image containing characters; 2, the mobile device preprocesses the acquired original image and uploads to a server; 3, the server acquires a character set and position information of each character in the image; 4, the server acquires a keyword set and position information of each keyword; 5, the server searches multimedia resources related to each keyword and returns corresponding results to the mobile device; 6, aiming at each group of received results, the mobile terminal precisely overlays the multimedia resources onto the original image.The invention further discloses a reading system for implementation of the character recognition based mobile augmented reality reading method.The reading system comprises a mobile phone terminal and a server terminal, and the mobile phone terminal and the server terminal are in communication through the internet.The character recognition based mobile augmented reality reading method and the reading system have the advantages of low storage cost of the server and the like.

The invention discloses head mounted electronic equipment. The head mounted electronic equipment includes a spectacle frame, eyeglasses, two cameras, a control lever with a processing system, two displays at the back side of the eyeglasses, and two lenses, wherein the two lenses are arranged between the two displays and two eyes; the processing system controls the two cameras to shoot the physical scene at the front of the current eyeglasses and process the shot content into real-time video flows and adding a system icons into the video flows; the video flows with the system icon can be respectively displayed through the two displays; and after amplification of the lenses, the physical scene at the front of the eyeglasses can be converted into a virtual 3D image with the system icon. Through the above structure, the head mounted electronic equipment can realize the function for virtual reality and augmented reality, and also has all the functions of a current mobile phone, and can satisfy the requirements for daily life of people.

Provided is a distribution transformer optimal selection method with fault risk and whole life cycle cost influence being taken into consideration. The method quantifies the fault risks of the distribution transformer under different overloads, makes cost compositions in a whole life cycle model clear, obtains whole life cycle cost considering fault risk by adding fault risk to the model, and carries out assessment decision on capacity selection risk due to distribution transformer overload by combining a decision-making tree method so as to determine an optimal distribution transformer selection scheme. The distribution transformer optimal selection method realizes integration of energy saving performance and economical performance of capacity selection of the distribution transformer by comprehensively comparing each cost in the whole life cycle of the distribution transformer; and meanwhile, the fault risk of the distribution transformer under the overload condition is taken into consideration, so that the corrected whole life cycle model is allowed to meet the practical situation better, and the method provides more reliable data support for the optimal selection of the distribution transformer.

An embodiment of the invention discloses a naked eye 3D augmented reality method and device based on transparent liquid crystals, which are applied to a display device including a transparent liquid crystal display (LCD) screen and a liquid crystal grating. The distance between the transparent LCD screen and the liquid crystal grating meets a 3D imaging condition. The method comprises the steps of acquiring image information and depth information of a real scene; segmenting the image information according to segmenting rules of a user, the segmented image information containing a fusion region; adjusting depth information of a virtual scene according to the depth information of the fusion region in the image information; according to the position of the fusion region in the image information region, displaying the adjusted virtual scene in a position in the transparent LCD screen; and adjusting liquid crystal grating parameters according to positions of user's eyes to display the virtual scene in a 3D manner. The embodiment of the invention can be used for bringing more comfortable experience to the user, without the need of wearing a helmet display, and for generating a true augmented reality effect.

The invention discloses an automatic three-dimensional mapping projection system and a method. the projection system comprises a projection lens unit, an image processing unit, a space recognition unit and a picture storage unit, wherein the space recognition unit carries out three-dimensional space information acquisition on the projection space and three-dimensional space information reconstruction is carried out; and the image processing unit processes a projection application picture on the basis of the three-dimensional space information to form a graph-corrected picture, the picture is then mapped by the projection lens unit, and a projection image matched with at least two intersection surfaces and / or at least one three-dimensional object is formed in the projection display region.

The present invention provides a method for object fusion based on video images, comprising: step 101, collecting a video image containing a first object; step 102, establishing a three-dimensional model of the first object according to the video image containing the first object; step 103 , acquiring a 3D model of at least one second object, merging the 3D model of the second object with the 3D model of the first object, and displaying the fused second object in a video image containing the first object. The invention also provides an object fusion terminal based on video images. The invention collects video images of objects, establishes three-dimensional models of objects, and provides fused video images of multiple objects after matching the three-dimensional models of multiple objects.

The invention discloses a method for providing an augmented reality effect for multimedia data and a system capable of realizing the display function. The method comprises the following steps: firstly, solving augmented reality information of related specific multimedia data and storing the augmented reality information in a storage unit. During playback of specific multimedia data by a multimedia source, multimedia capture equipment provides a plurality of shooting pictures including the appearance of the multimedia source, a multimedia identification unit identifies identifying information and locating information from the shooting pictures, and a processing unit reads the augmented reality information from the storage unit according to the identifying information. Therefore, a display unit can display a corresponding augmented reality image in the augmented reality information according to the locating information while displaying a specific shooting picture in the shooting pictures.

The embodiment of the invention discloses a virtual character control method and device, equipment and a computer readable storage medium. The method comprises the steps: acquiring multiple frames ofinteraction images of an interaction object in a real scene and a display image of a target display object in the real scene respectively; determining state information of the interactive object according to the multiple frames of interactive images; determining posture information of a virtual character according to the state information of the interaction object; determining virtual effect dataof the target display object according to the display image; performing rendering by adopting the posture information of the virtual character and the virtual effect data to obtain a virtual effect image; and displaying an augmented reality effect including the virtual effect image on a display device. Through the method and device, the display flexibility of the virtual character and the displayobject can be improved, and the display effect of the virtual character and the display object is enriched.

The invention discloses an augmented reality method and device, and relates to the technical field of computers. A specific embodiment of the method comprises the steps of collecting video informationof a target, and obtaining real image information and real sound information of the target from the video information; determining at least one target state data based on the image by using the realimage information, and determining at least one target state data based on the sound by using the real sound information; fusing the same target state data based on the image and the sound to obtain target portrait data; and obtaining virtual information corresponding to the target portrait data, and superposing the virtual information into the target video information for display. According to the embodiment, the current state of the target can be recognized according to the image information and the sound information of the target, recognition results of the two aspects are fused to obtain the accurate target portrait, virtual information matched with the user state can be displayed on the basis of the target portrait, and therefore the augmented reality effect and the user experience are improved.

The invention discloses a head-mounted 3D display device. The display device comprises a backlight source, a display and a lens, wherein the backlight source is used for supplying quasi parallel light to the display; the display is used for modulating the quasi parallel light emitted by the backlight source and projecting the modulated light to the lens; the lens is used for converting the modulated light to parallel light and projecting the parallel light to human eyes. The head-mounted 3D display device realizes an augmented reality effect by a single reflection and enlarges a field angle through the single aspherical half-reflection lens. Since extra lenses are eliminated, the head-mounted 3D display device has a simple and compact optical structure, and the efficiency for solar energy utilization and the portability of the head-mounted display are improved.

The embodiment of the invention discloses a display method and device, display equipment and a computer readable storage medium. The method comprises the following steps: respectively acquiring multiple frames of interactive images of an interactive object in a real scene and a display image of the real scene; determining action effect data corresponding to the virtual object and virtual effect data of the display object based on the display object displayed in the display image; determining response effect data of the virtual object based on the multiple frames of interactive images; rendering the virtual object based on the action effect data and the response effect data, and rendering the display object according to the virtual effect data to obtain a virtual effect image; displaying anaugmented reality effect including the virtual effect image on a display device. Through the invention, the display interactivity can be improved, and the display effect is enriched.

The invention discloses a portable augmented reality ultraviolet imaging system. The ultraviolet light forms a multi-bit image through the image sensor, and the multi-bit image is binarized, and then the ultraviolet image is subjected to morphological and other digital signal processing and transmitted to the visible light camera, which performs lossless ultraviolet image compression and storage; visible light passes through the imaging module. Output high-definition visible light video images, and form three independent time stamp-based data in the visible light camera, namely ultraviolet images, visible light video images, and OSD text information, of which ultraviolet images and visible light video images can be scanned in real time. In the display stage, the panoramic ultraviolet image, the panoramic visible light image and the OSD text information are synchronously displayed by timestamp. The invention effectively expands the detection field of the instrument, realizes the discharge detection in augmented reality, enhances the intuitive and visualized fault location capability, and can also be linked with the power operation and maintenance platform by means of a mobile phone.

The invention discloses an augmented reality method, device and system which are used for performing augmented reality on a shot scene at a mobile terminal. The augmented reality method comprises thesteps of turning on a camera of the mobile terminal, aligning to a real target building, and obtaining current space parameters of the mobile terminal; calculating a virtual target building corresponding to the real target building in a low-precision three-dimensional model according to a space relation in the low-precision three-dimensional model by combining the preset low-precision three-dimensional model on the basis of the current space parameters of the mobile terminal, obtaining basic information corresponding to the virtual target building in the low-precision three-dimensional model;and finally displaying the obtained basic information on the real target building in an overlapped manner. The three-dimensional geometric space algorithm adopted by the invention is simple, the required calculating resources are limited, the storage space required by the low-precision three-dimensional model is very small, the real-time performance is high, and application range is wide.

The embodiment of the invention provides an AR head display device and terminal device combined system, which collects external data through a plurality of modules, performs distributed processing onthe data through a processor and a plurality of coprocessors, and outputs a processing result. The combination of an AR head-display device and a terminal device improves the augmented reality effect,enhances the interaction and enhances the sense of user experience.

The invention provides a head-up display capable of augmenting reality through a 3D display technology. The head-up display comprises a shell, a 3D display unit, an optical magnifying and projecting unit and an optical imaging film, wherein the 3D display unit and the optical magnifying and projecting unit are arranged in the shell, the 3D display unit is used for providing 3D imaging light beams,the optical magnifying and projecting unit is used for magnifying the 3D imaging light beams and projecting the same on a windshield, and the optical imaging film is arranged on the windshield and used for imaging the magnified 3D imaging light beams to achieve combination between a three-dimensional virtual image and actual pavements. The head-up display has the advantages that navigation indicating information can fit the actual pavements completely, information can be transferred to a driver clearly, directly and effectively to obtain an augmented reality effect, and the driver can obtaininformation conveniently during driving and is prevented from distracting and going wrong roads, so that driving efficiency and safety are improved greatly.

The invention provides an image display method, device and equipment and a computer readable storage medium, and the method comprises the steps: collecting a real scene image, and obtaining virtual object data corresponding to the real scene image; determining display data of a virtual object corresponding to the virtual object data based on the real scene image; carrying out rendering processingbased on the display data and the virtual object data to obtain a virtual effect image, wherein a virtual object in the virtual effect image is not shielded by a real object in the real scene image; and displaying an augmented reality effect formed by superposing the real scene image and the virtual effect image on a display device. Through the method and the device, the display flexibility and richness can be improved.

The embodiment of the invention discloses an augmented reality adjusting method and device, a storage medium and augmented reality equipment. The method comprises the following steps: acquiring ambient light intensity; adjusting the brightness of a virtual image according to the ambient light intensity, so as to enable the adjusted brightness of the virtual image to be matched with the ambient light intensity; and converting the adjusted virtual image into a virtual optical signal, the virtual optical signal and a real optical signal being respectively incident into a target pupil to form an augmented reality image. According to the embodiment of the invention, by adopting the technical scheme, the problems that when the difference between the intensity of the real optical signal and the intensity of the virtual optical signal exists, the content of the image formed by the optical signal with relatively low brightness is not clear and part of the image in the formed augmented reality image is not clear due to the fact that the optical signal with high brightness masks the optical signal with low brightness are solved, the quality of the augmented reality image is improved, and theaugmented reality effect is improved.

The invention relates to a live-action interaction method and system, a computer device and a storage medium. The method comprises the following steps: carrying out real proportion modeling on a virtual projection scene containing preset contents and functions, to obtain a three-dimensional model of a projection scene, rendering a scene picture in the projection scene three-dimensional model, to obtain projection information, carrying out live-action building and calibration according to a projection scene three-dimensional model to obtain a calibration database, carrying out perspective transformation on the projection information based on the calibration database, and projecting a to-be-projected image subjected to the perspective transformation into a live-action built by the live-action, so that the surface augmented reality effect in the live-action can be accurately realized.

The invention discloses a quoted price plan generating method of an electricity market power generation side on the basis of a quantity-cost-profit model. The method comprises the following implementation steps that (1) quoted price scene boundary condition data, such as power generation boundary cost C, power generation fixed cost F, cardinal number electricity price G, deduction cardinal number electricity proportion H, initial cardinal number electricity quantity Q and a target profit E is input; (2) a quoted price scene is built, and the operation includes the processes of generating a break even curve, a fixed cost curve and a target profit curve; (3) the large user electricity consumption is predicted according to the market supply and demand; (4) the big user electricity price is calculated on the basis of the existing big user electricity quantity by combining the target profit curve in the quoted price scene. The method provided by the invention has the advantages that the reasonable quoted price plan can be effectively made for electricity plant enterprise bidders and salesmen, so that the economic benefits of enterprises are maximized.

The industrial augmented reality combined positioning system comprises an intelligent sensing module, a base station positioning module and a service decision-making module, wherein the base station positioning module is based on an existing HTCVIVE positioning system and comprises a base station, a helmet and a server, the base station transmits laser, a sensor on the helmet receives a laser signal and transmits data to the server for analysis, and the pose of the helmet relative to the base station is calculated. The intelligent sensing module comprises a portable microprocessor and a cameraintegrated on the helmet, the camera transmits image information to the microprocessor, an object is recognized through a built-in positioning and recognition algorithm, and the pose of the object inthe head scene is calculated; and the service decision module receives the pose from the intelligent sensing module and helmet information detected by the base station, obtains a final pose through acoordinate conversion relationship, and fuses a three-dimensional model into a video stream in real time according to the pose according to different application scenes, thereby realizing an augmented reality effect.

The invention provides a method and a system for enhancing a reality based on a mobile phone side and an electronic whiteboard. The method comprises the following steps: a 3D model database is respectively preset at the mobile phone side and the electronic whiteboard side; the mobile phone side obtains a to-be-displayed 3D picture; the mobile phone side obtains a 3D model matched with the picture and an identity of the 3D model from the 3D model databases; the mobile phone side obtains a camera real-time image data; the real-time image data and the identity of the 3D model are sent to the electronic whiteboard side; the electronic whiteboard side obtains the corresponding 3D model from the 3D model databases according to the identity of the 3D model; and the electronic whiteboard side overlaps the obtained 3D model to a camera image to display. By interaction between the mobile phone side and the electronic whiteboard side, the reality enhancement effect at the electronic whiteboard side is realized; and meanwhile, the mobile phone side only needs to send the identity of the 3D model to the electronic whiteboard side, so the data transmission quantity is greatly reduced.

The embodiment of the invention discloses an image display method. The method comprises the steps of collecting at least one frame of real scene image; identifying a target display object and a background area in the at least one frame of real scene image; acquiring virtual effect data corresponding to the target display object, and rendering the target display object based on the virtual effect data to obtain a virtual effect image; and performing shielding processing on at least part of the background area, and displaying the augmented reality effect of superposition of the real scene imageafter shielding processing and the virtual effect image is displayed on image display equipment. The embodiment of the invention also discloses an image display device, image display equipment and a computer readable storage medium.

The invention discloses intelligent glasses with a 3D image function; the intelligent glasses comprise a glass frame, a support, a camera, and a transparent display screen module; the support is respectively arranged on two ends of the glass frame; the transparent display screen module is arranged on the glass frame and connected with the camera, and also comprises a lens group and a sealing fixed housing, wherein the sealing fixed housing is arranged outside the lens group and wraps the lens group; the lens group also comprises a first convex lens, a transparent display screen, and a first concave lens; the first convex lens is arranged in front of the transparent display screen, and the first concave lens is arranged behind the transparent display screen; the outer side of the first concave lens is a plane, so the second main focal point of the first concave lens can overlap with the first main focal point of the first convex lens, thus forming a Galileo type anti-telescopic structure. The optics module based on the transparent display screen is arranged so as to realize large screen high definition displaying 3D images, and the set touch screen allows a user to click on the screen for directly operations, thus realizing better man-machine interactions.

The embodiment of the invention discloses an image display method. The method comprises the steps: acquiring multiple frames of interactive images of an interactive object in a real scene through multiple first image acquisition devices; based on a specific selection condition, selecting a target interaction image from the multiple frames of interaction images; determining virtual effect data corresponding to a display object based on the target interaction image, and rendering the virtual effect data to obtain a virtual effect image; and displaying an augmented reality effect obtained by superposing the virtual effect image and the display object on a display device. The embodiment of the invention also discloses an image display device, display equipment and a computer readable storage medium.