Reality augmenting based panoramic video interaction method and system

Abstract

The invention discloses a reality augmenting based panoramic video interaction method. The reality augmenting based panoramic video interaction method comprises the steps that video data of a real scenery are acquired through a panoramic camera shooting device and input into an image processor to be processed; the image processor coverts the video data into continuous single-frame images, and successive sequence relation of each single-frame image is recorded; an interaction heat area is selected in each single-frame image, and coordinates and a range of the interaction heat area are set; the image processor converts the single-frame images into a panoramic image three-dimensional scenery according to the successive sequence relation; the panoramic image three-dimensional scenery is transmitted to a terminal device; the terminal device confirms a projection range according to a view angle when the panoramic camera shooting device acquires the real scenery, converts the panoramic image three-dimensional scenery into a spherical panoramic image and outputs the spherical panoramic image to a screen of the terminal device to be displayed. The invention further discloses a reality augmenting based panoramic video interaction system. The panoramic continuous browsing experience is improved and man-machine interaction is achieved.

Description

technical field [0001] The present invention relates to the technical field of video display, in particular to an augmented reality-based panoramic video interaction method and system. Background technique [0002] At present, panoramic image processing technology has been developed rapidly, and panoramic video display systems can be established for virtual tours of tourist attractions, corporate display and publicity, and commercial space display. The existing panoramic image or panoramic video technology can first capture pictures of scenes in the real world, and use professional equipment or software to convert the captured pictures into panoramic images, thereby forming a panoramic video. [0003] There are mainly two specific implementation methods in the prior art: [0004] (1) Shoot through hardware facilities such as cameras and fisheye lenses, use panoramic shooting stitching software to stitch the pictures into panoramic images, and then import multiple panoramic ...

AI Technical Summary

Problems solved by technology

[0005] The first implementation can use limited pictures to realize panoramic video, but this kind of panoramic technology usually only collects one or a few viewpoints in a large scene, so the user can only observe the panoramic scene in the selected viewpoint. details without being able to roam in other 3D scenes

Since the user's coordinates are relatively fixed, the viewing angle and field of view can only be changed at several fixed points. To switch scenes, you can only click on the links of other 3D panoramas, so it is impossible to achieve a continuous browsing experience and increase the limitation of roaming.

At the same time, the panoramic scene realized by this method cannot be displayed and interacted with virtual objects, so the interactivity, operability and scalability of the system are poor

The second implementation method uses 3D software modeling, which can realize the free movement of the viewpoint, but its development workload and the amount of data to be processed are relatively large, and the model accuracy is relatively low

Images