226 results about "Video stitching" patented technology

A drift-free hybrid method of performing video stitching is provided. The method includes decoding a plurality of video bitstreams and storing prediction information. The decoded bitstreams form video images, spatially composed into a combined image. The image comprises frames of ideal stitched video sequence. The method uses prediction information in conjunction with previously generated frames to predict pixel blocks in the next frame. A stitched predicted block in the next frame is subtracted from a corresponding block in a corresponding frame to create a stitched raw residual block. The raw residual block is forward transformed, quantized, entropy encoded and added to the stitched video bitstream along with the prediction information. Also, the stitched raw residual block is inverse transformed and dequantized to create a stitched decoded residual block. The residual block is added to the predicted block to generate the stitched reconstructed block in the next frame of the sequence.

Multiple images taken from different locations or angles and viewpoints are joined and stitched. After the stitching and joining a much larger video or image scenery may be produced than any one image or video form which the final scenery was produced or an image of a different perspective than any of the input images may be produced.

The invention relates to a road network traffic condition monitoring system based on a video image processing technology, and belongs to the field of traffic engineering. Along with that video monitoring devices are added to a road network continuously, manual real-time monitoring of road network traffic conditions is difficult to carry out. The system monitors the road network traffic conditions in real time by processing video images to obtain useful information from the video images. The road network traffic condition monitoring system comprises a camera video information acquisition module, a traffic condition extraction module, a perspective shifting module, a video stitching module, a three-dimensional reconstruction module and a multi-level display module. A monitoring staff selects a road network traffic condition panoramic display mode as required to monitor the panoramic condition of road network traffic on a monitor wall, further a road section traffic video real-time display mode can be selected for a congestion area, and an animated display mode can also be selected to observe three-dimension reconstruction, panoramic stitching or vertical view of interested road sections so as to timely respond to traffic emergency situations.

The invention provides an intelligent video analysis system and method based on PTZ video camera cruising. The system comprises a front-end PTZ video camera and a rear-end server. The rear-end server comprises a cruising configuration module, a PTZ video camera control module, a video analysis configuration module, a system control module, an intelligent video analysis module and an alarm management module. The cruising configuration module is used for setting cruising groups and cruising points of the system to generate a cruising list. The PTZ video camera control module is used for analyzing the cruising list and generating a cruising execution list automatically. The video analysis configuration module is used for configuring related intelligent video analytical algorithms for all the cruising points and configuring the cruising points into the cruising list. The system control module is used for calibrating video camera parameters of each cruising point, calling a video stitching module and automatically generating a panorama splicing map in the whole cruising period according to the execution sequence of the cruising points. The intelligent video analysis module is used for conducting target detection and event analysis according to related setting and giving a real-time alarm to a detected event. The alarm management module is used for conducting corresponding local management on the alarm.

The invention discloses a panoramic video stitching method based on a multi-depth image transformation matrix. The panoramic video stitching method based on the multi-depth image transformation matrix comprises the following steps: synthesizing a plurality of videos provided with mutually overlapped regions and shot by a plurality of cameras into a panoramic video. The method comprises a background calibration process and a real-time stitching process. A reference planar image transformation matrix with an infinitive depth is obtained in the background calibration process, and besides, other depth information is divided into different depth levels, so that a planar image transformation matrix corresponding to each depth level is obtained; in the real-time stitching process, a reference panoramic image is obtained by using the reference planar image transformation matrix, besides, the current depth information in the overlapped region is calculated, and the panoramic image of the overlapped region is obtained according to the image transformation matrix corresponding to the depth information; finally, the panoramic image of the overlapped region and the reference panoramic image are mixed into the panoramic video image. The method disclosed by the invention can obtain stable, continuous and high-quality panoramic video, and the method has the characteristics of small calculated amount and high running speed.

A low-complexity panoramic image and video stitching method includes the steps of (1) providing a first image / video and a second image / video; (2) carrying out an image / video alignment to locate a plurality of common features from the first and second images / videos and to align the first and second images / videos pursuant to the common features; (3) carrying out an image / video projection and warping to make the first and second coordinates of the common features in the first and second images / videos correspond to each other and to stitch the first and second images / videos according to the mutually corresponsive first and second coordinates; (4) carrying out an image / video repairing and blending for compensating chromatic aberrations of at least one seam between the first and second images / videos; and outputting the stitched first and second images / videos.

An advanced dynamic stitching method for multi-lens camera system is disclosed. This invention aims to address the parallax phenomenon which exists in a multi-lens camera system. Stitching points vary with the object distance. In a video stitching system, a fast search engine to update the stitching points dynamically is needed. This invention provides an advanced method to reduce the high computation power required for the traditional block matching method of finding stitching points. As a result, the stitching points can be adjusted dynamically with the method of this invention.

The invention relates to an image information processing technology, and provides an ultrahigh resolution panorama speed dome AIO (All-In-One) system, a video stitching method and a spatial registration method of the ultrahigh resolution panorama speed dome AIO system. A device comprises an engine base element, a panorama stitching video camera comprising multiple cameras, a speed dome, a controller, a shell and a support. The video stitching method comprises the steps of lookup table calculation, stitching line calculation, image fusion and the like. The spatial registration method comprises the steps of establishing a panorama stitching image coordinate system, uniformly dividing a panorama stitching image into a plurality of rectangular regions, sampling, calculating a mapping relation of sampling points and calculating a non-sampling point mapping relation by adopting a bilinear interpolation method. According to the ultrahigh resolution panorama speed dome AIO system, the video stitching method and the spatial registration method, provided by the invention, not only can panorama monitoring be realized, but also a high-resolution monitoring scene can be provided at the same time, and quick and accurate focus location, zoom out and zoom in and quick and stable browsing of an interested target can be realized through registration linkage between a panorama real-time stitching camera and the speed dome.

The invention discloses an image brightness and color balancing method and system for video stitching. The method comprises the steps of S1, acquiring two adjacent images to be stitched, calculating an image transformation matrix according to the two adjacent images to be stitched and setting an iteration suspensive condition; S2, determining the overlapping part of the two adjacent images to be stitched according to the image transformation matrix, and determining the brightness and color compensation coefficients of the images according to the brightness and color difference of the images with similar textures in the overlapping part; S3, adjusting the brightness and color of the two adjacent images to be stitched to obtain an adjusted image according to the brightness and color compensation coefficients of the images, and recalculating the image transformation matrix according to the adjusted image; S4, repeating S2 and S3 in sequence till the iteration suspensive condition is met, obtaining a final image transformation matrix and the brightness and color compensation coefficients of the final image, and saving the current original images to be stitched as reference images. By the adoption of the method and system, brightness and color jump occurring during video stitching can be eliminated.

The invention discloses an optimized video stitching method, comprising: inputting predefined pattern images; proceeding with a transformation which combines planar and cylindrical transformation; proceeding with a merging calculation which combines linear difference merging and alpha blending calculation; and proceeding with a horizontal stitching processing by putting the processed images horizontally together into one seamless wide-angle image. The optimized video stitching method according to the invention further comprises a camera position calibration flow comprising: finding a planar matrix by using predefined pattern images; proceeding with a planar transformation of image; proceeding with an image registration by using a block matching method to find out the stitching points on the planar surface; and proceeding with a cylindrical transformation by transforming the stitching points from the planar surface to cylindrical surface.

Disclosed are a color correction apparatus for panorama video stitching and a method of selecting a reference image using the same. A method of selecting a reference image for color correction when stitching panorama video based on input images includes selecting an optimum reference image candidate from the input images based on standard deviations for overlapping regions between the input images, performing color correction on the input images based on the optimum reference image candidate, and validating the optimum reference image candidate based on the color-corrected input images.

A method and computing system for receiving a first video file containing a first plurality of video frames. A second video file containing a second plurality of video frames is received. The video files are processed to identify at least one non-graphical temporal alignment object included in each of the video files. The video files are temporally aligned using the at least one non-graphical temporal alignment object to produce temporally-aligned video files.

The invention provides a panoramic virtual alert target relay tracking device. In the invention, nine paths of videos of a camera set of the tracking device are sequentially input into three three-channel video acquiring and stitching processing boards for video stitching or single-path video extraction output, and the output videos of the three three-channel video acquiring and stitching processing boards are input into a video input interface of a three-channel video acquiring and stitching target tracking board to realize panoramic seamless stitching display under a natural scene; and a motion target of a virtual alert area is detected according to an external command to finish stable and real-time tracking of a threatening target. The panoramic virtual alert target relay tracking device solves the problems that large-view-field monitoring can be realized in the actual application but a remote target cannot be precisely and stably tracked, and the remote target can be precisely and stably tracked but is not subject to the panoramic monitoring, and can ensure that the target can be accurately and stably tracked under the condition of monitoring the threatening target.

The invention relates to the technical fields of image processing and video processing, and provides a multi-scale real-time monitoring video stitching device based on feature points and a multi-scale real-time monitoring video stitching method. The multi-scale real-time monitoring video stitching device comprises cameras, video decoding circuits, a video capture module, image pre-processing modules, an SDRAM control module, an image interception and conversion module, a feature point extraction module, a feature point filter module, an image fusion cutting module, an output control module, a feature point matching module and an image homography matrix calculation module, wherein the cameras are connected with the video decoding circuits; the video capture module is connected with a plurality of the video decoding circuits and the image pre-processing modules; the SDRAM control module is connected with other modules; the feature point matching module is connected with the feature point extraction module and the feature point filter module; and the image homography matrix calculation module is connected with the feature point filter module and the image fusion cutting module. According to the multi-scale real-time monitoring video stitching device disclosed by the invention, a video with a wide viewing angle can be generated by performing seamless stitching on video data acquired by a plurality of paths of high definition cameras, so that the requirements for real-time performance can be met, and the stitching accuracy can be increased.

The invention discloses a panoramic video stitching method and device. The panoramic video stitching method is used for stitching video images acquired by front-end devices to be stitched into a panoramic video image through a client and comprises the steps of binding the front-end devices to be stitched into a resource group, acquiring four vertices of a stitched video image part of each front-end device so as to form a cut quadrilateral corresponding to each corresponding front-end device, calculating the deformity correction and conversion matrix of each front-end device according to the acquired vertices and a set standard rectangle, converting the video images acquired by all the front-end devices, and then, laying out the converted video images according to set position information, so as to form and display a panoramic video image. The panoramic video stitching device disclosed by the invention comprises a configuration module, a vertex acquisition and matrix generation module and a stitching module. According to the method and the device, disclosed by the invention, the deformity correction and conversion can be carried out by the front-end devices or the client so as to realize panoramic stitching, and the requirements on the performance of matrix conversion equipment are not high, so that the method and the device are particularly applicable to the upgrade and development of old items.

An exemplary video generation system (the “system”) receives a plurality of overlapping and concurrently-captured video instances from a plurality of video capture devices in a static configuration. The system temporally synchronizes concurrently-captured video data from each video instance to form a plurality of image sets and identifies a particular image set from the plurality of image sets. The system then performs a camera registration process on the particular image set in order to determine camera registration parameter data. Based on the camera registration parameter data determined using the camera registration process with respect to the particular image set, the system then performs a video stitching process on each of the image sets within the plurality of image sets to form stitched video content representative of a scene captured by the plurality of video capture devices in the static configuration. Corresponding methods and systems are also disclosed.

The invention provides a distributed video decoding system and a synchronous stitching and on-wall method thereof. The distributed video decoding system comprises a decoder group consisting of a plurality of discrete IP (Internet Protocol) video decoders. According to the method, synchronous stitching and on-wall of a plurality of discrete IP video decoders are realized by using a video stitching and synchronizing mechanism and a decoding control mechanism. According to the method and the system, parts of IP images are selected through a plurality of decoders respectively to be directly decoded and put on a wall without being limited to a centralized stitching controller or purchasing an expensive stitching management hardware platform, so that the cost and the complexity are effectively reduced, and meanwhile, a better effect is achieved; the synchronizing mechanism of the distributed method is implemented on the basis of software, the hardware dependency is extremely low, and the system can be very conveniently transplanted to different hardware platforms.

The invention provides an online classroom directed broadcasting control method and system. The method includes the following steps that stitching parameters are set by a parameter management device, presetting bit parameters are set by the parameter management device according to a plurality of paths of input first video data, the stitching parameters are sent to a video stitching control device, and the presetting bit parameters are sent to a moving target tracing device; when the moving target tracing device detects a moving target based on the multiple paths of input first video data, a camera is traced according to the presetting bit parameters so that the moving target can be traced, and second video data containing the moving target are informed to the video stitching control device as main video data; the video stitching control device stitches the multiple paths of second video data according to the stitching parameters and the main video data so that combined video data can be obtained, and the combined video data are sent to the exterior. The high integration level smart directed broadcasting system based on PC architecture is provided, and the integration level of the system is greatly improved.

The invention relates to a local registration parallel video stitching method and a local registration parallel video stitching system. The method comprises the steps of 1, carrying out three-dimensional coordinate view angle calibration, acquiring video images so as to obtain multi-channel video images, and decomposing the multi-channel video images into video data; 2, using received a plurality of Nth frame of data as current data, wherein the N is a natural number; 3, carrying out pre-processing on the current data, and acquiring a plurality of clipped video frames; 4, judging a neighboring relation of the clipped video frames, and establishing an adjacent frame spatial relation model according to the neighboring relation; executing a step 5, receiving (N+1)th frame of data to act as the current data, and executing the step 3; 5, carrying out registration on a plurality of video frames having a neighboring relation, and acquiring a homography matrix between the adjacent video frames; and 6, carrying out video scene stitching according to the homography matrix, and completing parallel video stitching. The method and the system provided by the invention can carry out stitching processing on multi-channel video efficiently and accurately, and are low in complexity, high in calculation speed, high degree of parallelism and good expansibility.

The invention discloses a panoramic video real-time stitching method and device. The method includes the following steps: receiving multipath wide-angle video data shot by multiple image acquisition units; conducting synchronous processing on the multipath wide-angle video data; writing each path of synchronized wide-angle video data into a memory, and spreading the wide-angle video data to carry out distortion correction; and merging and stitching overlapped areas of the multipath wide-angle video data. Panoramic videos can be stitched in real time in a panoramic camera without being stitched and post-processed by a cell phone or a computer, the panoramic videos can be acquired and stitched immediately, the frame rate is consistent before stitching and after stitching, and the timeliness of panoramic video stitching is improved. Moreover, the stitching cost is low, no other hardware cost is needed, the operation is simplified, and the device is simple and easy to use.

The invention is applicable to the technical field of video stitching, and provides a method, a system and an electronic device for stitching multiple channels of videos. The method includes dividing a frame memory into a plurality of memory rooms according to a mode for stitching the multiple channels of videos; sequentially writing a row of data into each memory room, and repeating the procedure until all data of the various channels of videos are written into the memory rooms; and sequentially reading the various rows of data in the frame memory and displaying the read data so as to stitch the multiple channels of videos without synchronous trigger. The method, the system and electronic device have the advantages of easiness in control, good synchronization and high image quality.

The invention discloses a video stitching method for a sports scene. The video stitching method for the sports scene includes that firstly, using an improved congruence-transformation invariant-feature algorithm to solve common feature points in different videos to improve feature extraction speed; secondly, using an iteration method to calculate a minimum brightness difference route to dynamically regulate a stitching seam to process problems when a moving object passes through the overlapped region between stitching frames so as to avoid the double image of the moving object after passing the overlapped region; finally, using a feature-based video tone normalization method to eliminate the color difference between video frames. The video stitching method for the sports scene can be broadly used for the video monitoring for the large sports scene; the video stitching method for the sports scene improves the adaptation of the video stitching to different environments, solves the common problems of the video stitching and directly and greatly drives the improvement of the video stitching algorithm.

The invention relates to the digital image processing technology field and discloses a binocular camera imaging control method used for video stitching and an apparatus thereof. The binocular camera imaging method comprises the following steps of carrying out stitching fusion on two current images collected by a binocular camera in a current frame; calculating a fusion luminance difference and a fusion color difference of a fusion area of the current images before the fusion and after the fusion; according to the fusion luminance difference and the fusion color difference, adjusting a shooting parameter of the camera used to shoot the current images; and making the camera used to shoot the current images shoot a next frame of images withan adjusted shooting parameter. In the invention, brightness and colors of the cameras can be controlled from an aspect of a video source so that the brightness and the colors of the fusion area and a non-fusion area are close to each other after stitching fusion is performed on the next frame of two images; and a condition that an integral stitching effect generated through fusion is not uniform because the difference of the brightness or the colors of the two cameras is great is avoided.

The invention belongs to the technical field of video processing. In order to avoid ghost images and object deformation during stitching of videos with moving objects and complete synchronization of information of different video sources on a timeline to enable the information to be well used for various processing based on still image registration stitching during subsequent stitching and to obtain good effect, the technical scheme includes that a multisource video stitching method with the time domain synchronization calibration technology includes the steps: storing inputted video sequences of different video sources into a frame buffer for pre-processing; detecting Harris corners of frame images of each video by an image gray value and optimizing distribution of the corners; performing coordinate unification of two to-be-stitched images spatially and completing spatial match; and performing image fusion after calibration. The multisource video stitching method with the time domain synchronization calibration technology is mainly applied to video image processing.

A video stitching method based on a dynamic optimal stitching line belongs to the technical field of video information processing. The method comprises the following steps: S1, calculating the overlap region of spatially adjacent images; S2, separating the foreground and background images of the overlap region; S3, calculating out an optimal initial stitching line; S4, determining whether each pixel on the stitching line of frames in front and behind is a moving pixel through calculation; S5, judging whether to update the optimal stitching line; S61, updating the optimal stitching line, or S62, maintaining the current optimal stitching line; and S7, fusing the images according to the optimal stitching line to get a panoramic image after stitching. The problem that ghosting is likely to occur during video stitching under the condition that the overlap region contains a moving object is solved. A good video image stitching effect is achieved.

The invention provides a multi-image video stitching method and device. The method includes the following steps of collecting video signals, conducting decoding conversion, and then obtaining video interwoven signals; separating and analyzing the video interwoven signals, obtaining synchronous signals and multi-channel video interwoven signals, and conducting cross processing on the multi-channel video interwoven signals; conducting interlacing removing on the video signals undergoing cross processing; calculating the perpendicular resolution ratio according to the synchronous signals, and judging whether the video signals undergoing interlacing removing belong to a 480p system or not according to the perpendicular resolution ratio; if yes, the video signals of the 480p system are converted into video signals of a 576p system; conducting multi-image video stitching according to the video signals of the 576p system. According to the method and the device, multi-channel video signal stitching display can be achieved through an FPGA, cost is low, the amount of collected information is large, and a PCB is simple in wire arrangement and port connection and high in controllability.

The invention discloses a video stitching method based on image semantic segmentation. The video stitching method comprises the following steps: acquiring a video single-frame image acquired by a certain video sensor; accurately acquiring a remote sensing image of the target area as a splicing reference background according to the video position information in combination with surface feature shape features in the single-frame image; performing semantic segmentation on the video single-frame image and the spliced reference background image by adopting a full convolutional neural network; combining the segmentation result with a matching method based on a feature vector Euclidean distance to serve as a matching constraint condition of feature points, and selecting a matching feature point set; according to the selected matching feature point set, realizing matching of each frame of image of the video and the splicing reference background image; and carrying out time sequence fusion on all results obtained by matching to obtain a final video splicing result. The method has the advantages that more accurate feature point matching and high-quality video splicing are achieved, the method is suitable for multi-video splicing with a large overlapping area, and multi-video splicing with a small overlapping area can be well achieved.

The invention relates to the field of video processing, and discloses a video stitching method and device, electronic equipment and a computer readable storage medium, and the method comprises the steps: detecting the similarity between a first image and a second image, wherein the first image is the last frame of image of a first to-be-stitched video, and the second image is the first frame of image of a second to-be-stitched video; then, if the similarity meets a preset condition, determining a motion vector of the first image relative to the second image; according to the motion vector, determining at least one compensation frame between the first image and the second image, and splicing the first image and the second image based on at least one compensation frame so as to splice the first to-be-spliced video and the second to-be-spliced video. According to the method provided by the embodiment of the invention, the smooth compensation can be efficiently carried out on jitter occurring at the joint in real time, so smooth transition can be carried out among multiple video segments, and the occurrence of image jitter or image hopping after the multiple video segments are splicedis effectively reduced.