154 results about "Volume (compression)" patented technology

Embodiments of the disclosure relate to archiving data in a storage system. An exemplary embodiment comprises making a flash copy of data in a source volume, compressing data in the flash copy wherein each track of data is compressed into a set of data pages, and storing the compressed data pages in a target volume. Data extents for the target volume may be allocated from a pool of compressed data extents. After each stride worth of data is compressed and stored in the target volume, data may be destaged to avoid destage penalties. Data from the target volume may be decompressed from a flash copy of the target volume in a reverse process to restore each data track, when the archived data is needed. Data may be compressed and uncompressed using a Lempel-Ziv-Welch process.

The invention discloses a point cloud attribute compression method based on deletion of 0 elements in a quantization matrix. In view of the quantization matrix during the point cloud attribute compression process, the optimal traversal order is adopted at a coding end to enable 0 elements to be centrally distributed at a tail end in a generated data stream, entropy coding is carried out after the0 are deleted, the data volume of the data stream is reduced, a bit stream generated after coding is reduced, point cloud geometry information is combined at a decoding end to recover the deleted 0 elements, and the method is ensured not to introduce extra errors. The method comprises steps: the traversal order of the quantization matrix is optimized at the coding end; the 0 elements at the tail end of the data stream are deleted; the geometry information is consulted to recover the quantization matrix at the decoding end; and a point cloud attribute compression coding process and a decoding process are carried out. At the point cloud attribute compression coding end, seven traversal orders are adopted for the quantization matrix, and distribution of the 0 elements in the data stream is more centralized at the tail end; the 0 elements at the tail end of the data stream are deleted, redundant information is removed, and the data volume in need of entropy coding is reduced; and at the decoding end, the point cloud geometry information is combined to complete the deleted 0 elements, the quantization matrix is recovered according to the traversal order, and the compression performanceis improved on the premise of not introducing new errors.

The invention discloses a rapid hyperspectral signal compression scheme for a huge data volume of a hyperspectral image. By a compression coding scheme, the spatial and inter-spectrum correlation of the hyperspectral image is eliminated by adopting a vector quantization clustering technology, superior codeword is generated in combination with a conventional Linde Buzo Gray (LBG) clustering algorithm and a fast codeword searching algorithm, and simultaneously, coding is finished. Hadamard transform is performed on input vectors; and in a Hadamard domain, an initial codebook is constructed, andsimultaneously, fast clustering is performed by utilizing a three-step elimination inequality to effectively generate a final codebook and codes. By the hyperspectral image compression scheme provided by the invention, relatively lower image quality loss can be turned into a relatively greater compression ratio to fulfill the aim of fast coding in combination with the properties of the Hadamard transform and the characteristics of vector quantization.

An apparatus and method for lossless run-length data encoding is disclosed. In the first stage of the method, an input data sequence is transformed without increasing its volume in order to obtain long sequences of identical digits. In the second stage, every such sequence is replaced with a unique shorter sequence. The compressed data is decoded performing corresponding inverse operations. The method is very efficient for compression of some classes of digital images with long sequences of the same number, such as graphics, texts, signatures, and fingerprints.

The invention discloses a high-resolution video image compression transmission method and system based on an FPGA. The method comprises the following steps: acquiring a video data stream and sending the video data stream to the FPGA; obtaining a YCbCr4:4:4 format through color gamut conversion, circularly writing into 16 video row cache RAMs, dividing eight RAMs into one group and two groups, andafter each group of RAMs is written, sequentially reading data from left to right and reading eight columns each time to form an 8X8 image data block until the whole group of data is completely read;performing DCT transform, ZIGZAG scanning, quantification, RLE run length coding and Huffman coding sequentially on the 8*8 image data blocks until all the 8 rows of data are processed according to the 8*8 image data blocks, and if the number of points of the last block is smaller than 8 pixels, performing corresponding complementation; and completing compression until the processing of the wholeframe of image is finished. The system comprises an FPGA, and the FPGA comprises video data stream input, write RAM control, a video cache RAM, 8*8 block generation, DCT, ZIGZAG scanning, quantification, RLE run length coding, Huffman coding and the like. The high-resolution video image compression is realized by only using the single FPGA, so that the data volume is greatly reduced.

The invention discloses a video compression method, device and equipmentand a computer readable storage medium. The method comprises the steps of obtaining a current frame of to-be-compressed image; comparing the current frame of to-be-compressed image with the previous frame of to-be-compressed image to obtain change image block data, wherein the change image block data comprises target image blocks, which are different from the previous frame of to-be-compressed image, in the current frame of to-be-compressed image and image coordinates corresponding to the target image blocks; and performing image compression on the change image block data to obtain an image block compression file corresponding to the current frame of to-be-compressed image. According to the invention, the current frame of to-be-compressed image is compared with the previous frame of to-be-compressed image to obtain the data of the change image blocks, and the image blocks needing to be compressed are determined by using the inter-frame compression technology, so that the data volume needing to be compressed is reduced, the video compression ratio is greatly improved, the network transmission data volume is reduced, the image transmission time is shortened, and the remote display effect is ensured.

The invention relates to the technical field of artificial intelligence, and provides an image processing method, device and equipment and a computer readable storage medium, and the method comprisesthe steps: obtaining a to-be-processed target image, and determining whether the data size of the target image is greater than or equal to a preset data size threshold or not; if the data volume of the target image is greater than or equal to a preset data volume threshold, obtaining a resolution parameter, a compression quality parameter and an image size parameter of the target image; and processing the target image according to the resolution parameter, the compression quality parameter and the image size parameter, and outputting the processed target image. The invention relates to image processing. The adaptability and the display effect of a target image on different display devices are effectively enhanced.

The invention discloses a digital KVM (Keyboard, Video and Mouse) switcher oriented screen video compression method. The method comprises the steps of (1), inputting a frame of screen video data; (2), writing frame header information of a current video frame in a stream; (3), obtaining an uncoded chrominance component sub-frame from the current video frame; (4), obtaining an uncoded data block from a current chrominance component sub-frame; (5), calculating coding information and reconstruction data of a current block under various candidate coding modes, and selecting a final coding mode; (6), writing the coding information of the current block in the stream; (7), repeating the steps (4) to (6); (8), carrying out byte alignment to the stream written in the current video frame; (9), repeating the steps (3) to (8); and (10), carrying out frame synchronization header escape on the stream generated by the current video frame. According to the method, under the limited calculation complexity, the overall and peak data volume of the video stream of the screen can be effectively reduced; moreover, the high reconstruction video quality is ensured.

The invention discloses a data consistency detection method, device and equipment and a computer storage medium. The detection method comprises the following steps: receiving to-be-detected data, anddividing the to-be-detected data into a plurality of data groups; allocating indexes to the data groups; according to the indexes, retrieving a data set needing fragment compression, and performing fragment compression on the data in the set; and converting the to-be-detected data after fragment compression into a detection task according to the dynamically generated subscription list, and publishing the detection task to a corresponding detection node according to a subscription relationship to carry out consistency detection. According to the embodiment of the invention, by grouping the dataand establishing the index, the detection processing on each piece of data is avoided, so that the data volume needing to be detected is reduced; the problem of data fragmentation is solved by performing fragmentation compression on the data in the group; through a subscription / release mechanism, full-process recording and tracking of transaction consistency detection are realized, and meanwhile,the expandability of the detection system is improved.

The invention relates to a method of digital acquisition and image processing for Dongba pictograph. The method includes the following steps: acquiring digital images of Dongba classic ancient books; denoising the acquired digital images; performing highlight treatment to the stroke characteristics of the digital images denoised and enhancing the contract ratio between the target characters and the background; performing contour detection to the characteristic highlighted digital image information; performing size unification to the contour detected digital image information to achieve the digital acquisition and image processing of the Dongba pictograph. With the application of the method of digital acquisition and image processing for Dongba pictograph, digital acquisition of fuzzy paper books is effectively achieved, the ratio of data volume compression is high, and clear images are obtained by smooth arc transition between the denoised noise and image signals. The method is convenient for digital inheriting and protecting and can be widely used in the field of characters and images processing.

The embodiment of the invention relates to the technical field of data transmission, and discloses a data compression method, electronic equipment and a storage medium, and the method comprises the steps: carrying out the primary compression of an initial data sequence through employing a first coding algorithm, and then carrying out the secondary compression through employing a second coding algorithm, so as to enable the initial data sequence to be fully compressed, and a data volume is reduced as much as possible. In addition, the length of the second data sequence after the secondary compression is compared with the length of the first data sequence after the primary compression to ensure that the secondary compression is effective, so that the compressed data volume can be accurately controlled to be effectively reduced relative to the data volume before the compression, the transmitted data volume can be reduced, and the transmission efficiency is improved.

The embodiment of the invention provides a cloud video transcoding method and device, a decoding method and device, and electronic equipment, and the method comprises the steps: receiving a video request from a user side, and extracting the background information of a corresponding video and a coding region of a target foreground; based on the background duration, performing first encoding on therepresentative frame images with the same background to obtain first background encoded data, and performing second encoding on the rest frame images to obtain second background encoded data, whereinthe compression ratio of the second encoding is greater than the compression ratio of the first encoding; performing third encoding on the encoding area of the target foreground to obtain target foreground data, wherein the compression ratio of the third encoding is less than or equal to the compression ratio of the first encoding; and combining the first background data, the second background data and the target foreground data into a target video file, and sending the target video file to a user side. The data volume of the target video file can be reduced, and the target video file with a lower transmission code rate is improved.

The embodiment of the invention provides a data processing method and device. The data processing method comprises the steps: obtaining to-be-processed time series data, and dividing the time series data into first time series data and second time series data; coding the first time sequence data based on a dictionary coding algorithm to generate a first coded value; coding the second time sequence data based on a column compression algorithm to generate a second coded value; and generating processed time sequence data according to the first coded value and the second coded value. According to the data processing method, the time sequence data is divided into two parts according to the data type, and the compression coding method corresponding to each part of time sequence data is adopted to perform compression coding on the time sequence data, so that the size of the time sequence data is greatly reduced, the occupation of the time sequence data on the storage space of the database is reduced, and the data volume of the time sequence data written into the database is increased.

The invention discloses a data compression method suitable for marine meteorological visualization, which comprises the following steps of: step 1, reading original data, namely reading the original marine meteorological data, and extracting a time slice and meteorological element data; step 2, meteorological data preprocessing: performing integer processing on the original data; step 3, removingcorrelation of the meteorological data; and step 4, compressing code stream data and performing entropy coding on the meteorological data subjected to decorrelation. Compared with an existing data compression mode, the method is more suitable for compressing the data visually displayed by the marine meteorology, the characteristics of high real-time requirement and large data volume of traditionalmeteorological data are fully considered, the marine meteorological data can be compressed, the data repeatability is reduced, redundant labels are removed, and the data size is reduced to the maximum extent. The method specifically comprises the steps that 1, original data can be read; 2, truncating is performed according to the observation precision of the elements; and 3, the correlation of the meteorological data is removed; and 4, the marine meteorological data compression ratio is increased.

The embodiment of the invention discloses a video deduplication and compression method and device, a server and a storage medium. The method comprises the following steps: extracting a first frame image from a target video as a reference image of a compression set; obtaining a neural convolution image feature of the first frame image; for each frame of image starting from the second frame of imageof the target video, calculating the distance between the neural convolution image feature of the current frame of image and the neural convolution image feature of the reference image; judging whether the distance is greater than a preset threshold value or not; if yes, storing the current frame image into the compression set and defining the current frame image as a new reference image; and ifso, deleting the current frame image. According to the technical scheme of the embodiment of the invention, the neural network technology is fused into the video deduplication compression technology by calculating the distance between the neural convolution image feature of the current frame image and the neural convolution image feature of the reference image, so that the data volume of video compression is greatly reduced, and the compression efficiency is improved.

The invention relates to an image compression coding method and device, computer equipment, a storage medium and a computer program product. The method comprises the steps that an image to be compressed is acquired, the image to be compressed is divided into a plurality of image blocks, and each image block comprises a plurality of pixels; for each image block, judging the type of the image block according to pixels in the image block; if the image block is a color image block, judging whether pixels in the image block meet a preset condition or not; wherein the preset condition comprises at least one of a pixel grouping condition, a pixel component equality condition and a pixel component difference value and corresponding threshold value relation condition; and if the pixels in the image block meet one of the preset conditions, coding the image block by adopting a coding rule corresponding to one of the preset conditions. According to the method provided by the invention, the coded data volume is small, the occupied storage space is small, and meanwhile, the decompressed data also has relatively high quality.

The invention discloses a method for improving application decompilation speed, an intelligent terminal and a storage medium. The method comprises the steps: obtaining an APK file of an application, carrying out the preprocessing of the APK file, and enabling the preprocessing to be used for deleting a preset file, which does not need to be decompiled, in the APK file; performing decompression processing on the preprocessed APK file, and storing a decompressed folder; and selecting a detection file required for application safety detection in the decompressed folder to perform decompilation. According to the application safety detection method and device, the files which do not need to be decompiled in the application APK files are deleted, and only the files needed when application safetydetection needs to be carried out are decompiled, so that the application decompilation time is greatly shortened, and the application safety detection requirement of a large data volume is met.

The invention discloses a data mapping identification method and device, equipment and a medium, and the method comprises the steps: carrying out the mapping arrangement of original data, carrying outthe preprocessing of the original data, and facilitating the subsequent compression processing; by encoding and compressing the first mapping bitmap, on the premise of not influencing various analysis requirements brought by data collection, the occupied space of the data after one-time compression is reduced to 20% or below, and the requirements for the transmission bandwidth and the cloud storage space are reduced; the data volume of the first compressed image is compressed and uploaded again based on the preset image recognition model when the data volume of the first compressed image exceeds the preset threshold, so that the data volume of the original data is further reduced, the requirement of edge side computing power is effectively reduced, and compared with a traditional data uploading mode, the transmission resource consumption is greatly reduced.

The invention provides an intelligent video compression method and device based on optical flow decision. The method comprises the following steps: acquiring panoramic semantic segmentation expression of a current frame; judging whether the current frame is a key frame or not: if so, obtaining the optical flow energy intensity of the current frame; obtaining the score of an optical flow energy threshold OPET; and judging whether the optical flow energy intensity is greater than the score of an optical flow energy threshold OPET or not: if so, carrying out quantization processing on the image characteristics of the current frame by adopting a high bit number. The invention has the beneficial effects that according to the time continuity and the space consistency of the optical flow, the scene analysis technology is utilized to reserve full resolution of frames related to stronger motion information in the video frame group, and the part with less information amount is transmitted in a feature extraction mode after down-sampling, so the transmission data volume is effectively reduced; by extracting the reconstruction error information and returning the reconstruction error information to the video frame, the texture information is better reserved in the reconstruction process, and better bit rate- distortion optimization of the video compression system is realized.

The invention discloses a cloud hard disk data compression backup and recovery method and device, electronic equipment and a computer readable storage medium, and the method comprises the steps: segmenting a source cloud hard disk to obtain a plurality of initial data blocks, and determining the initial offset of each initial data block in the source cloud hard disk; compressing non-zero data blocks in the initial data blocks to obtain compressed data blocks, and calculating the data volume of each compressed data block; generating corresponding backup information by using the initial offset and the data volume corresponding to the compressed data block, and determining a preset sequence corresponding to the backup information; writing the compressed data block into the backup volume; and when a recovery request is detected, performing data recovery by using target backup information specified by the recovery request and a corresponding target preset sequence. According to the method, the occupation amount of the storage space can be reduced on the premise of ensuring correct data recovery.

Embodiments of the invention disclose a log data compression processing method and device, electronic equipment and a storage medium. The method comprises the steps of obtaining each first attribute name in to-be-processed first log data; according to a mapping relation between currently stored attribute names and compression names and each first attribute name in the first log data, determining a first compression name corresponding to each first attribute name, wherein the character number of the first compression names is smaller than that of the first attribute names; and replacing each first attribute name in the first log data with the corresponding first compression name to obtain compressed second log data. Through the technical scheme of the embodiment of the invention, the log data volume can be greatly reduced under the condition that the text structure of the log data is not damaged.

The embodiment of the invention discloses a video sequence frame compression method and device, a video sequence frame decompression method and device, electronic equipment and a storage medium. The embodiment of the invention provides a technical scheme. When video frame data is compressed, each frame of analyzed video frame data is compared with the previous frame of video frame data, corresponding difference rectangular areas are determined, an LZ4 algorithm is used for compressing the data in the difference rectangular areas one by one, and the data and corresponding coordinate informationare packaged and stored in a video file in sequence. And then when the video file is decompressed and played, each frame of read video frame data is decompressed to extract a difference rectangular area and corresponding coordinate information to obtain the corresponding previous frame of video frame data in real time, and the current video frame data is rendered based on the previous frame of video frame data, the difference rectangular area and the corresponding coordinate information. By adopting the technical means, the decompressed data volume can be reduced, the video decompression efficiency can be improved, and the video decompression playing effect can be optimized.

The invention provides a video coding method and system based on a digital retina and a storage medium, and the method comprises the steps: obtaining an input image, carrying out the inter-frame / intra-frame prediction based on a block, and obtaining first coding prediction data; according to the input image, performing inter-frame / intra-frame prediction based on a depth prediction model to obtain second coding prediction data; and when the second coding prediction data volume is smaller than the first coding data volume, coding according to the second coding prediction data. According to the method, the coding compression mode is adaptively selected, the feature extraction capability of the depth model is utilized, redundant information in the image is further compressed, the coding performance is greatly improved, and a higher compression ratio is realized.

The embodiment of the invention discloses a firmware upgrading method and device for embedded equipment, a terminal and a storage medium. The method comprises the steps: acquiring a firmware compressed file; transmitting the firmware compressed file to a preset first storage area of the embedded device; verifying the firmware compressed file in the preset first storage area; if the verification is passed, decompressing the firmware compressed file to a preset second storage area of the embedded device; and restarting the embedded equipment to enable the embedded equipment to execute the firmware obtained by decompression, and completing firmware upgrading. According to the scheme, the firmware compressed file is obtained by compressing the firmware, the firmware compressed file is subsequently transmitted, in the transmission process, the data volume needing to be transmitted is reduced, the data transmission speed is improved, the storage space of the preset first storage area is reduced, the storage space of the embedded device is reduced, and the cost of purchasing a large storage space is reduced.

The invention discloses a system and method for converting JSON weather data into a JPEG picture. The system and the method are used for converting a source file for storing weather data in a JSON data format into a target file in a JPEG picture form; reading header information of the JSON data; calculating data such as a maximum value, a minimum value, an intermediate value and a difference valuebetween the maximum value and the minimum value of the JSON data volume, and storing the data to the head of the JPEG picture file; and calculating offset difference data in the JSON data volume, converting the offset difference data into four-byte data, and storing the four-byte data into a data part of the JPEG picture file so as to finally generate a JPEG picture target file. The JPEG picturefile is small in size, high in transmission speed and easy to encrypt, and the JPEG picture file after data compression occupies a small storage space, so that the converted file can save a large amount of storage space and network flow.

The invention is suitable for the technical field of computers, and provides a power load data compression method. The method comprises the steps of obtaining to-be-compressed power load data; determining a target character from the target data; obtaining a first character string corresponding to the target character, wherein the first character string is used for identifying position informationof the target character in the target data; removing the target character from the target data to obtain a second character string; and generating target compressed data corresponding to the target data based on the target character, the first character string and the second character string. According to the method, the target character, the first character string and the second character stringare acquired, and the target compressed data of the original power load data are generated through the target character, the first character string and the second character string, so that the power load data volume is increased without increasing the storage capacity; the production cost of an electric energy meter is reduced; and storage resources are saved.

The invention provides HEVC intra-frame coding compression performance optimization research combined with a convolutional neural network. The HEVC intra-frame coding compression performance optimization research integrates a down-sampling process, an HEVC coding and decoding process and an up-sampling and quality enhancement process. In order to efficiently extract the structural features of video frames, two convolutional neural networks are integrated in the proposed compression framework. According to the invention, a down-sampling convolutional neural network (DwSCNN, Down Sampling CNN) is provided to replace bicubic down-sampling; detail information is reserved while the resolution is effectively reduced; a more compact low-resolution video sequence is obtained; the low-resolution video sequence is subjected to further data volume compression through HEVC (High Efficiency Video Coding) intra-frame coding, and a quality-enhanced convolutional neural network (PPCNN,Post ProcessingCNN)) is provided to improve the quality-reduced video sequence which is recovered to the original resolution after decoding. The method can be widely applied to the fields of digital movie shooting transmission, literary and sports activity live broadcast, remote education training, target detection and the like.