Method and device for synchronizing compressed dictionary

Abstract

The embodiment of the invention discloses a method and a device for synchronizing a compressed dictionary. The method comprises the following steps of: obtaining synchronizing information fields of dictionary entries corresponding to data to be sent of the compressed dictionary; judging whether network equipment at a receiving terminal has the dictionary entries according to the synchronizing information fields, if the network equipment at a receiving terminal does not have the dictionary entries, synchronizing the dictionary entries by using the network equipment at the receiving terminal to ensure that the network equipment at the receiving terminal can uncompress the compressed data to be sent according to the dictionary entries after receiving the data to be sent, which is subjected to redundancy data removal and compression according to the dictionary entries. According to the embodiment of the invention, data redundancy can be decreased by reducing the synchronization for the invalid dictionary entries of the equipment.

Description

technical field [0001] The invention relates to data compression technology, in particular to a method and device for synchronizing compression dictionaries. Background technique [0002] Data compression technology is widely used, and can compress various file formats such as text, image, audio, and video. Compression processing can be performed not only on personal computers, servers, and various special devices, but also on network devices (such as routers and switches). The most typical application scenario is data transmission between various network devices of an enterprise. In the process of data transmission, due to the existence of a large amount of data redundancy, the network device at the sending end compresses the data first, and decompresses it at the network device at the receiving end, which can effectively reduce the amount of data transmission on the network, make full use of the network bandwidth and Reduce transmission delay. [0003] There are two type...

AI Technical Summary

Problems solved by technology

However, when there are many network devices in an enterprise, dictionary synchronization needs to be performed among multiple network devices, and the complexity is greatly increased.

An existing technical solution is to maintain a separate compression dictionary for other network devices on one network device, but the biggest problem is the waste of storage space, and the data between network devices in the enterprise has great redundancy

There is also a dictionary synchronization method in the prior art scheme, which uses a unified dictionary mode and adopts the dictionary synchronization mechanism of the global network device, but this method is actually a blind synchronization, because the device cannot predict whether to use the synchronized dictionary entry in the future , these dictionary entries are useless when there is no similar data transmission, and will eventually age out or be replaced by other entries due to space constraints, and the dictionary entries include indexes, lifetimes, corresponding data segments, etc. The synchronization between devices will also occupy a large amount of memory and disk space on the device. When there are many network devices, it will seriously increase the data traffic on the network.

In summary, the existing technology still cannot avoid reducing the synchronization of dictionary entries between devices to reduce data redundancy

Images