Data filtering and storing device

Abstract

The invention discloses a data filtering and storing device which comprises a controller and a flash memory unit connected to the controller, and a data filtering unit is further connected between thecontroller and the flash memory unit. The controller sequentially comprises a write-in unit and a reading unit, the reading unit is connected with the data filtering unit, and the data filtering unitis respectively connected with a target block and an auxiliary target block in the flash memory unit; the auxiliary target block is further connected with the write-in unit in the controller, and thedata filtering unit, the auxiliary target block and the write-in unit are sequentially connected to form a data filtering feedback system. The data filtering unit filters out old data information andstores the old data information in the auxiliary target block, when the same data information is written in again, an alarm can be given out in time, repeated write-in of the data information is avoided, the read-write efficiency of the data storage device is improved, the storage pressure of the flash memory unit is reduced, and the storage relative capacity of the flash memory unit is effectively increased.

Description

technical field [0001] The invention belongs to the technical field of big data, in particular to the technical field of data storage, in particular to a data filtering storage device. Background technique [0002] Data storage objects include temporary files generated during data stream processing or information that needs to be searched during processing. Data is recorded in a certain format on a computer internal or external storage medium. Data storage should be named, and this naming should reflect the composition meaning of information characteristics. Data flow reflects the data flowing in the system, showing the characteristics of dynamic data; data storage reflects the static data in the system, showing the characteristics of static data. . [0003] Both disk and tape are commonly used storage media. Data storage organization varies by storage medium. On the tape, the data can only be accessed as sequential files; on the disk, sequential access or direct access...

AI Technical Summary

Problems solved by technology

[0007] In the existing storage devices, the main technical problem is that the storage capacity of the flash memory unit is not enough to support an increasing amount of data information, and various data information has several repeated contents, resulting in long reading time and low flash memory capacity. Various concurrency issues such as limitations, especially a large amount of duplicate content stored in the flash memory unit, overwhelmed