Stream type repetitive data detection method
A technology of repeated data and detection methods, applied in data transformation, electrical digital data processing, instruments, etc., can solve problems such as unacceptable overhead, and achieve the effect of reducing memory overhead
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment Construction
[0018] The invention uses the Bloom filter detection technology to detect repeated data for the data stream. Before describing the inventive solution, briefly introduce the working principle of the bloom filter.
[0019] Bloom Filter is a random data structure with high space efficiency. It uses bit array to represent a collection concisely, and can determine whether an element belongs to this collection. The efficiency of Bloom Filter comes at a certain price: when judging whether an element belongs to a certain set, it is possible to mistake elements that do not belong to this set as belonging to this set (false positive). Therefore, Bloom Filter is not suitable for those "zero error" applications. In applications where low error rates can be tolerated, Bloom Filter saves a lot of storage space with very few errors.
[0020] Let's take a look at how Bloom Filter uses bit arrays to represent collections. In the initial state, the Bloom Filter is a bit array containing m bi...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com