Subset filter for memory key value table

A filter and key-value table technology, applied in the financial field, can solve the problems of limited data format, complex event and indicator data, low efficiency, etc., to achieve the effect of speeding up the scanning operation

Pending Publication Date: 2022-06-28
ZHEJIANG BANGSUN TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In the complex time processing and calculation scenarios of financial risk control and anti-fraud, the scanned event and index data are becoming more and more complex, and the scanning methods are becoming more and more flexible and diverse. However, the above-mentioned indexing method is difficult to meet these scanning requirements. There are the following two Point defect:
[0007] (1) The data types supported by the index are limited: the data format is limited to common data types such as strings and integers, which cannot meet the indexing requirements of complex events and calculation indicators
[0008] (2) The scanning methods based on index support are limited: the prefix index based on dictionary tree only supports prefix scanning of strings, while the index based on B+ tree only supports range scanning of specific ordered data, complex events and calculation indicators that meet specific conditions scanning, which is very inefficient
[0009] To sum up, the existing index-accelerated scanning methods mentioned above cannot fully meet the scanning needs of financial real-time computing and complex event processing such as risk control and anti-fraud.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Subset filter for memory key value table
  • Subset filter for memory key value table
  • Subset filter for memory key value table

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The specific embodiments of the present invention will be further described in detail below with reference to the accompanying drawings.

[0028] The present invention provides a subset filter oriented to an in-memory key-value table. The subset filter is provided with a filter function and a matching value for extracting key-value pair features. When the extracted key-value pair features are consistent with the matching value When the subset filter records the memory address of the key-value pair; the subset filter includes a subset filter building module, a data item storage module, a data item update module and a scan module;

[0029] The Subset Filters building block is used to specify 2 filter keys defined as follows:

[0030] filterFunction(key,value): Set a filter function, the key in the parameter is the key, and the value is the value. This function is used to extract the characteristics of the key-value pair, which can be customized.

[0031] matchValue(): Se...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a subset filter for a memory key value table. The subset filter is mainly divided into five parts: definition of the subset filter, data item storage of the subset filter, data item updating of the subset filter, reconstruction of the subset filter and scanning of the subset filter. According to the method, filtering of any type of index data and filtering of any specified data feature are supported, so that a flexible scanning mode is provided, all index data do not need to be traversed during scanning, and the scanning operation is effectively accelerated. The method can be applied to most memory key value tables and has certain universality.

Description

technical field [0001] The invention relates to the financial field requiring high-frequency real-time information processing and storage, such as risk control and anti-fraud, and relates to a subset filter oriented to a memory key-value table. Background technique [0002] In the financial field that requires real-time calculation such as risk control and anti-fraud, it is not only necessary to calculate financial indicators such as "the transaction volume of an entity in the past 1 day" and "the maximum transaction amount of an entity in the past 1 week", but also needs to be calculated such as " Calculation and processing of complex events such as looking for entities that conduct 3C transactions within 30 minutes after recharging the phone bill, and then conduct valuables transactions within 10 minutes”, “find two adjacent transaction entities with a total amount of more than 1 million yuan”, etc. The indicator data of the transaction entity needs to be scanned, and the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/23
CPCG06F16/2282G06F16/2272G06F16/23
Inventor 陈伟王刚鲁萍黄滔杨运平叶金韬
Owner ZHEJIANG BANGSUN TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products