Big data efficient asynchronous and synchronous decryption processing method, module and system

A processing method and technology of processing modules, applied in the field of big data decryption, can solve problems such as inability to respond to a large number of demands in a short time, performance bottlenecks, etc., to meet the needs of large-scale transaction decryption, increase fault tolerance mechanisms, and solve performance bottlenecks.

Pending Publication Date: 2020-11-27
银盛支付服务股份有限公司
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When dealing with a large amount of data in a similar example scenario, if a temporary real-time decryption method is used, there will obviously be a serious performance bottleneck, and it will not be able to respond to a large number of demands in a short time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data efficient asynchronous and synchronous decryption processing method, module and system
  • Big data efficient asynchronous and synchronous decryption processing method, module and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The idea, specific structure and technical effects of the present invention will be clearly and completely described below in conjunction with the embodiments and accompanying drawings, so as to fully understand the purpose, features and effects of the present invention. Apparently, the described embodiments are only some of the embodiments of the present invention, rather than all of them. Based on the embodiments of the present invention, other embodiments obtained by those skilled in the art without creative efforts belong to The protection scope of the present invention. In addition, all the connection / connection relationships involved in the patent do not simply refer to the direct connection of components, but mean that a better connection structure can be formed by adding or reducing connection accessories according to specific implementation conditions. The various technical features in the invention can be combined interactively on the premise of not conflictin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a big data efficient asynchronous decryption processing method, module and system. The method comprises that data is synchronously pushed to a Kafka cluster; ETL processing onthe corresponding Topic by using the Kafka consumption terminal; if the number of the data pieces corresponding to the same Last Up Date Time is smaller than or equal to the set N pieces, real-time synchronous decryption is carried out; if the number of the data pieces corresponding to the same Last Up Date Time is greater than the set N pieces, the temporary storage library directly stores the data into a number bin specified table in the distributed database; setting a timing task, reading the to-be-decrypted data stored in the temporary library every time interval, and storing the to-be-decrypted data in a data warehouse specified table in the distributed database after decryption is completed; and continuously running the asynchronous decryption program to ensure that all the to-be-decrypted data can meet the service decryption requirement. According to the big data efficient asynchronous and synchronous decryption processing method, module and system, synchronous and asynchronousdecryption modes are compatible at the same time according to service characteristics, and the large throughput performance requirement is met; and the performance bottleneck is solved, a fault-tolerant mechanism is added, and the requirement for large-batch transaction decryption can be met.

Description

technical field [0001] The invention relates to the field of big data decryption, in particular to a method, module and system for high-efficiency and synchronous decryption of big data. Background technique [0002] Data security has a decisive impact on the survival and development of enterprises. Leakage and destruction of data assets will lead to irreparable economic losses and loss of core competitiveness of enterprises. However, most small and medium-sized enterprises often focus on the rapid development of business and ignore The importance of data security. Data security control has always been an important part of data governance, and data desensitization belongs to the category of data security control. For Internet companies and traditional industries, data security has always been an extremely important and sensitive topic. Data desensitization refers to the transformation of certain sensitive information through desensitization rules to achieve reliable protec...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F21/60G06F21/62
CPCG06F21/602G06F21/6245
Inventor 刘跃红曾国江郭倩李雨峰
Owner 银盛支付服务股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap