Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A data processing method and system

A data processing and data technology, applied in the field of data processing methods and systems with high concurrent performance, can solve problems such as database crash, limited concurrent performance, poor concurrent performance, etc., to ensure consistency and integrity, enhance concurrent processing, The effect of avoiding bottleneck problems

Active Publication Date: 2018-03-30
西安京迅递供应链科技有限公司
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The transaction concurrency performance (TPS) of the database is limited, so it can lead to a bottleneck risk in the concurrency performance of OLTP application systems
Practice also shows that no matter how you optimize query SQL (Structured Query Language, Structured Query Language), database configuration, etc., it is difficult to meet the high concurrency requirements of the above-mentioned preemptive application scenarios;
[0013] 2) In high-concurrency application scenarios, existing technical solutions are prone to database deadlocks. If the deadlocks are not handled properly, it is easy to cause database crashes, which in turn lead to serious consequences such as system unusability;
[0014] 3) The concurrency performance is poor, and the user experience is not good. It often takes several seconds to return the result after the client initiates a claim request

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data processing method and system
  • A data processing method and system
  • A data processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] In order to make the object, technical solution and advantages of the present invention more clear, the present invention will be further described in detail below with reference to the accompanying drawings and examples.

[0055] Such as figure 2 As shown, the data processing method provided by the present invention includes a data writing stage and a data processing stage, wherein:

[0056] The data writing stage includes:

[0057] Step 1. Receive the data information sent by the client;

[0058] Step 2, create a database connection, and start a database transaction, and persist the data information to the database;

[0059] Step 3, writing the data to be processed in the data information into the Redis cache, and then submitting the database transaction;

[0060] The data processing stages include:

[0061] Step 4. Obtain the data to be processed from the Redis cache, process the data to be processed, and send the processed result data to a message queue (MQ);

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data processing method and system. The data processing method comprises the first stage of data writing, wherein data information sent by a client-side is received, persistence is carried out on the data information into a database, and to-be-processed data in the data information are written into a Redis cache; the second state of data processing, wherein the to-be-processed data are obtained from the Redis cache and are processed, processed result data are sent to an information queue, the result data are obtained from the information queue, and persistence is carried out the result data into the database. As the Redis cache stores the to-be-processed data, concurrent preemption and processing of the to-be-processed data in the Redis cache are achieved, and persistence on the processed result data into the database is achieved in a serialization mode through the information queue. According to the data processing method and system, concurrency processing of the data is enhanced, good experience is brought to clients, the bottleneck problem brought to the database under the condition of high concurrency is avoided, the deadlock problem of the database is avoided, and consistency and completeness of the data are ensured.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a data processing method and system with high concurrent performance. Background technique [0002] After-sales service is a very important link in business behavior. Whether it is a traditional retailer or an e-commerce company, it is necessary to establish a complete after-sales service system in order to guarantee the quality of products sold and the legitimate rights and interests of customers, and the quality of after-sales service directly affects the shopping experience of customers. [0003] For e-commerce companies, if customers purchase goods on an e-commerce website and find problems such as quality and wrong purchases after receiving the goods, they can directly submit relevant after-sales service applications on the e-commerce website, and the after-sales service application data will be sent to In the after-sales service system of the e-commerce company. The aft...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F16/2308G06F16/2365G06Q30/016
Inventor 者文明
Owner 西安京迅递供应链科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products