Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data splitting method and device based on massive business data scene and storage medium

A technology for business data and scenarios, applied in the field of data processing, can solve problems such as high database pressure, and achieve the effect of solving excessive pressure

Pending Publication Date: 2021-12-03
SHANGHAI PUDONG DEVELOPMENT BANK
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a data splitting method, device and storage medium based on a large number of business data scenarios, which solves the access bottleneck caused by excessive pressure on the database when a large number of data services are stored

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data splitting method and device based on massive business data scene and storage medium
  • Data splitting method and device based on massive business data scene and storage medium
  • Data splitting method and device based on massive business data scene and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] The present invention is further detailed below with reference to the accompanying drawings and examples. It will be appreciated that the specific embodiments described herein are merely illustrative of the invention and are not limited thereto. It will also be also to be described, and only the parts associated with the present invention are shown in the drawings rather than all structures.

[0020] Several aspects of the summary affect database performance: 1) the amount of data. The amount of data in a single database performance is better within 50 million, exceeds the threshold performance increases as the amount of data weakened. The amount of data between a single table is better performance 500w-1000w, 1000w performance will fall over. 2) disks. Because a single service disk space is limited, if concurrently under pressure, all requests to access the same node, certainly cause great impact on disk IO. 3) a database connection. Database connection is very scarce reso...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data splitting method and device based on a massive business data scene and a storage medium. The data splitting method comprises the steps that database splitting and table splitting processing is carried out on a data table related to a user, and a fragmentation key used for database splitting and table splitting is determined according to a unique identifier of the user; and the plurality of data tables subjected to database splitting and table splitting processing are stored in at least one database according to a database splitting and table splitting result. According to the data splitting method and device based on the massive business data scene and the storage medium disclosed by the invention, the access bottleneck caused by excessive pressure of a database when massive data business is stored is solved.

Description

Technical field [0001] Example The present invention relates to data processing technology, more particularly to a resolution process based on the data, and the storage medium means a lot of business data for the scene. Background technique [0002] Traditional data storage is stored in the data set into a single data node, i.e., a single table memory. Then the amount of data to a certain amount of time, optimized by adding indexes, rewritten SQL, etc.. With the rapid development and expansion of the scale of Internet users, the system requirements are also increasing. When the table data reaches more than ten million level, and there is a growing trend, while the amount of concurrent access to the system reaches a certain size when the business of additions and deletions to change search operation, the database will make the average response time is too long. [0003] The traditional approach, while optimizing system performance can be improved to a certain extent, alleviate the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22
CPCG06F16/2282
Inventor 侯亚君
Owner SHANGHAI PUDONG DEVELOPMENT BANK
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com