Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing method for database system, and database system

A data processing and database technology, applied in the database field, can solve problems such as huge computing overhead and migration overhead, Hash partition function is difficult to adapt to the dynamic expansion of the number of database nodes, etc., to improve performance, reduce the amount of data migration, and quickly re-partition and distribution Effect

Active Publication Date: 2013-03-13
JIANGSU DAWN INFORMATION TECH CO LTD
View PDF9 Cites 43 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At this time, the value range of nodeid has changed, and the originally set Hash division function cannot adapt to the dynamic expansion of the number of database nodes, and must be recalculated
In a large-scale database system, data repartition calculation will bring huge computing overhead and migration overhead

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method for database system, and database system
  • Data processing method for database system, and database system
  • Data processing method for database system, and database system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The present invention will be further described in detail below in conjunction with the accompanying drawings.

[0043] The embodiment of the present invention proposes a data distribution method that can realize dynamic expansion and contraction of the system scale in a database system, especially a large-scale cluster database system. When the database nodes of the database system change, the establishment of the mapping relationship between all the data in the database and the database system nodes can be completed without re-partitioning and migrating all the data.

[0044] figure 1 is a schematic flowchart of a data processing method of a database system according to an embodiment of the present invention, such as figure 1 As shown, the data processing methods include:

[0045] Step S101, mapping the data records in the data table to corresponding data virtual partitions according to the mapping relationship between data records and data virtual partitions;

[004...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data processing method for a database system, which comprises the following steps: mapping all the data records in a data sheet to corresponding data virtual partitions according to the mapping relationship between the data records and the data virtual partitions; mapping the data virtual partitions to corresponding database nodes on the basis of the mapping relationship between the data virtual partitions and the database nodes; and storing all the data records in the data sheet in the corresponding data virtual partitions of the corresponding database nodes. Correspondingly, the invention also discloses a database system. After the data processing method is adopted, the data repartitioning and the data distribution can be quickly carried out, so that the database clustering performance is enhanced.

Description

technical field [0001] The present invention relates to the technical field of databases, and more specifically, to a data processing method of a database system and a database system. Background technique [0002] In a database cluster system using a shared-nothing structure (such as IBM's product DB2UDB, product MySQL Cluster, and EMC's product Green Plum), due to the huge amount of data, a partition strategy must be used to distribute data to multiple database nodes Hash partitioning is one of the most common data partitioning methods. Hash division can quickly locate the database node where the relevant records are located by performing Hash calculation on a certain column in the relational table. Hash division can improve the performance of data loading and query processing. In particular, Hash partitioning can greatly improve the performance of large table statistics and large table associated queries. [0003] In the cluster database system, Hash division is mainly ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 宋怀明李晋钢杨浩苗艳超刘新春邵宗有
Owner JIANGSU DAWN INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com