A data synchronization method and device

A data synchronization and data technology, applied in the network field, can solve problems such as low efficiency and cumbersome data synchronization operations

Active Publication Date: 2021-03-12
BEIJING QIYI CENTURY SCI & TECH CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a data synchronization method and device, in order to solve the problem of cumbersome data synchronization operation and low efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data synchronization method and device
  • A data synchronization method and device
  • A data synchronization method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0049] figure 1 is a flow chart of the steps of a data synchronization method provided in Embodiment 1 of the present invention, and the method can be applied to the first server cluster, such as figure 1 As shown, the method may include:

[0050] Step 101: Divide the processing resources of the first server cluster into multiple virtual nodes according to the predefined number of nodes and the amount of memory corresponding to each node, and allocate a corresponding amount of memory to each virtual node.

[0051]In this embodiment of the present invention, the number of nodes and the amount of memory corresponding to each node can be determined by developers based on the performance of all servers included in the first server cluster and the number of partitions included in the first server cluster. For example, in the definition For the number of nodes, you can set a value not greater than the number of partitions as the number of nodes. Further, when setting the correspond...

Embodiment 2

[0062] figure 2 is a flow chart of the steps of a data synchronization method provided in Embodiment 2 of the present invention, and the method can be applied to the first server cluster, such as figure 2 As shown, the method may include:

[0063] Step 201: Divide the processing resources of the first server cluster into multiple virtual nodes according to the predefined number of nodes and the amount of memory corresponding to each node, and allocate a corresponding amount of memory to each virtual node.

[0064] Specifically, for the implementation manner of this step, reference may be made to the foregoing step 101, and details are not described here in this embodiment of the present invention.

[0065] Step 202, detecting whether the preset data table exists in the second server cluster.

[0066] In this step, the first server cluster can detect whether there is a preset data table by connecting to the service exposed by the second server cluster. For example, the pres...

Embodiment 3

[0086] image 3 It is a block diagram of a data synchronization device provided in Embodiment 3 of the present invention, such as image 3 As shown, the device 30 may include:

[0087] The division module 301 is configured to divide the processing resources of the first server cluster into multiple virtual nodes and allocate a corresponding amount of memory to each virtual node according to the predefined number of nodes and the amount of memory corresponding to each node.

[0088] A loading module 302, configured to use each of the plurality of virtual nodes to load target data of each virtual node in a corresponding partition in the first server cluster into the memory of the virtual node; Wherein, each virtual node corresponds to at least one partition.

[0089] The writing module 303 is configured to use the plurality of virtual nodes to write the target data in the memory into the partition corresponding to the preset data table according to the preset data table of the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data synchronization method and device, belonging to the field of network technology. Wherein, the first server cluster can divide a plurality of virtual nodes and allocate a corresponding amount of memory for each virtual node, and use each node in the plurality of virtual nodes to place each virtual node in the corresponding partition in the first server cluster The target data in the memory is loaded into the memory of the virtual node, thereby improving the efficiency of obtaining the target data from the first server cluster, and using multiple virtual nodes to write the target data in the memory into the partition corresponding to the preset data table, thereby omitting the second The second server cluster loads the target data to further improve the efficiency of data synchronization, and controls the second server cluster to update the preset data table according to the target data, so that in the subsequent steps, the preset data table can be used to identify the synchronization to the second The target data of the server cluster, thereby ensuring that the synchronized data can be processed normally.

Description

technical field [0001] The invention belongs to the field of network technology, and in particular relates to a data synchronization method and device. Background technique [0002] With the continuous development of network technology, more and more data are generated in the network. In order to facilitate data management, these data are often stored in different partitions in the file system of the server cluster. Because the data contains a lot of valuable information, it is often necessary to analyze the data, and before analyzing the data, it is often necessary to synchronize the data, for example, to synchronize the data on the first server cluster to the second server cluster superior. [0003] In the prior art, when synchronizing the data on the first server cluster to the second server cluster, each partition of the first server cluster is usually scanned sequentially to obtain the data to be synchronized, and then the obtained data to be synchronized is The data ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
CPCH04L67/1044H04L67/1095H04L67/1097H04L67/5682
Inventor 黄文仁
Owner BEIJING QIYI CENTURY SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap