Data synchronization method and device

A data synchronization and data technology, applied in the network field, can solve problems such as low efficiency and cumbersome data synchronization operations

Active Publication Date: 2019-02-22
BEIJING QIYI CENTURY SCI & TECH CO LTD
View PDF4 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a data synchronization method and device, in order to solve the problem of cumbersome data synchronization operation and low efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data synchronization method and device
  • Data synchronization method and device
  • Data synchronization method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0049] figure 1 is a flow chart of the steps of a data synchronization method provided in Embodiment 1 of the present invention, and the method can be applied to the first server cluster, such as figure 1 As shown, the method may include:

[0050] Step 101: Divide the processing resources of the first server cluster into multiple virtual nodes according to the predefined number of nodes and the amount of memory corresponding to each node, and allocate a corresponding amount of memory to each virtual node.

[0051]In this embodiment of the present invention, the number of nodes and the amount of memory corresponding to each node can be determined by developers based on the performance of all servers included in the first server cluster and the number of partitions included in the first server cluster. For example, in the definition For the number of nodes, you can set a value not greater than the number of partitions as the number of nodes. Further, when setting the correspond...

Embodiment 2

[0062] figure 2 is a flow chart of the steps of a data synchronization method provided in Embodiment 2 of the present invention, and the method can be applied to the first server cluster, such as figure 2 As shown, the method may include:

[0063] Step 201: Divide the processing resources of the first server cluster into multiple virtual nodes according to the predefined number of nodes and the amount of memory corresponding to each node, and allocate a corresponding amount of memory to each virtual node.

[0064] Specifically, for the implementation manner of this step, reference may be made to the foregoing step 101, and details are not described here in this embodiment of the present invention.

[0065] Step 202, detecting whether the preset data table exists in the second server cluster.

[0066] In this step, the first server cluster can detect whether there is a preset data table by connecting to the service exposed by the second server cluster. For example, the pres...

Embodiment 3

[0086] image 3 It is a block diagram of a data synchronization device provided in Embodiment 3 of the present invention, such as image 3 As shown, the device 30 may include:

[0087] The division module 301 is configured to divide the processing resources of the first server cluster into multiple virtual nodes and allocate a corresponding amount of memory to each virtual node according to the predefined number of nodes and the amount of memory corresponding to each node.

[0088] A loading module 302, configured to use each of the plurality of virtual nodes to load target data of each virtual node in a corresponding partition in the first server cluster into the memory of the virtual node; Wherein, each virtual node corresponds to at least one partition.

[0089] The writing module 303 is configured to use the plurality of virtual nodes to write the target data in the memory into the partition corresponding to the preset data table according to the preset data table of the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data synchronization method and device, and belongs to the technical field of networks, wherein a first server cluster can divide multiple virtual nodes, and distribute the corresponding memory to each virtual node; by utilization of each node in the multiple virtual nodes, target data of each virtual node in the corresponding partition in the first server cluster is loaded into the memory of the virtual node; therefore, the efficiency of obtaining the target data from the first server cluster is increased; the target data in the memory is written in the correspondingpartition of a pre-set data table by utilization of the multiple virtual nodes; therefore, the operation of loading the target data by a second server cluster is avoided; the data synchronization efficiency is further increased; the second server cluster is controlled to update the pre-set data table according to the target data; therefore, the target data synchronized to the second server clustercan be identified through the pre-set data table in the subsequent step; and thus, the synchronized data can be normally processed.

Description

technical field [0001] The invention belongs to the field of network technology, and in particular relates to a data synchronization method and device. Background technique [0002] With the continuous development of network technology, more and more data are generated in the network. In order to facilitate data management, these data are often stored in different partitions in the file system of the server cluster. Because the data contains a lot of valuable information, it is often necessary to analyze the data, and before analyzing the data, it is often necessary to synchronize the data, for example, to synchronize the data on the first server cluster to the second server cluster superior. [0003] In the prior art, when synchronizing the data on the first server cluster to the second server cluster, each partition of the first server cluster is usually scanned sequentially to obtain the data to be synchronized, and then the obtained data to be synchronized is The data ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
CPCH04L67/1044H04L67/1095H04L67/1097H04L67/5682
Inventor 黄文仁
Owner BEIJING QIYI CENTURY SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap