Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method, apparatus and system for processing data

A technology for processing data and metadata servers. It is applied in the computer field and can solve the problems that the system load level cannot be fully described, and the division and migration decisions are not necessarily accurate.

Active Publication Date: 2021-08-10
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The way of hash table mapping is not suitable for scenarios with fixed data distribution and frequent environmental changes
In addition, the dynamic partition method only monitors the system load, and the partition and migration decisions made are not necessarily accurate, and cannot fully describe the load level of the system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, apparatus and system for processing data
  • Method, apparatus and system for processing data
  • Method, apparatus and system for processing data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain related inventions, rather than to limit the invention. It should also be noted that, for the convenience of description, only the parts related to the related invention are shown in the drawings.

[0033] It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and embodiments.

[0034] figure 1 An exemplary system architecture 100 is shown to which embodiments of the method for processing data or the apparatus for processing data of the present application can be applied.

[0035] Such as figure 1 As shown, the system architecture 100 may include ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the present application discloses a method, device and system for processing data. A specific implementation of the method includes: in response to receiving the access request, determining the time interval between the access request and the last access request as the first time interval; obtaining a preset complete binary tree from the management server, wherein the non- The value of the leaf node is related to the time interval between the last two access requests received by the metadata server. The leaf node is used to represent the virtual node corresponding to the metadata server in the distributed system; select the target from the complete binary tree according to the first time interval Path: Send the access request and the target path to the metadata server corresponding to the leaf node of the target path. This embodiment realizes the load balancing of the distributed system.

Description

technical field [0001] The embodiments of the present application relate to the field of computer technology, and in particular to methods, devices and systems for processing data. Background technique [0002] As a form of data storage in the computer field, the file system has long served computer application systems in various industries. However, with the explosive growth of data volume, a distributed file system based on computer clusters emerged as the times require. In the design of this large-scale distributed file system, a separate metadata processing node is required to manage the metadata of the entire file system. When the number of files or directories reaches billions or even tens of billions, the load of the metadata nodes will become the system The biggest bottleneck of the existing load balancing method is from the fixed configuration of the number of subdirectories served by each metadata server to the mapping through the hash table, which is an effective ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08G06F16/182G06F16/13
CPCH04L67/1004H04L67/1023H04L67/561H04L67/60G06F16/2246G06F16/182H04L67/10G06F16/1824G06F15/16H04L67/1097G06F16/2379G06F16/953H04L67/01
Inventor 宋双洋牛献会李莅连林江
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com