A disk storage load balancing method and device

A disk storage and load balancing technology, applied in the field of data processing, can solve the problems of waste of storage resources and uneven data storage occupation, and achieve the effects of balancing disk data, balancing cluster storage occupation, and improving cluster storage utilization.

Active Publication Date: 2022-03-18
CHINA UNITED NETWORK COMM GRP CO LTD +1
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] This application aims at the shortcomings of distributed message middleware existing in the prior art, which have uneven data storage occupancy between nodes and disks, and in big data scenarios, using distributed message middleware is also easy to read and write to individual disks The peak problem will cause a certain waste of storage resources, and a disk storage load balancing method and device are provided

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A disk storage load balancing method and device
  • A disk storage load balancing method and device
  • A disk storage load balancing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0065] In order to enable those skilled in the art to better understand the technical solutions of the present invention, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0066] The present application provides a disk storage load balancing method and device. The following describes in detail one by one with reference to the drawings of the embodiments provided in the present application.

[0067] The disk storage load balancing method provided in the first embodiment of the present application is as follows:

[0068] The execution subject of the embodiment of the present application is the node coordinator, such as figure 1 As shown in FIG. 2 , it shows a flow chart of a disk storage load balancing method provided by an embodiment of the present application, including the following steps.

[0069] Step S101, calculating the average instantaneous storage utilization rate of each disk.

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present application discloses a disk storage load balancing method and device, including: calculating the average value of the instantaneous storage utilization rate of each disk; calculating the average value of the historical storage utilization rate of each disk; generating a disk according to the average value of the instantaneous storage utilization rate of each disk Storage utilization list; sort each disk in the disk storage utilization list according to the instantaneous storage utilization average and historical storage utilization average of each disk in the disk storage utilization list, and determine according to the sorted sequence A disk to be migrated and a target disk; data is migrated from the disk to be migrated to the target disk. You can obtain the disks to be migrated with priority migration data and the target disks with priority migration data, which effectively balances the data of each disk and effectively avoids wasting the CPU and disk IO of cluster nodes, balances the cluster storage usage, and greatly improves the cluster storage. utilization rate.

Description

technical field [0001] The invention belongs to the technical field of data processing, and in particular relates to a disk storage load balancing method and device. Background technique [0002] Middleware is a service provided by the application program other than the service provided by the operating system. The component in the "middle layer" is a bridge between the upper application program and the underlying service, and also a bridge between applications (for example, Distributed service components). Distributed message middleware supports hardware or software infrastructure for sending and receiving messages in a distributed system, that is, distributed message middleware itself is also a distributed system. [0003] At present, the high-throughput distributed message middleware operating system uses file cache instead of memory cache. The current high-throughput distributed message middleware stores data offsets to each disk as a record basis for data reading and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
Inventor 余澈
Owner CHINA UNITED NETWORK COMM GRP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap