Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

IO request scheduling method and device

An IO request and scheduling method technology, applied in the computer field, can solve problems such as system freezes, affect user experience, increase IO request response time, etc., to achieve the effect of good scheduling and accelerated execution

Active Publication Date: 2021-05-14
BEIJING OCEANBASE TECH CO LTD
View PDF3 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When the IO requests initiated by the background tasks occupy too many IO resources, it will increase the response time of the IO requests initiated by the foreground tasks, causing the system to freeze and affecting the user experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • IO request scheduling method and device
  • IO request scheduling method and device
  • IO request scheduling method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] Various non-limiting embodiments provided in this specification will be described in detail below with reference to the accompanying drawings.

[0041] For some data storage systems including LSM-based databases, the IO requests scheduled per unit time usually include two types of IO requests, foreground IO requests and background IO requests.

[0042] Take the database based on LSM structure as an example. The process of writing new data includes: First, the active Memtable, as the memory data structure of the LSM, will be responsible for writing new data by the application; after writing new data of the corresponding size in the active Memtable, the writing will stop and be frozen To freeze the Memtable, a new active Memtable is also created to be responsible for writing new data. Then, the system background can schedule a dump task, through which the frozen Memtable conversion format is dumped (Dump) to disk to generate an SSTable structure file, after which the mem...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides an IO request scheduling method and device. The method comprises: obtaining a to-be-scheduled target IO request, and determining whether the target IO request belongs to a current-limited IO request or not; when the target IO request belongs to the first type of IO requests which are not subjected to current limiting, determining the current moment as the scheduling moment of the target IO request; when the target IO request belongs to a current-limited second type IO request, determining a scheduling moment of the target IO request according to a current current-limiting resource proportion, wherein the current current-limiting resource proportion is a resource proportion used for processing the second type IO request in a current time period to which the current moment belongs, and obtaining the current current-limiting resource proportion through calculation according to a previous current-limiting resource proportion of a previous time period and load information of a first type of IO requests scheduled in the previous time period, wherein the scheduling moment is not less than the current moment; and adding the target IO request into an IO request set, and sequentially sending a plurality of IO requests in the IO request set to a disk for processing according to the scheduling time from small to large.

Description

technical field [0001] One or more embodiments of this specification relate to the field of computers, and in particular, to a method and apparatus for scheduling IO requests. Background technique [0002] For some data storage systems, such as databases based on the Log-Structured MergeTree (LSM) structure, the IO request initiated by the data query request (also called the foreground task) from the application needs to occupy more than the IO resources of the disk. , there may also be IO requests initiated by untimed background tasks (such as dump tasks or merge tasks) that need to occupy disk IO resources. When the IO request initiated by the background task occupies too many IO resources, it will increase the response time of the IO request initiated by the foreground task, causing the system to freeze and affecting the user experience. [0003] Generally, in order to ensure the efficient operation of the system and improve the user experience, some IO requests may need...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/0629G06F3/0676
Inventor 孙坚运赵裕众
Owner BEIJING OCEANBASE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com