External sorting method and device of NVM (Non-Volatile Memory) and NVM memory

An external sorting and data sorting technology, applied in the field of NVM memory, can solve problems such as affecting the service life of NVM, limited service life, and reducing write operations, so as to solve the problem of I/O load, prolong the service life, and reduce the number of write operations. Effect

Pending Publication Date: 2022-07-29
NAT UNIV OF DEFENSE TECH
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

One is that the overhead of writing operations is higher than that of reading, and it can be accessed randomly, so in the process of algorithm design, additional reading operations can be added to reduce writing operations; second, the service life is limited, and frequent writing operations will affect the use of NVM life

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • External sorting method and device of NVM (Non-Volatile Memory) and NVM memory
  • External sorting method and device of NVM (Non-Volatile Memory) and NVM memory
  • External sorting method and device of NVM (Non-Volatile Memory) and NVM memory

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application will be described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application. Hereinafter, an NVM-based external sorting method is called NVMSort for convenience of description, and the test mentioned in the following is implemented on the Optane DC PMM, a real NVM product introduced by Intel Corporation.

[0033] In one embodiment, as figure 1 As shown, an external sorting method of NVM is provided, which includes the following steps:

[0034] Step 102: Obtain the ordered interval of the small file in the input cache read into the memory, and sort the unordered data in the input cache to obtain a first ordered intermediate result, and write the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an external sorting method and device of an NVM (Non-Volatile Memory) and a computer storage medium. The method comprises the following steps: obtaining an ordered interval of a small file read into an input cache of a memory, sorting disordered data in the input cache to obtain a first ordered intermediate result, and writing the first ordered intermediate result back to an NVM (Non-Volatile Memory); the small files are obtained by segmenting the big data file; acquiring position information of the ordered interval on the NVM, establishing an index table according to the position information, and storing the index table in a memory; when data merging is carried out, data merging is carried out according to the septicem tree, the index table and the first ordered intermediate result. By adopting the method, the I/O load problem of traditional external merging sorting can be solved, and the service life of external storage equipment is prolonged.

Description

technical field [0001] The present application relates to the technical field of novel non-volatile storage, and in particular, to a method and device for external sorting of NVM, and an NVM memory. Background technique [0002] The rise and development of new non-volatile memory technology, new non-volatile memory has read and write performance close to Dynamic Random Access Memory (DRAM), while providing high-density, large-capacity data storage, and It can also be non-volatile like a hard disk drive (Hard Disk Drive, HDD) and a solid state drive (Solid State Disk, SSD), and can store data persistently. With the explosion of data volumes, the need for new types of non-volatile storage in high-performance computing and database management systems has increased dramatically. In the database system, a common scenario is that the originally ordered data is out of order due to the partial update of the data. If the data is re-sorted after each partial update of the data, the o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F12/02G06F12/0877
CPCG06F3/0616G06F3/0643G06F12/0877G06F12/0261
Inventor 肖侬欧洋刘洋陈文汉
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products