Distributed file system based file reading and writing method and node server

A distributed file and file reading technology, applied in transmission systems, instruments, electrical components, etc., can solve problems such as low performance

Inactive Publication Date: 2016-06-01
BEIJING QIHOO TECH CO LTD +1
View PDF4 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the process of random reading, if each disk operation takes about 10ms, 3 times is 30ms, and the performance is very low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed file system based file reading and writing method and node server
  • Distributed file system based file reading and writing method and node server
  • Distributed file system based file reading and writing method and node server

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0083] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0084] The distributed file system HDFS is the core sub-project of the Hadoop project and the basis of data storage management in distributed computing. It is developed based on the requirements of streaming data mode access and processing very large files, and can run on cheap commercial servers. Its characteristics of high fault tolerance, high reliability, high scalability, high availability, and high throughput provide storage f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed file system based file reading and writing method and a node server. The method comprises the steps of receiving a data access request sent by a client through a data node server, wherein the data access request comprises information of a target data block required to be read; obtaining the target data block matched with the information of the target data block, wherein the target data block comprises identifier information and first data information, and the identifier information comprises check attribute information; and sending the check attribute information and the first data information to the client. According to the method and the node server, the I / O frequency of a disk can be reduced, the data reading efficiency can be effectively improved, and the HDFS random reading performance can be improved.

Description

technical field [0001] The invention relates to the technical field of file processing, in particular to a file reading method based on a distributed file system, a file writing method based on a distributed file system, and a node server. Background technique [0002] With the rapid development of information technology, massive amounts of information need to be stored reliably and at the same time meet the needs of fast access by a large number of users. The traditional storage solution has become more and more difficult to adapt to the rapid business development in recent years from the structure, and has become the bottleneck and obstacle of business development. At this time, HDFS (Hadoop Distributed File System, Hadoop Distributed File System) came into being. [0003] HDFS uses an efficient distributed algorithm to distribute data access and storage among a large number of servers. While reliably storing multiple backups, HDFS can also distribute access to each server...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F3/06H04L29/08
Inventor 郭东东
Owner BEIJING QIHOO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap