Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data analysis processing method and system based on pre-read and post-write

A technology for data analysis and processing and slow writing, which is applied in the direction of input/output to record carrier, etc., and can solve problems such as storage congestion

Active Publication Date: 2015-12-23
BEIJING NORMAL UNIVERSITY
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The technical problem to be solved by the present invention is how to effectively reduce unnecessary waiting time during batch data calculation, improve program operation efficiency, and avoid storage blockage during batch input and output of data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data analysis processing method and system based on pre-read and post-write
  • Data analysis processing method and system based on pre-read and post-write
  • Data analysis processing method and system based on pre-read and post-write

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] Combine below Attached picture The present invention is described in further detail with examples. The following examples are used to illustrate the present invention, but should not be used to limit the scope of the present invention.

[0040] The invention discloses a data analysis and processing method based on read-ahead and slow-write, and the method includes:

[0041] S1. Read in part of the data to be input;

[0042] S2. Use a corresponding calculation method to perform calculations based on the data to be input read in step S1, obtain corresponding calculation results, and output the calculation results;

[0043] After the step S1 is executed for the first time, the steps S1 and S2 are executed simultaneously, and the execution of the step S1 is stopped until all the data to be input are read into; the step S2 is stopped until all the calculation results are output. implement.

[0044] The above method embodies a pre-reading and slow-writing mechanism: firs...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data analysis processing method and system based on pre-read and post-write. The data analysis processing method comprises the following steps: firstly, reading one part of data to be input; then, according to the input data, carrying out calculation in advance, and meanwhile, reading one rest part of data to be input or all data to be input to continue to carry out calculation; and meanwhile, when a calculation result can be output, outputting the result of the part in advance. The processing mode is subjected to parallel running through multithread programming so as to finish program running in a shortest time, and therefore, a memory can be dynamically and efficiently used. Program running efficiency can be improved by 75% through the introduction of a pre-read and post-write mechanism, and storage congestion caused when the data are subjected to batch input and output is avoided.

Description

Technical field [0001] The present invention is a high -performance remote sensing data processing field, and it also involves a data analysis processing method and system based on pre -read and slowly writing. Background technique [0002] In the process of using high -performance clusters for batch data calculation, the operation of data input and output frequently occurs frequently. Due to the large amount of calculation, multiple calculation nodes access the memory at the same time, which will cause storage blockage and cannot reach the ideal program.operating efficiency.The production procedures involved in existing technologies are generally serial programs, which are basically three processes input, calculated and output. These three processes can be understood as the following three modules: [0003] Enter the module. When running the input module, the data input required for all calculations is temporarily stored in memory, but it will occupy a lot of space; [0004] Cal...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
Inventor 赵祥崔娇徐帅魏红梁顺林
Owner BEIJING NORMAL UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com