Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Historical data collection and storage method

A technology of historical data and data storage, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc. and other problems to achieve the effect of convenient management and query, reducing complexity and ensuring real-time

Inactive Publication Date: 2017-10-20
XIDIAN UNIV
View PDF4 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

With such a high amount of data and frequency, if a commercial database is used for storage and management, it will be a great burden and occupy too many system resources. At the same time, commercial databases cannot meet the time-limited requirements of historical data collection
Moreover, commercial databases do not provide compression, which is a big problem for the ever-increasing storage of historical data
[0004] In addition, the storage of historical data mainly depends on the hard disk, but for a large amount of saved data, the impact of the saving speed on high-frequency access to the hard disk is unfavorable

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Historical data collection and storage method
  • Historical data collection and storage method
  • Historical data collection and storage method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] In order to further understand the content, features and effects of the present invention, the following examples are given, and detailed descriptions are given below with reference to the accompanying drawings.

[0022] The invention relates to a method for storing data in a file format for obtaining historical data from a real-time database and efficiently managing the data. It mainly includes: 1. Strictly divide 24 hours in a day from 0:00:00 into 144 whole ten minutes, each disk data file is named from 0-143 in turn, and the starting time of each memory buffer is also from the whole ten minutes Starting from the minute, two memory buffers of the same size (respectively marked as #0 and #1 areas) are opened for the ten-minute collection data of all collected variables; 2. The two memory buffers are used to alternately store the collected historical data and Provides historical data queries within ten minutes, and they are exchanged every ten minutes. That is, the #0...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the field of automatic control technology and particularly relates to a historical data collection and storage method. According to the method, a self-defined data storage file format is adopted, a buffer region is used to reduce disk I / O times and improve real-time performance of a system, data query efficiency is improved through a new file storage format and a new file storage organization form, and data can be compressed through a compression tool to reduce disk space occupation. The method can guarantee real-time performance of collection of historical data, facilitate management and query of the historical data and improve system performance.

Description

technical field [0001] The invention belongs to the technical field of automatic control, and in particular relates to a method for storing data in a file format for obtaining historical data from a real-time database and efficiently managing it. Background technique [0002] The scale of modern automation control system is getting larger and larger, and the processing capacity is getting stronger and stronger. It supports more and more points. The resulting data volume is even greater. The historical database is responsible for data collection, saving required data to disk, and providing query. [0003] At present, most of the historical databases of automation control systems use mature commercial databases, such as ACCESS, SQLSERVER, Oracle, Sybase, etc. However, for historical databases that provide trend queries, the sampling frequency is correspondingly increased for fast-changing process quantities, such as one second. In this way, for a system with tens of thousan...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/219
Inventor 王培财刘奋民
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com