Internet-of-Things time sequence big data processing method based on Internet of Things middleware

A technology of big data processing and Internet of Things, applied in the direction of electrical digital data processing, special data processing applications, database management systems, etc., can solve problems such as low efficiency, slow time series data storage and query speed, poor real-time performance, etc.

Active Publication Date: 2021-05-11
合沃物联技术(南京)有限公司
View PDF7 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Purpose of the invention: In order to overcome the deficiencies in the prior art, the present invention provides a method for processing time-series big data of the Internet of Things based on the middleware of the Internet of Things, which solves the problem of slow storage and query of time-series data based on structured databases on the market. Problems of low efficiency and poor real-time performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Internet-of-Things time sequence big data processing method based on Internet of Things middleware
  • Internet-of-Things time sequence big data processing method based on Internet of Things middleware
  • Internet-of-Things time sequence big data processing method based on Internet of Things middleware

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment approach

[0025] Such as figure 1 Shown is a method for processing large IoT time series data based on IoT middleware. Firstly, a database is established, and the variable data collected at the collection point is standardized by the middleware and then written into the database in real time by the Internet of Things. Users query The service fetches data from the database. The specific implementation is as follows:

[0026] 1. Database part

[0027]Create a database: When creating a database, in addition to the SQL standard options, the application can also specify various data characteristics such as the retention period, the number of data backup copies, the cache size, the file block size, and whether to compress. For example: create databaseb_userId keep 30 tables 20000 cache 10240 ablocks 4 tblocks 50, keep is the number of days to keep data, tables is the maximum number of tables allowed to be created for each vnode, cache is the size of memory blocks in bytes, tblocks is each t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an internet-of-things time sequence big data processing method based on internet-of-things middleware. A database, a storage service and a query service are included. The database is designed on the basis of a TD engine time sequence database, and data stored in one database have the same data characteristics; a sub-table is established for each variable of each collection point, the first column of the sub-table is a timestamp, the second column of the sub-table is variable data, and the field type of the variable data is set to be the minimum format for ensuring the data storage range; in each database, sub-tables with the same field type of the variable data are established in a super table, and the static attributes of the collection points are used as labels to be stored in metadata nodes through the super table. According to the invention, the business requirements of ever-increasing and huge-capacity storage and time series data management in the data acquisition scene of the Internet of Things can be met; by adopting the time series data processing architecture provided by the invention, the effects of concurrent storage and query statistics are obviously improved.

Description

technical field [0001] The invention relates to an Internet of Things time series big data processing method based on Internet of Things middleware, which belongs to the storage and query technology of Internet of Things time series data. Background technique [0002] With the wide application of Internet of Things technology, the characteristic data of Internet of Things has grown rapidly, the amount of data has become larger and larger, and the types have become more and more. Traditional structured databases have been unable to meet the requirements of time-series data storage and query with Internet of Things characteristics. Therefore, it is inevitable to use a time-series database to process the characteristic data of the Internet of Things. Time-series data is time-series data with time tags. Its typical characteristics are fast generation frequency, dependence on collection time, and large amount of information collected at multiple points. In order to ensure the saf...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/23G06F16/2458G06F16/25G16Y10/75
CPCG06F16/2282G06F16/2322G06F16/252G06F16/2462G16Y10/75Y02D10/00
Inventor 石守业蔡明涛
Owner 合沃物联技术(南京)有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap