Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and system for storing mass data of Internet of Things (IoT)

A technology of massive data and storage system, applied in the field of Internet of Things storage, can solve the problems of inability to flexibly add and delete data fields, restrictions on concurrency, and low database performance.

Active Publication Date: 2013-04-03
COMP NETWORK INFORMATION CENT CHINESE ACADEMY OF SCI
View PDF3 Cites 158 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Parallel databases are mainly composed of multiple relational databases that support the storage of massive structured data, but the performance of such databases is far lower than that of NoSQL (Not Only SQL, non-relational databases). Due to the distributed lock mechanism adopted, the degree of concurrency In addition, the data format of this type of database is fixed, and data fields cannot be flexibly added or deleted to effectively deal with heterogeneous data. Therefore, parallel databases are not suitable for storing and managing massive IoT data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for storing mass data of Internet of Things (IoT)
  • Method and system for storing mass data of Internet of Things (IoT)
  • Method and system for storing mass data of Internet of Things (IoT)

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0118] Example 1: Query all illegal license plate numbers whose speed exceeds 200km / h between 2012-07-25 and 2012-07-28.

[0119] for each SampleRecord in

[0120] set(getByTimeRange(Collection,"2012-07-25","2012-07-28") AND

[0121] getElement(speed,SampleRecord).value>200):

[0122] return getElement(plateNumber, getMultiMedia(key, SampleRecord)).value

example 2

[0123] Example 2: Query the shipping track whose ID is "ID123".

[0124] for each SampleRecord in

[0125] set(sort(getRecordSet(Collection,"ID123"),t))

[0126] return getElement(SampleRecord,loc).value

example 3

[0127] Example 3: Query the 10 nearest mobile phone locations from (112.02,111.01)

[0128] for each SampleRecord in Collection:

[0129] Point=getElement(loc,SampleRecord).value

[0130] sort(set(getObjDistance(Point,(112.02,111.01))))

[0131] return set.limit(10)

[0132] 2. Index

[0133] In the Internet of Things, one of the most important characteristics of sampled data is temporal and spatial correlation. A well-designed index helps to improve the retrieval efficiency of spatiotemporal correlation. In the storage system designed by the present invention, the space is not limited to the GPS space, and the user can define any size of space, for example, a space of 30 kilometers × 30 kilometers can be defined to represent the geographical space within the fifth ring road of Beijing urban area . At the same time, the space can also be expanded according to actual needs. If it is necessary to include the space within the sixth ring road in Beijing, it can...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a method and a system for storing mass data of the Internet of Things (IoT). The system comprises a plurality of data receiving nodes, a master node server and a database cluster. The method comprises the following steps of: (1) carrying out preprocessing on IoT data, and putting the preprocessed data in the database cluster consisting of a master node, slave nodes and the data receiving nodes; (2) creating sample records, which take sample elements as storage units, on the master node according to the static and dynamic information of the data in the database cluster; (3) after the sample records are encapsulated, sending the encapsulated sample records to all the slave nodes by the master node so as to be subjected to fragmentation processing and / or separated storage; and (4) after the slave nodes complete storage, uploading results to the master node, and updating the data in the database cluster by the master node, thereby completing storage. According to the method and the system, the cluster is extended by fully utilizing the existing storage technologies so as to store the mass data, the IoT data are divided into lightweight data and multimedia data, and particularly, a fragmentation strategy is adopted aiming at a large-scale amount of data, so that the time expenditure caused by the extension of a storage space is avoided.

Description

technical field [0001] The present invention relates to a storage method and system for the Internet of Things, in particular to a NoSQL-based data storage method and system for the Internet of Things. Background technique [0002] The Internet of Things (IoT) connects items to the Internet through various information-aware devices, so that all ordinary physical objects that can be independently addressed can exchange information, and finally achieve intelligent identification, positioning, tracking, monitoring and management purposes. [0003] Data is one of the most valuable aspects of the Internet of Things. In the Internet of Things environment, data comes from different sensing devices and represents billions of objects. Overall, IoT data presents the following characteristics: [0004] 1. Multi-source heterogeneity. IoT data comes from different sensing devices, such as RFID (Radio Frequency Identification, radio frequency identification) readers, video devices, temp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08G06F17/30
Inventor 李廷力田野杜源峰刘阳
Owner COMP NETWORK INFORMATION CENT CHINESE ACADEMY OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com