Internet of Things unstructured big data analysis algorithm based on machine learning

An unstructured data and unstructured technology, applied in machine learning, instrumentation, computing, etc., can solve the Internet of Things unstructured big data analysis scheme and distance maintenance degree without public machine learning precedents and without public machine learning Low measurement value and other problems, to achieve the effect of solving big data problems

Pending Publication Date: 2020-08-14
NORTH CHINA ELECTRIC POWER UNIV (BAODING)
View PDF2 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

High-dimensional feature extraction involves the problems of "distance" and "dimensionality reduction". The ideal feature extraction algorithm has a low measurement value for the degree of distance preservation. However, there is no public precedent for applying machine learning to the field of big data in the prior art. That is, there is no public machine learning-based IoT unstructured big data analysis solution

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Internet of Things unstructured big data analysis algorithm based on machine learning
  • Internet of Things unstructured big data analysis algorithm based on machine learning
  • Internet of Things unstructured big data analysis algorithm based on machine learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0049] For direct-to-application scenarios, the training set instances selected by Online Terminal Analysis (OTA) consist of unstructured data, and OTA uses the adjacent node distance as a weighting parameter to evaluate the correlation, figure 2 The file reading process for the online terminal analysis algorithm.

[0050] In order to deeply analyze the performance of the present invention, the present invention analyzes the performance of raw data based on big data analysis of IoT sensors, due to a large amount of user data information, a big data platform is created to test the data, and then configure the platform. Build and test the big data platform using Ubuntu-Linux10.04, Hadoop1.03 and SunJava6 architecture. Hadoop needs to enable SSH access. SSH can manage remote nodes and local nodes. After the configuration is completed, a comprehensive analysis of the running data is performed. Table 1 shows the time and number of nodes used for each analysis.

[0051] Table 1

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an Internet of Things unstructured big data analysis algorithm based on machine learning. The algorithm comprises the following steps of: 1), constructing a big data platform,and acquiring unstructured original data input by an online client at a front end; 2) according to the unstructured original data received by the front end, preprocessing the unstructured original data by a client terminal background so as to perform background data mining; 3) removing redundant and noisy junk data of the unstructured original data to obtain an unstructured data sample; and 4) clustering unstructured data sample by the Internet of Things unstructured big data analysis algorithm based on machine learning, and reasoning and training a prediction model, then performing predictionwith the trained prediction model, and outputting the prediction result. The method can realize analysis of the Internet of Things unstructured big data by utilizing the algorithm based on machine learning.

Description

technical field [0001] The invention relates to an unstructured big data analysis algorithm of the Internet of Things, in particular to a machine learning-based unstructured big data analysis algorithm of the Internet of Things. Background technique [0002] Machine learning is a research hotspot in computer science and artificial intelligence. The industry does not have a unified standard for defining "machine learning", but machine learning is generally a model of human cognitive processes and learning processes, combined with the computing power of a computer to perform human behavior simulations. Acquire new knowledge or skill algorithms. It uses prior knowledge and training data to guide learning, and continuously adjusts the existing knowledge structure to improve its performance. In recent years, many machine learning algorithms have been widely used in engineering practice and scientific research. Such as clustering (data clustering), SVM (support vector machine),...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N20/00
CPCG06N20/00G06F18/23G06F18/214
Inventor 侯瑞赵云灏胡杨任国文李建彬刘欢常亮刘佳悦任羽圻方苏婉袁梦
Owner NORTH CHINA ELECTRIC POWER UNIV (BAODING)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products