Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data cleaning method and device based on time sequence similarity

A technology of time series and data cleaning, applied in the field of data cleaning, can solve problems such as complex construction and evaluation models, and achieve the effects of high accuracy, low computational complexity, and strong robustness

Pending Publication Date: 2020-04-17
ELECTRIC POWER SCI & RES INST OF STATE GRID TIANJIN ELECTRIC POWER CO +3
View PDF5 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The estimated value obtained by this method is often closer to the real value, but the process of constructing and evaluating the model is more complicated, and the model needs to be evaluated

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data cleaning method and device based on time sequence similarity
  • Data cleaning method and device based on time sequence similarity
  • Data cleaning method and device based on time sequence similarity

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be described in detail below. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other implementations obtained by persons of ordinary skill in the art without making creative efforts fall within the protection scope of the present invention.

[0044] The following is attached Figure 1-6 Embodiments of the present invention are described in further detail:

[0045] A data cleaning method based on time series similarity, comprising the following steps:

[0046] Step 1. Read historical data based on the historical sample database, and perform dimensionality reduction processing on the historical data;

[0047] The high-dimensional sample data (D dimension) collected from the smart grid is actually in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data cleaning method and device based on time sequence similarity, relates to the technical field of data cleaning, and mainly aims to provide a data cleaning method which islow in calculation complexity and high in accuracy. The data cleaning method based on time sequence similarity is technically characterized by comprising the following steps: step 1, reading historical data based on a historical sample database, and performing dimension reduction processing on the historical data; 2, carrying out discretization processing on historical data by adopting a time series symbolization method; 3, performing similarity measurement and similarity calculation on the data by using a dynamic time warping algorithm; and step 4, carrying out data cleaning on the data through a set threshold, so as to obtain a cleaned result sequence. The method is suitable for a power load big data application scene, and can quickly and effectively clean the power load big data to obtain high-quality data for subsequent analysis and processing.

Description

technical field [0001] The invention relates to the technical field of data cleaning, in particular to a data cleaning method and device based on time series similarity. Background technique [0002] The smart grid collects the user's electricity consumption data through smart meters and other equipment, and then transmits the information back to the information center for analysis and processing through the network. The power user load data has important guiding significance for the study of the economic and social development of the region. With the continuous development of the smart grid, various information systems take on extremely important tasks in the operation of the power grid, and massive power user load data provide a data basis for the operation of the information system. [0003] The main characteristics of daily electric power load data are: high dimensionality and large amount of data. Due to communication reasons, equipment failure and other reasons, a lar...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/215G06F16/2458G06K9/62
CPCG06F16/215G06F16/2474G06F18/213G06F18/23G06F18/10
Inventor 李野董得龙李刚卢静雅孔祥玉李予辉孙虹刘浩宇杨光顾强何泽昊季浩白涛乔亚男翟术然张兆杰吕伟嘉许迪赵紫敬
Owner ELECTRIC POWER SCI & RES INST OF STATE GRID TIANJIN ELECTRIC POWER CO
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com