Data exception detection method and device

A technology of data anomaly and detection method, which is applied in the direction of electrical digital data processing, error detection/correction, generation of response error, etc. It can solve the problems of not considering the different impact of data, not considering the characteristics of data storage and access, etc., to achieve guarantee The effect of real-time detection, good precision and recall

Active Publication Date: 2019-09-27
TSINGHUA UNIV
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Algorithms related to anomaly detection are also widely used. Existing research uses a variety of methods, such as detection methods based on sliding time windows and traditional density-based time series data anomaly detection, but the above two methods are not suitable for blockchain Online anomaly detection of time-series data on third-party storage media has the following deficiencies: (1) It does not consider the impact of different attributes of data on outliers; (2) It does not consider the characteristics of data storage and access on blockchain third-party storage media

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data exception detection method and device
  • Data exception detection method and device
  • Data exception detection method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0025] figure 1 A schematic flowchart of a data anomaly detection method provided by an embodiment of the present invention is shown.

[0026] The data anomaly detection method provided by the embodiment of the present invention is applied to a third-party data storage medium based on blockchain, including: concurrently acquiring data on the thir...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data exception detection method and device. The method comprises the following steps: carrying out de-noising division on each data set according to attributes, and calculating the weight of each attribute according to the information entropy of the divided data set; calculating cosine distances between different data objects in each data set according to the weight of each attribute, and calculating an initial abnormal value of each data object according to the cosine distances between each data object and other data objects; inserting the data sets with the calculated initial abnormal values of all the data objects into an ordered sequence according to a time sequence; updating the initial abnormal value of the data object of any data set according to the abnormal states of the data set at the previous moment and the next moment of any data set in the sequence; and detecting the data of each data set, and judging the data of which the abnormal value exceeds a specified threshold as abnormal. According to the embodiment of the invention, the data on the third-party storage medium of the block chain can be detected, and the accuracy and the recall rate are relatively high.

Description

technical field [0001] The invention relates to the technical field of computer data management, in particular to a data anomaly detection method and device. Background technique [0002] With the development and popularization of Bitcoin, the research and application of blockchain technology has shown explosive growth. The transaction performance of the blockchain platform is very low, and it cannot meet the needs of large-scale data chaining in the industry. The common practice in the industry is to store the data on a third-party storage medium, and then store the index (pointer) on the chain. The solution enables a large amount of data to be "uplinked". This idea has become the mainstream method for large-scale data uplinking in the industry, and there is a relatively mature storage medium such as IPFS (Inter-Planetary File System). [0003] With the development of blockchain technology, more and more time series data of equipment operation and maintenance are managed o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/07
CPCG06F11/0709G06F11/079
Inventor 宋韶旭王喜方晨光王建民
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap