A method for filling missing values ​​of water quality monitoring data

A technology for water quality monitoring and missing data, applied in general water supply conservation, instrumentation, design optimization/simulation, etc., can solve problems such as low data filling accuracy, and achieve the effect of excellent performance and improved accuracy

Inactive Publication Date: 2021-07-02
HANGZHOU DIANZI UNIV
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In order to solve the problem of low filling accuracy of missing water quality data, it is necessary to propose a new filling method for missing water quality data. This method is based on an improved OCS-FCM water quality monitoring data filling method for missing values. The parameters of the OCS-FCM algorithm are optimized by using the degree matrix method to improve the clustering performance of the algorithm, and finally a complete water quality monitoring data set with an ideal filling effect is obtained.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for filling missing values ​​of water quality monitoring data
  • A method for filling missing values ​​of water quality monitoring data
  • A method for filling missing values ​​of water quality monitoring data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The technical scheme of the present invention is described in detail now in conjunction with the accompanying drawings.

[0039] Such as figure 1 Shown, the algorithmic model of the inventive method is as follows:

[0040] First, the water quality monitoring data of the water quality monitoring station is regarded as a data set, which contains normal water quality data and missing water quality data, and then the improved OCS-FCM algorithm is used to solve the missing data in the data set. The membership matrix is ​​updated iteratively until the preset number of iterations is reached, and the iteration is stopped. Finally, the solved missing data is filled into the original data set to obtain a complete data set without missing data.

[0041] Such as figure 2 As shown, the steps of filling missing data by the algorithm used in the present invention are as follows:

[0042] Step 1: Select the data set X, and initialize the parameters of the fuzzy clustering optimiza...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for filling missing values ​​of water quality monitoring data. The present invention regards the water quality monitoring data of the water quality monitoring station as a data set, which contains normal water quality data and missing water quality data, and then uses the improved OCS-FCM algorithm to solve the missing data in the data set, mainly as Continuously update the membership matrix iteratively until the preset number of iterations is reached, and then stop the iteration. Finally, the solved missing data is filled into the original data set to obtain a complete data set without missing data. The method of the invention overcomes the disadvantage of difficult selection of membership degree matrix parameters of the traditional FCM algorithm, adopts a method of updating the membership degree matrix in real time, and realizes the improvement of the correct rate of missing data filling, especially in the case of a data set with a large missing rate.

Description

technical field [0001] The invention belongs to the field of water quality monitoring, and in particular relates to a method for filling missing values ​​of water quality monitoring data. Background technique [0002] In water quality monitoring engineering applications, the data collected by front-end sensors is often not directly available, and data preprocessing has become an indispensable step in engineering applications. Due to sensor aging or system instability, there are often data loss phenomena in the process of water quality monitoring data collection, resulting in the absence of water quality monitoring data sets. An important part of the processing link. The missing value is the NULL value in the database. At present, the common NULL value processing methods in the field of water quality monitoring are as follows: [0003] (1) Direct discard method. That is, delete the NULL value in the water quality monitoring database. This method is simple and crude, and is...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/62G06F30/27G06F111/04
CPCY02A20/152
Inventor 蒋鹏孙光培许欢林广
Owner HANGZHOU DIANZI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products