Patents
Literature
Hiro is an intelligent assistant for R&D personnel, combined with Patent DNA, to facilitate innovative research.
Hiro

64 results about "Generalization error" patented technology

In supervised learning applications in machine learning and statistical learning theory, generalization error (also known as the out-of-sample error) is a measure of how accurately an algorithm is able to predict outcome values for previously unseen data. Because learning algorithms are evaluated on finite samples, the evaluation of a learning algorithm may be sensitive to sampling error. As a result, measurements of prediction error on the current data may not provide much information about predictive ability on new data. Generalization error can be minimized by avoiding overfitting in the learning algorithm. The performance of a machine learning algorithm is measured by plots of the generalization error values through the learning process, which are called learning curves.

Rapid target detection method based on convolutional neural network

The invention relates to a rapid target detection method based on a convolutional neural network, and relates to the computer vision technology. The rapid target detection method comprises the following steps: training convolutional neural network parameters by utilizing a training set; solving the problem of max-pooling losing feature by using an expander graph and generating a discriminative complete feature graph; regarding the full-connection weight of the convolutional neural network as a linear classifier, and estimating the generalization error of the linear classifier on the discriminative complete feature by using a probable approximately correct learning framework; estimating the required number of the linear classifiers according to the generalization error and the expected generalization error threshold value; and finally, completing the target detection on the discriminative complete feature graph by using the linear classifiers on the basis of a smooth window. The detection efficiency and the target detection precision are obviously improved.
Owner:XIAMEN UNIV

Vehicle flow predicting method based on integrated LSTM neural network

The invention relates to a vehicle flow predicting method based on an integrated LSTM neural network. On the basis of historical data obtained by vehicle flow detection, an integrated LSTM neural network vehicle flow prediction model is established to carry out vehicle flow prediction, so that the generalization error of the prediction model is reduced and the accuracy is improved. The method comprises the following steps that: data preprocessing is carried out; according to a preprocessed vehicle flow time sequence value, a vehicle flow matrix data set is constructed and the vehicle flow of an (n+1)th period of time is predicted by using first n periods of time, wherein each period of time is delta t expressing the time length and the unit is min; a plurality of different LSTM neural network models are constructed by using different initial weights; on the basis of a bagging integrated learning method, a training set and a verification set are constructed; a plurality of LSTM neural networks are trained to obtain an optimized module; a weighting coefficient of the single LSTM model is calculated by using the verification set; and inverse transformation and reverse normalization are carried out on a predicted vehicle flow value to obtain a predicted vehicle flow and integrated weighting is carried out to obtain a vehicle flow value predicted finally by the model.
Owner:CHONGQING UNIV OF POSTS & TELECOMM

Power transformer fault diagnosis method

The invention discloses a power transformer fault diagnosis method. The power transformer fault diagnosis method comprises the following steps of determining N fault types of a transformer, and determining corresponding fault characteristic quantities for diagnosing the N fault types; taking the fault characteristic quantities corresponding to the N fault types as a testing sample, and performing normalizing processing of testing sample data; combining any two of the N fault types, establishing X (described in the specification) SVM ( Support Vector Machine) secondary classifiers, and training the X SVM secondary classifiers, and optimizing a SVM kernel function using a method based on combination of K-fold cross validation and an artificial bee colony algorithm; calculating generalization errors of each SVM classifier according to the K-fold cross validation method; and diagnosing the N fault types using an improved reordering adaptive directed acyclic graph support vector machine method. The invention has a capability of well diagnosing the fault type of a transformer, can greatly improve the accuracy of transformer fault diagnosis, and provides a reliable basis for transformer maintenance.
Owner:STATE GRID JIANGSU ELECTRIC POWER CO ELECTRIC POWER RES INST +2

RBF-neural-network-based atmospheric pollutant concentration prediction method

The invention relates to an RBF-neural-network-based atmospheric pollutant concentration prediction method. The RBF-neural-network-based atmospheric pollutant concentration prediction method includesthe steps: dividing experimental data according to the actual situation of the predicted area, and pre-processing the atmospheric pollutant concentration data; using the MMOD improved K-means++ algorithm to solve the center of clustering, and calculating each kernel function width based on the variance; sampling the experimental data, wherein data subsets taking part in creation of RBF neural networks are IOB, and the remaining data that are not drawn are OOB data; evaluating learners to screen out the RBF neural network with the smallest generalization error, training an integrated RBFNN model; and by means of the weighted integrated RBFNN algorithm, based on weighted Euclidean distance, training single parameter through the center of clustering, the width and the weight to optimize RBFNN, and applying the single parameter to the integrated RBFNN to predict data. The RBF-neural-network-based atmospheric pollutant concentration prediction method is applied to atmospheric pollutant concentration prediction, and can greatly improve accuracy of atmospheric pollutant concentration prediction.
Owner:NORTHEASTERN UNIV

Visualized optimization processing method and device for random forest classification model

Disclosed is a visualized optimization processing method for a random forest classification model. The method comprises: for a random forest classification model which has been constructed, estimating the degree of correlation between various decision trees of the random forest classification model via out-of-bag data; constructing a correlation matrix using the degree of correlation between various decision trees of the random forest classification model; according to the correlation matrix, by means of the dimension reduction technology, acquiring a visual pattern of the random forest classification model in a space with dimensions fewer than three; and according to the visualized pattern of the random forest classification model, conducting optimization processing on the random forest classification model, so that the upper limit of a second generalization error of the processed random forest classification model does not go beyond the upper limit of a first generalization error of the random forest classification model prior to processing. By means of the above-mentioned method, the present invention can reduce the number of decision trees in the random forest classification model and reduce the memory space required by the random forest classification model, and can also improve the prediction speed and accuracy at the same time.
Owner:HUAWEI TECH CO LTD

Construction method of domain self-adaptive classifier, construction device for domain self-adaptive classifier, data classification method and data classification device

The invention provides a construction method of a domain self-adaptive classifier, a construction device for the domain self-adaptive classifier, a data classification method and a data classification device, wherein the construction method comprises the following steps that: a combined penalty objective function for constructing the domain self-adaptive classifier is determined, wherein the domain self-adaptive classifier is a classifier for classifying the data of a target domain and a source domain; the domain self-adaptive generalization error upper limit is determined on the basis of the combined penalty objective function; and on the basis of the domain self-adaptive generalization error upper limit, more than two classifiers are subjected to coordination training, and the domain self-adaptive classifier is constructed. The problem of distribution unconsistency of a source domain and a target domain in the prior art is solved; the more accurate classification can be realized on the premise of ensuring the convergence; the computation complexity is greatly reduced; and the problem of cross-domain information processing which cannot be handled by ordinary mode identification is solved.
Owner:CHINA UNIV OF PETROLEUM (BEIJING)

Method of optimizing deep neural network based on learning automata

InactiveCN106951959AAdaptableDoes not cost extra computationNeural architecturesGeneralization errorLearning automata
Provided is a method of optimizing a deep neural network based on learning automata (LA). In the training phase of a deep neural network, by starting from a fully connected initial network structure, weak connections in the network are continuously found and removed in the process of iterative parameter update through gradient descent. Thus, a more sparsely connected network structure with smaller generalization error is obtained, and image classification can be carried out on test samples more accurately. The weak connections are judged by LA through continuous interaction with the neural network in the process of training. By using the idea of reinforcement learning for reference, introducing a learning automaton algorithm to improve the traditional back propagation algorithm and removing redundant connections to reduce network parameters, the classification accuracy of test samples is increased, and the method has stronger ability to prevent over-fitting.
Owner:SHANGHAI JIAO TONG UNIV

Method and device for predicting operation stage and service life of grounding grid of substation

The invention discloses a method and device for predicting the operation stage and service life of a grounding grid of a substation based on the improved random forest algorithm. The method includes the following steps that initial data is obtained, and an original sample set is constructed; based on the characteristics of an original sample set, characteristic variables are extracted; the K-medoids method is used for clustering of the original sample set; the random forest algorithm is used for processing various samples, and a random forest model is formed; the to-be-predicted substation grounding grid characteristic variables are loaded into a random forest model, and the operation time in a feature vector is changed to obtain the relationship of an evaluation result and the operation time, and the predicted result of an operation stage and operation life are deduced. The randomness of the original sample set classification in the random forest algorithm is improved; the forest model is generated on the basis of the random forest algorithm, the generalization error is controllable, and the clustering accuracy is high; various factors affecting the state of the grounding grid ofthe substation are taken into account comprehensively, and different operation stages are divided to identify the corrosion state of the grounding grid in the corresponding stage through combination of the most suitable grounding grid fault detection method.
Owner:STATE GRID HENAN ELECTRIC POWER ELECTRIC POWER SCI RES INST +3

Garbage classification method and system based on transfer learning and model fusion and medium

The invention discloses a garbage classification method and system based on transfer learning and model fusion and a storage medium. In the method, the method includes classifying the junk image datathrough a classifier, and outputting a corresponding classification result; moreover, the generation process of the classifier adopted by the invention comprises the step of constructing two differentclassification networks into two strong classifiers by using an Adaboost algorithm, so that the generalization error rate is low, over-fitting is avoided, and the high accuracy of industrial requirements can be achieved. And the two strong classifiers are fused in a decision-making layer fusion mode, so that the feature diversity is fully utilized, and the classification accuracy is further improved.
Owner:CAS OF CHENGDU INFORMATION TECH

Method for determining a transfer learning boundary of heterogeneous relation data in public opinion data role recognition

The invention discloses a method for determining a transfer learning boundary of heterogeneous relation data in public opinion data role recognition, and relates to the technical field of transfer learning. The problem that in the prior art, data in two fields are not combined for learning and then applied to a target domain, and the classification effect is inaccurate is solved. The method comprises the following steps: defining divergence for measuring the difference between two heterogeneous domains according to the formula (1), and defining the divergence for measuring the difference between the two heterogeneous domains, solving Empirical distances from two fields of the same abstract hypothesis class A by using the method, and giving an algorithm for converting the two classes into the same feature space; giving A difference boundary between an empirical distance and a real distance , a boundary for minimizing an error of a target domain, a giving generalization error which is strongest in generalization ability and combines training data of a source domain and the target domain, and obtaining a boundary of the error of the target domain by minimizing a joint error. And obtaining the obtained boundary ensures that a reasonable boundary value under the condition that the labeled data of the target domain is very few. The method is suitable for various identification problems in public big data and new media data platforms.
Owner:HARBIN INST OF TECH

Training method and detection method of network traffic anomaly detection model

The invention discloses a training method and a detection method of a network traffic anomaly detection model. The network traffic anomaly detection model comprises a feature extraction network and aclassification network, and the training method comprises the following steps: determining the number of hidden layers and the number of neurons in each hidden layer according to a training sample; constructing an initial feature extraction network according to the number of the hidden layers and the number of neurons in each hidden layer; training the initial feature extraction network by using atraining sample to obtain a trained feature extraction network; extracting abstract feature data of a training sample by using the trained feature extraction network, and training a classification network by using the abstract feature data so as to complete training of a network traffic detection model. The network structure can adapt to network flow data, the situation that the structure of a detection model is too complex and too simple is avoided, and therefore, generalization errors are reduced, the detection time can be obviously shortened, and the detection accuracy can be obviously improved.
Owner:SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI

Off-line embedded abnormal sound detection system and method

The invention provides an off-line embedded abnormal sound detection system. The off-line embedded abnormal sound detection system comprises a sound acquisition module, a sound audio feature extraction module and a neural network module. The sound audio feature extraction module processes sampling data obtained by the sound acquisition module through a digital microphone in a frequency domain by using fast Fourier transform, and inputs the sampling data to the neural network module to complete anomaly classification. The neural network module comprises a CNN feature extraction layer, an LSTM long-term and short-term memory layer, a full connection and classification layer and a trigger judgment layer. The number of network layers of the CNN feature extraction layer is dynamically adjustable, the network structure of the full connection and classification layer is dynamically variable, and a trigger decision layer is used for eliminating generalization errors generated by the neural network. The invention further comprises a method for carrying out anomaly detection by utilizing the off-line embedded abnormal sound detection system. The method works in an off-line environment, has less dependence on a network, is high in performance and reliable in work, and can adapt to a changing abnormal diagnosis working environment.
Owner:ESPRESSIF SYST SHANGHAI

Support vector machine based automatic focusing method of ultrasonic phased arrays of ring welds

The invention discloses a support vector machine based automatic focusing method of ultrasonic phased arrays of ring welds. The method includes: establishing a rectangular coordinate system, taking a least squares support vector regression (LSSVR) machine as the regression model and Gaussian radial basis function as the kernel function, performing training with input and output which are subjected to standardized processing, and establishing a prediction model of LSSVR initial function; taking a generalization error calculated with a k-fold cross validation method as the target function, optimizing the LSSVR initial function by adopting an optimization method combining a coupling-simulated annealing algorithm with a grid searching method to acquire an optimal hype-parameter and an LSSVR optimization model, predicting tested data to acquire the output, performing inverse normalization processing to obtain the optimal acoustic beam path plan of a corresponding partition, performing reverse solution according to the Fermat theorem to obtain time delay, and applying ultrasonic signals to perform focusing detection on ring weld defects. By the arrangement, the method has the advantages that intelligent ring weld defect detection is realized, and detection precision and efficiency are effectively improved.
Owner:ZHEJIANG UNIV

New-drilled well workload prediction method based on ensemble learning

InactiveCN112330064AHigh precisionReduce the effect of noisy dataEnsemble learningForecastingGeneralization errorWell drilling
The invention discloses a new-drilled well workload prediction method based on ensemble learning. The method is characterized in that a new-drilled well workload prediction model based on a random forest is built, a key hyper-parameter combination of the new-drilled well workload prediction model is optimized through a particle swarm optimization method, and a weighted voting mechanism is added ina decision stage; by adjusting the weight value of the weak classification decision tree, the generalization error of new-drilled well workload prediction is reduced, and the precision of the new-drilled well workload prediction model is improved. The key hyper-parameter combination in the new-drilled well workload prediction model is optimized by adopting the particle swarm optimization method,the influence of noise data in oil reservoir development historical data is reduced, and the stability and the operation speed of the random forest method are improved; a weighted voting mechanism isadded in the decision stage, wherein the weight proportion of a high-score decision tree is increased and meawhile the negative influence of a low-score decision tree on a prediction result is reduced, and thereby the precision of a new-drilled well workload prediction model is improved.
Owner:CHINA UNIV OF PETROLEUM (EAST CHINA)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products