306 results about "Unsupervised clustering" patented technology

A system and method for performing domain-specific knowledge based metasearches. A metasearch engine is provided for accessing a searching text-based documents using generic search engines while simultaneously being able to access publication based databases and sequence databases as well as in-house proprietary databases and any database capable of being interfaced with a web interface so as to produce search results in text format. A data mining module is also provided for organizing raw data obtained by unsupervised clustering, simple relevance ranking, and categorization, all of which are done independently of one another. The system is capable of storing previous search data for use in query refinement or subsequent searches based upon the stored data. A search results collection browser may be provided for analyzing current browsing patterns of the user for developing weighting factors to be used in ordering the results of future searches.

The invention discloses a rear-end collision pre-warning method based on driver types, and aims to solve the problem that the pre-warning accuracy is reduced due to no consideration of driving habits of different types of drivers in the prior art. The rear-end collision pre-warning method comprises the steps as follows: 1, an emergency reaction ability test: reaction time of a tested driver is tested by a reaction time tester; 2, driving behavior monitoring: corresponding sensors are respectively utilized to acquire operation parameters of the tested driver, a distance between the tested vehicle and a vehicle ahead and a relative speed; 3, classification of driver types: according to emergency reaction ability test data and driving behavior monitoring data of the tested driver, an unsupervised cluster analysis method is adopted to determine the driver type on the basis of a preset reaction capacity classification rule and a driving style membership grade function; 4, real-time danger level detection: a danger level judgment equation suitable for the driver type of the tested driver is selected to judge current driving danger level of the tested vehicle; and 5, pre-warning triggering.

A novel and useful method for enabling system logs to be effectively and efficiently monitored by ranking the system log messages by their estimated value to administrators and generating a log view that displays the most important messages. The ranking process uses a dataset of system logs from many computer systems to score messages. For better scoring, unsupervised clustering is used to identify sets of systems that behave similarly. The expected distribution of messages in a given system is estimated using the resulting clusters, and log messages are scored using this estimation.

The present disclosure relates to an early warning and recommendation system for proactive management of a wireless broadband network. Without human intervention, the system processes highly heterogeneous network and non-network data and applies unsupervised machine learning to the data to predict and understand the situations that lead to different network state conditions. More specifically, unsupervised clustering is applied to the data to understand “situations” that can lead to non-normal network state conditions. A deep neural network model of situations is then created to further understand the underlying data relationships between the elements of a situation and network states. The deep neural network model and Reinforcement Learning is used to provide recommendations as to changes in wireless / mobile broadband network configuration parameters that will improve the state of a predicted situation associated with non-normal network conditions. The system displays warnings and corresponding recommendations regarding predicted non-normal network conditions in a user interface for a network operator.

The invention discloses a fast high-resolution SAR (synthetic aperture radar) image ship detection method based on feature fusion and clustering. The fast high-resolution SAR image ship detection method comprises the following steps: on the basis of the back scattering characteristics of each ground object and the prior information of a ship target in an SAR image, positioning a target potential position index map by an Otsu algorithm and range constraint; on the index map, pre-screening to obtain a detection binary segmentation map by a CFAR (constant false alarm rate) algorithm based on a local contrast; carrying out morphological processing to a detection result, and extracting a potential target slice from the SAR image and a detected binary segmentation map according to a processing result; and carrying out K-means clustering to the extracted slice by a designed identification feature to obtain a final identification result. According to the fast high-resolution SAR image ship detection method based on feature fusion and clustering, the data volume of a detection stage is effectively reduced by pre-processing, and point-to-point detection is not needed / the time of point-to-point detection is saved. Meanwhile, a target identification problem under the condition of insufficient training samples at present can be solved by the designed characteristic and a non-supervision clustering method, the target can be effectively positioned, and the size of the target can be estimated.

The invention discloses a voice endpoint detection method based on waveform morphological characteristic clustering. The voice endpoint detection method based on waveform morphological characteristic clustering includes the following steps that first, a pure voice signal is acquired through an original voice signal; second, an envelope signal of the pure voice signal is acquired and divided into a plurality of voice sub-segments; third, according to the waveform morphological characteristics of all the voice sub-segments, the voice sub-segments are clustered and non-voice voice sub-segments are removed; fourth, all the voice sub-segments of reserved parts in the third step are processed, and a voice endpoint is obtained. According to the method, a good result can be obtained fast and accurately with a relative simple non-monitoring clustering method under the condition that a single characteristic is utilized.

The invention discloses a wind power prediction method based on continuous time slice clustering and support vector machine (SVM) modeling. The method comprises the following steps of: (1) performing annual similar day unsupervised clustering according to the wind characteristic; (2) partitioning an entire year into n continuous time slices according to a similar day clustering result obtained in the step (1), and clustering and classifying every time slice according to the frequency of each type of date within every time slice and the wind characteristic in the continuous time slices; and (3) modeling the time slices of the same type in the step (2) by using an SVM for predicting the same time of future years. An annual continuous time slice clustering method is adopted on the basis of day similarity, so that day similarity and time continuity are considered simultaneously, and the similarity of a training sample in a prediction model and the accuracy of wind power prediction are increased greatly. Compared with the conventional method, the wind power prediction method has the advantages that: the relative power prediction error is decreased by 7.2 percent, and the prediction accuracy of the wind power is up to 83.96 percent.

A non-supervision clustering-based distributed cooperative spectrum sensing method for a cognitive self-organizing network relates to the field of cognitive radio in wireless communication technology. Aiming at solving the problems of difficult distributed cooperation of the cognitive self-organizing network and large overhead of whole-network cooperation, the method adopts the latest achievements of a non-supervision clustering theory and a co-recognition theory to achieve fully-distributed, steady and reliable distributed cooperative spectrum sensing under the condition of simplifying the overhead of network sensing; and users with potential optimal detection performance spontaneously gather only via information interaction between neighbors, further the users carry out cooperation spectrum sensing by utilizing an average co-recognition protocol, and a sensing result is broadcast to the whole network users. The method does not require local users to receive apriori information of noise-signal ratio, and does not need any central controllers, thereby greatly lowering sensing overhead and acquiring detection performances similar to optimal soft combination solution.

Embodiments of the present invention describe a collaborative framework for mining of surveillance videos to detect abnormal events, which introduces a two-stage training process to alleviate the high false alarm problem. In the first stage, unsupervised clustering is performed on the segments of the video streams and a set of abnormal events are combined with user feedback to generate a clean training set. In the second stage, the clean training set is used to train a more precise model for the analysis of normal events and the motion detection results from multiple cameras can be cross validated and combined. This description is not intended to be a complete description of, or limit the scope of, the invention. Other features, aspects, and objects of the invention can be obtained from a review of the specification, the figures, and the claims.

The invention relates to an automatic extraction method for newly-increased construction land image spots in high-resolution remote sensing images based on the NDVI and the PanTex index. The method includes the first step of inputting a front time phase high-resolution remote sensing image and a back time phase high-resolution remote sensing image, and then conducting geometric fine correction and relative radiation correction, the second step of calculating a front time phase NDVI image, a back time phase NDVI image, a front time phase PanTex image and a back time phase PanTex image, the third step of conducting unsupervised clustering on the two NDVI images and the two PanTex images respectively, the fourth step of extracting a binary change image from vegetation to buildings, bulldozed and filled earth according to the two NDVI clustered images, the fifth step of extracting a binary change image from vegetation, bulldozed and filled earth to the buildings according to the two PanTex clustered images, the sixth step of extracting interfering ground object regions, the seventh step of conducting union operation on the two extracted change images and removing interfering ground object masks to obtain a newly-increased construction land image, the eighth step of segmenting the back time phase images, and the ninth step of calculating the proportion of changed pixels in each segmented image spot and extracting the newly-increased construction land image spots. Through the method, three types of newly-increased construction land image spots can be effectively extracted, and auxiliary information can be provided for land utilization change investigation.

The invention belongs to the technical field of lung adenocarcinoma prediction, and specifically relates to an identification of early diagnosis markers of lung adenocarcinoma based on co-expression similarity, and a constructing method of a risk prediction model. The constructing method includes the steps of: data remodeling and grouping, data standardization, phase specific gene extraction, geneco-expression correlation analysis, unsupervised cluster analysis, specific and non-specific co-expression network analysis, functional pathway gathering, significant variation pathway identification, screening of early screening marker genes by using an REE algorithm, establishment of a classification model based on early screening risk genes, survival analysis verification, and the like. The identification of early diagnosis markers of lung adenocarcinoma based on co-expression similarity, and the constructing method of a risk prediction model can realize the early diagnosis of lung cancer,and can identify gene markers which change significantly with the progress of lung cancer at the same time.

A method mines unknown content of a video by first selecting one or more low-level features of the video. For each selected feature, or combination of features, time series data is generated. The time series data is then self-correlated to identify similar segments of the video according to the low-level features. The similar segments are grouped into clusters to discover high-level patterns in the unknown content of video.

The embodiment of the invention provides a method for setting a risk control score card. The setting method is applied to a risk control system of a website, and specifically comprises the following steps: receiving a data set transmitted by a business system of the website, wherein the data set comprises a plurality of rules; organizing each rule into a preset characteristic form, and obtaining aplurality of characteristic values corresponding to the plurality of rules; clustering the plurality of characteristic values by utilizing a density-based unsupervised clustering algorithm to obtaina plurality of characteristic sets; marking the characteristic sets containing pre-marked abnormal samples as abnormal samples, and acquiring the value range of the characteristic values in each abnormal sample; performing model training based on the abnormal samples and normal samples obtained by sampling, and obtaining a supervised learning model; and determining a threshold of each rule according to the value range of the characteristic values in each abnormal sample, and establishing the risk control score card based on a rule tree. The risk control score card provided by the invention canavoid the problem that an existing score card cannot reflect the true risk level of user access behaviors.

The disclosed embodiments provide a system that detects an anomaly in a computer system based on log messages. During operation, the system receives log messages generated by the computer system during operation of the computer system. Next, the system maps each received log message to a cluster in a set of clusters of log messages, wherein each cluster is associated with a specific event. The system then forms events for consecutive log messages into sequences of events. Finally, the system performs anomaly detection based on the sequences of events, wherein if an anomaly is detected, the system triggers an alert.

The invention discloses a labeling method and device for web page topics. The method includes the steps that based on titles and main bodies of web pages, topic feature vectors of the web pages are acquired; classification processing is performed on the topic feature vectors through a classifier which is obtained through training in advance; whether types which the topic feature vectors belong to exist is judged; if yes, the web pages are labeled as the types which the topic feature vectors belong to; otherwise, the web pages are labeled as web pages to be labeled; furthermore, clustering processing is performed on the multiple web pages to be labeled; the type of each cluster is obtained through analysis; the web pages to be labeled are labeled as the types of the clusters which the web pages belong to. By the adoption of a supervised classification method and unsupervised clustering method cascading mode, the topics are automatically acquired from the web pages, the web pages are labeled, and the labeling efficiency and accuracy of the web page topics are effectively improved.

The invention provides a method for automatically generating a main character abstract in a television program. According to the method, image characteristics and an unsupervised clustering method in a video are combined, so that main characters in a program video are extracted, an interviewer and an interviewee are marked, and a preview of the main character abstract is generated; and therefore, the user experience is enhanced. The method comprises the following steps of: extracting a key frame at a uniform time interval based on a video paragraph with marks, performing face detection and characteristic extraction, performing linear clustering on face images based on characteristics, obtaining rough character classifications according to time information and space information of the face images, obtaining a precise clustering result through graph-theory-based clustering, filtering the main character classifications of independent paragraphs by an adaptive method, integrating filter results of all the paragraphs, secondarily performing the graph-theory-based clustering, judging the interviewer and the interviewee according to a rule, and marking and generating the main character abstract of each paragraph. By the unsupervised clustering method, the structure is simple, and the method is easy to implement; and the method is relatively high in universality and robustness.

The invention discloses a semantic similarity analysis method based on text clustering. The method comprises the following steps: taking unprocessed text data as input; performing word frequency statistics on texts subjected to data preprocessing, adding word frequency statistics information serving as priori knowledge into text clustering, proposing a posteriori judgment criterion, and performingan unsupervised clustering method on the basis of taking the word frequency statistics as a classifier to improve the accuracy and timeliness of a text clustering result; carrying out synonym ambiguity elimination on the processed text, and carrying out semantic role labeling; and generating a semantic vector fused with the context features, processing the text sequence by adopting two LSTMs withcompletely same structures and parameters, adding the product and variance of the results, amplifying the same points and differences of the texts, and calculating to obtain a final result of similarity analysis. The method can be applied to actual scenes of text similarity analysis in various different fields, and text data of different types can be well processed.

The invention discloses a deep learning clustering method for noise images. The deep learning clustering method comprises the following steps: S1, constructing a deep learning clustering model; S2, adopting an AMsoftmax layer as a clustering device, and generating a clustering result according to the feature vector output by the encoder in the step S1; S3, measuring the similarity between the output of the encoder and the output of the twin network by adopting an L2 norm; S4, adopting KL divergence to measure the distribution difference between the clustering result and the auxiliary target distribution; S5, training a deep learning clustering model; And S6, obtaining a clustering result of the data through the AMsoftmax layer. According to the method, unsupervised clustering can be carried out on image data containing noise, and the problems that most image clustering algorithms do not model noise data and an existing deep clustering algorithm is poor in clustering effect on images with high non-linear characteristics are solved.

The invention belongs to the image processing field and relates to a multi-target tracking method and a system based on kernel function unsupervised clustering. According to the method, a binocular camera is utilized to acquire left and right sequence images at one same time, and parameters of the binocular camera are utilized for image correction; a parallax error is calculated through extracting image characteristic points and matching characteristics; the acquired parallax error is utilized to calculate the coordinate position of a target characteristic point relative to the camera, namely the coordinate of the camera, ground calibration is accomplished, ground shadow characteristic points can be filtered according to height from the characteristic point to the ground, and ground shadow interference is eliminated; according to the three-dimensional coordinate characteristic point, in combination with the kernel function, unsupervised clustering is carried out for targets with undetermined category quantity, all characteristic points of one target are gathered to form one set, one category corresponds to the position and the direction of one observation value, a present frame of the target can be acquired in combination with the position and the direction of the previous frame target, namely the prediction position value and the prediction direction value, an optimum estimation algorithm is utilized to acquire the position and the direction of the optimum target, and thereby the multi-target fast tracking effect is realized.

The invention discloses three gene groups for transferring and typing prognostic numerator to breast cancer, a gene chip, an unsupervised clustering map from a gene expression profile and a method for transferring and typing prognostic numerator to breast cancer patients. The invention is characterized in that: the gene chip is point-sampled and prepared by specific cDNA or oligonucleotide of the gene groups with an lattice form on the surface of the supports, and is used for transferring and typing prognostic numerator to breast cancer; the cDNA or amplified products of primary cancer tissue specimens based on breast cancer patients are fluorescence-marked and then crossbred with the gene chip for transferring and typing prognostic numerator to breast cancer, and then the gene expression profile is obtained, and the unsupervised clustering map for transferring and typing prognostic numerator to patients comes from the gene expression profile; the method makes use of the gene chip and the gene expression profile for transferring and typing prognostic numerator to breast cancer.

The invention relates to a method for obtaining geometrical parameters of typical terrains in a digital map. The method includes the steps of terrain classification and recognition, terrain simplification, extracting of the geometrical parameters of the terrains and the like. According to the digital map in the GeoTIFF format in the ASTER GDEM type, by means of an ArcGIS tool, the normalized elevation, the normalized gradient, the normalized gradient variability, the normalized curvature and the normalized terrain undulation are calculated, iterative selforganization (ISO) unsupervised clustering is carried out with the obtained parameters as characteristic indexes, and the preliminary classification of the terrains is obtained; then the terrains are classified into the plain, the hill, the low mountain, the medium mountain, the high mountain and the like according to the average undulation of the various terrains; the geometrical parameters such as the positions, the bottom faces and the heights of the typical terrains are finally obtained. The method has the advantages of being feasible and practical.

A natural language understanding system performs automatic unsupervised clustering of dialog data from a natural language dialog application. A log parser automatically extracts structured dialog data from application logs. A dialog generalizing module generalizes the extracted dialog data to generalization identifier vectors. A data clustering module automatically clusters the dialog data based on the generalization identifier vectors using an unsupervised density-based clustering algorithm without a predefined number of clusters and without a predefined distance threshold in an iterative approach based on a hierarchical ordering of the generalization.

The present invention provides an image classification method based on a concise unsupervised convolutional network, and belongs to the image processing and deep learning technology field. The method of the present invention utilizes a classic unsupervised clustering algorithm K-means to cluster the image blocks of a training image set, the obtained each clustering center is a convolution kernel in a network model, and the time-consuming process in the conventional convolutional network of utilizing a stochastic gradient descent algorithm repeatedly to obtain the convolution kernels is abandoned. In addition, the present invention provides a probability pooling method to enhance the robustness of the network to the image deformation. By a concise unsupervised depth convolutional network classification model provided by the present invention, the model training time can be shortened effectively, at the same time, the identification capability of the model to the changeable scene pictures is improved.

The invention discloses an operating system scheduling method and a device based on machine learning. The device comprises the following steps: classifying tasks into one or more task groups based onresource requirement characteristics by using an unsupervised clustering algorithm; the pre-established training model being used to adjust the resource allocation parameters of the task group, so that the hardware resource utilization efficiency and the degree to which the task meets the user expectations are optimized; the resource allocation parameter obtained by the training being used for scheduling and allocating resources for the process of the next cycle of the task group.

The invention provides a credit scoring model construction method and a device, equipment and a storage medium. The construction method comprises the steps of dividing an original unbalanced credit data set into a training set and a verification set; wherein a plurality of data samples in the original unbalanced credit data set comprise credit information of a plurality of users, and the pluralityof data samples are in one-to-one correspondence with the plurality of users; dividing the data samples in the training set into a majority class of training samples and a minority class of trainingsamples; clustering the majority class training samples by using an unsupervised clustering algorithm to generate a plurality of sample clusters; obtaining a preset number of balance training subsetsaccording to the plurality of sample clusters and the minority class training samples; and constructing a credit scoring model according to the obtained balance training subset, the verification set and a preset decision tree base classifier. According to the method, the classification performance of the credit scoring model can be improved.

Described is a system for classifying objects and scenes in images. The system identifies salient regions of an image based on activation patterns of a convolutional neural network (CNN). Multi-scale features for the salient regions are generated by probing the activation patterns of the CNN at different layers. Using an unsupervised clustering technique, the multi-scale features are clustered to identify key attributes captured by the CNN. The system maps from a histogram of the key attributes onto probabilities for a set of object categories. Using the probabilities, an object or scene in the image is classified as belonging to an object category, and a vehicle component is controlled based on the object category causing the vehicle component to perform an automated action.

A platform for transcriptome deconvolution of gene expression data is provided and may be used in assessing metastatic cancer samples. The deconvolution is performed using an unsupervised clustering technique, such as grade of membership, that allows for samples to be assigned to multiple clusters during a training process. A deconvolution gene expression model is generated as a result and is used for accurate assess of metastases in subsequent samples.

The invention discloses a children epilepsy syndrome classification method based on transfer learning multi-model decision fusion. The method comprises the following steps: step 1, performing digitalfiltering on original multi-channel EEG signal data to delete and select a frequency band, and then performing artifact elimination based on a Riemannian geometry unsupervised clustering algorithm andabnormal data point elimination based on median filtering to obtain a pure EEG signal; step 2, extracting MFCC features, LPCC features, wavelet packet features and statistical features from the EEG signals; and step 3, inputting the MFCC and LPCC feature pictures and training a model F1, inputting wavelet packet features and statistical features and training a model F2, performing weighted summation on SoftMax probability output layers of the model F1 and the model F2, and obtaining a child epileptic syndrome category to which the sample belongs according to the obtained final probability. The method can achieve the precise classification of the children epileptic syndrome.

The invention discloses a handwritten character recognition method based on an expanded nonlinear kernel residual network. A novel deep learning method, namely an algorithm based on the expanded nonlinear kernel residual network is provided by utilizing structural characteristics of a deep network, and the handwritten character recognition method based on the expanded nonlinear kernel residual network is proposed by applying the deep learning algorithm to handwritten character recognition. Through the method, the correlation between sample data and expected data can be described deeply, and digital image features can be automatically learned from original data efficiently; next, an appropriate intra-class unsupervised clustering algorithm is introduced into the method, and existing technical defects of the deep learning network in the handwritten character recognition field are overcome. The method is simple and easy to implement, and network training efficiency is improved while handwritten character recognition performance is improved.