National defense science and technology hot word discovery method and system based on big data

Abstract

The invention discloses a national defense science and technology hot word discovery method and system based on big data, and the method comprises: inputting a news dynamic text in a specific time period into a pre-built Chinese national defense science and technology term extraction model based on CRF, and outputting a national defense science and technology hot word candidate set; performing popularity sorting on national defense science and technology terms in the national defense science and technology hot word candidate set through a Newton cold cutting method, and outputting a national defense science and technology hot word set; and inputting the national defense science and technology hot word set into a pre-established national defense science and technology hot word classification model, and outputting national defense science and technology hot word category information. Technologies such as term extraction, hot word sorting and entity classification are comprehensively applied; the hot word discovery method oriented to the national defense science and technology field is proposed for the first time, and the result shows that the method can effectively mine the nationaldefense science and technology hot words appearing in Chinese dynamic news, and helps researchers to track and grasp the latest hot spots and key knowledge clues in the national defense science and technology field in time.

Description

technical field [0001] The present invention relates to the technical field of natural language processing, in particular to the technical field of information extraction, in particular to a method and system for discovering hot words of national defense science and technology based on big data. Background technique [0002] The traditional term extraction methods can be roughly divided into three categories: (1) Rule-based methods. Mainly based on some linguistic knowledge, the matching rules of terms are summarized, such as FASTR system, Terms system, etc. The advantage of this method is that it is simple to implement and has a high recognition accuracy, but the matching rules of terms need to be summarized manually, which is time-consuming It is laborious, and it is easy to have the problem of missing recognition caused by incomplete coverage of rules; (2) The method based on statistics. One is an unsupervised statistical method, which relies entirely on statistical quan...

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to overcome the problem that the traditional term extraction method cannot be directly and effectively applied to the recognition of national defense science and technology terms, and at the same time, facing the needs of quickly grasping the key hotspot knowledge in the field of national defense science and technology, comprehensively use improved term extraction, hot word sorting, entity classification and other technologies, A method for discovering hot words of national defense science and technology based on big data is proposed

Images