New word discovery method and device, terminal and server
A new word discovery and new word technology, applied in the field of natural language processing, can solve problems such as low efficiency, and achieve the effect of reducing workload and labor costs
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment Construction
[0040] As mentioned in the background technology, in the rule-based method of the prior art, how to establish comprehensive and complete rules is an urgent problem to be solved; in the statistical method, the determination of the threshold is a difficult problem, resulting in the extracted new words are not new words As a result, the new word candidates contain garbage word strings (such as doing housework, this book, time, etc.), which requires a lot of manual participation in new word filtering, and the efficiency is extremely low.
[0041] In the embodiment of the present invention, on the basis of the new word discovery operation, the sub-parts of the new word candidates are obtained based on the word segmentation results of the original corpus, that is to say, the sub-parts of the new word candidate words are all existing vocabulary; The semantic similarity between the candidate word and its sub-part, when the semantic similarity is less than the set threshold, indicates t...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com