Method and device for mining comparable network language materials
A corpus and network technology, applied in special data processing applications, instruments, electronic digital data processing, etc., can solve problems such as the limitation of comparable corpora, ambiguity in vocabulary translation, insufficient bilingual knowledge coverage, etc., to enhance analysis, improve accuracy, The effect of improving utilization
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment Construction
[0045] A method for mining comparable corpus in the network, the method includes the following steps: (1) using a web crawler to obtain source language web pages, and preprocessing to form source language documents; (2) constructing cross-language topics according to an existing bilingual corpus The model analyzes the probability of cross-language topics of the source language documents, and generates the corresponding target language query words by using the source language document topic information; (3) Submit the target language query words to the search engine, obtain the target language documents in the network, and select the top N (4) Analyze the cross-language topic probability distribution of the target language candidate similar documents, and calculate the similarity between the source language document and the target language candidate similar documents according to the KL divergence of the topic probability distribution. and filter out the source language document...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com