Semantic analysis method and system, equipment and readable storage medium

A technology of semantic analysis and storage media, applied in the field of semantic analysis methods, systems, equipment and readable storage media, can solve problems such as the inability to meet the service demands of accurately finding matching information, and achieve the effect of avoiding error propagation

Pending Publication Date: 2021-05-07
SHANGHAI DATATOM INFORMATION TECH CO LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing semantic analysis methods cannot meet the service demands of accurately finding matching information from massive data sources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Semantic analysis method and system, equipment and readable storage medium
  • Semantic analysis method and system, equipment and readable storage medium
  • Semantic analysis method and system, equipment and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0035] A semantic parsing method, comprising the following steps:

[0036] Step 1: Collect and clean the data to be processed;

[0037] Specifically, the collection and cleaning of the data to be processed includes the following steps:

[0038] Step 11: collect data to be processed;

[0039] Step 12: Remove duplicate values ​​from the data to be processed;

[0040] Step 13: Remove outliers from the data to be processed;

[0041] Step 14: Remove useless values ​​from the data to be processed;

[0042] Step 15: Build the mapping table and establish the corresponding relationship between the data classification and the mapping table

[0043] Step 2: construct a deep learning model, input the data to be processed into the deep learning model, extract elements from the data to be processed, and obtain the data category of the data to be processed;

[0044] Wherein, the deep learning model includes a serial BERT model and a bidirectional GRU model;

[0045] The objective funct...

Embodiment 2

[0051] Embodiment 2: Semantic parsing of natural language questions.

[0052] First, data collection is carried out. The collected data are: "Missing Persons in Shanghai", "Missing Persons in Shanghai", "Hello", "Missing Persons in America". After using python and other tools to remove duplicates, anomalies, and useless values ​​from the collected data, the "missing persons in Shanghai" are extracted as useful samples, and they are classified into the missing persons table.

[0053] The words in the obtained useful samples are translated into vectors E0, E1,..., E6 by the BERT model. And the E0, E1, ..., E6 are encoded as T0, T1, ..., T6 through the BERT model. Here E0,E1,...,E6 and T0,T1,...,T6 are 768-dimensional numeric vectors.

[0054] Specifically: the BERT model includes an embedding layer and a transformer layer. The embedding layer maps the input question to the word vector, position encoding and sentence encoding respectively, and adds the three vectors bitwise an...

Embodiment 3

[0075] A semantic analysis system includes: a preprocessing module 1, a learning module 2, a mapping module 3 and an analysis module 4.

[0076] The preprocessing module 1 is used to collect and clean the data to be processed; the learning module 2 is used to build a deep learning model, input the data to be processed into the deep learning model, extract elements from the data to be processed, and obtain the The data category of the processing data; the mapping module 3 is used to match the mapping table corresponding to the data category, input the extracted elements into the mapping table for mapping, and obtain the semantic logic corresponding to the data to be processed; the parsing module 4 is used for The parsed data conforming to the semantic logic is matched in the database, and the parsed data is output.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a semantic analysis method and system, equipment and a readable storage medium. The semantic analysis method comprises the following steps: step 1, collecting and cleaning data to be processed; 2, constructing a deep learning model, inputting to-be-processed data into the deep learning model, extracting elements from the to-be-processed data, and obtaining a data category of the to-be-processed data; 3, matching a mapping table corresponding to the data category, inputting the extracted elements into the mapping table for mapping, and obtaining semantic logic corresponding to the to-be-processed data; and 4, matching analysis data conforming to the semantic logic in a database, and outputting the analysis data. According to the method, the spoken question sentence can be analyzed and converted into the database language, and the data conforming to the intention of the question sentence can be obtained through matching.

Description

technical field [0001] The present application belongs to the technical field of language processing, and specifically relates to a semantic parsing method, system, device and readable storage medium. Background technique [0002] At present, the public security field has initially established an application system based on big data that basically covers its business scenarios, and has generated a large amount of business data in the actual use process. These data play a vital role in the research and judgment and daily work of the public security. However, the existing semantic parsing methods cannot meet the service demands of accurately finding matching information from massive data sources. Therefore, how to develop a new semantic parsing method to overcome the above-mentioned problems is the direction that those skilled in the art need to study. Invention content: [0003] The purpose of the present invention is to provide a semantic parsing method, which can parse ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F40/30G06F40/295G06F40/216G06F40/126G06N3/08G06F16/35
CPCG06N3/084G06F16/35G06F40/126G06F40/216G06F40/295G06F40/30
Inventor 王本强谢赟吴新野韩欣朱王芳
Owner SHANGHAI DATATOM INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap