Relational table-based extraction method of configurable information

Abstract

A relational table-based extraction method of configurable information includes: defining an information extraction task in a structural form, and building extraction rules by means of the combination of a manual method and machine learning so as to extract a target page; 1, using an information extraction user interface which allows a user to express an information extraction demand in a tabular form, including a subject of information extraction; 2, generating an information extraction rule set including extraction rules manually built and rules automatically generated via machine learning; 3, extracting data, to be specific, extracting information on a webpage and persisting results, to be more specific, during extracting information of the certain webpage according to a user-configured information extraction table, extracting content of each attribute, and classifying the contents via a trained model.

Description

1. Technical field [0001] The invention belongs to the Internet data extraction in the computer field, and in particular relates to a configurable information extraction framework technology based on a relational table. 2. Background technology [0002] With the rapid development of the Internet, people's lives are increasingly inseparable from the Internet, and the amount of information on the Internet is also increasing. [0003] The explosive growth of the Internet has made the Internet a huge information source, capable of providing massive amounts of valuable information. For users, how to effectively obtain and utilize such information has become particularly urgent and important. At present, most of the data on the Internet appear in the form of HTML. The information in HTML documents is mainly display-oriented, lacking a description of the data itself, and does not contain semantic information. Most of it is unstructured or semi-structured data. This prevents appli...

AI Technical Summary

Problems solved by technology

[0011] 1. In terms of versatility, some can only extract information from the plain text content of web pages; some are only suitable for the extraction of semi-structured data; some rely on the inherent structure of web pages and can only be extracted from similar web pages, etc.

[0012] 2. Existing extraction techniques are mainly aimed at extracting the information that appears clearly on the webpage, without considering the information implicit in the webpage.

Images