Information acquisition system based on financial heterogeneous big data and control method thereof

Abstract

The invention discloses an information acquisition system based on financial heterogeneous big data and a control method thereof. The information acquisition system comprises an internet information source, a Linux background service side system, a Web client side program system and a client terminal, the internet information source, the Linux background service side system, the Web client side program system and the client terminal are connected in sequence, the Linux background service side system comprises a heterogeneous information acquiring and preprocessing module, an extracting rule generating module and an information extracting evaluation module, and the heterogeneous information acquiring and preprocessing module comprises a crawler URL parser, a PDF parser, a searching engine searcher, an HTML parser and a data storage. A heterogeneous document of a financial product can be adopted in real time, data interested by a user is extracted from the heterogeneous document, the effectiveness of the provided financial data is ensured, and the problem that heterogeneous information in the traditional finance field is inconvenient to acquire is solved.

Description

technical field [0001] The invention relates to the technical field of information collection systems, in particular to an information collection system based on financial heterogeneous big data. Background technique [0002] With the development of information technology, there are more and more financial activities on the Internet. In the financial field, a large amount of information is released through the Internet at all times. Due to the huge information beam of the network itself, the unfixed source of information, and the obvious characteristics of textual expression, and the current financial information on the Internet is still released in half a day. Structured form prevails. Compared with structured data, although these heterogeneous information are easy to publish and collect, they have high noise, large information redundancy, and are not easy to read and understand. Therefore, effective information extraction becomes crucial. Contents of the invention [0...

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to solve the problems of high noise, large amount of information redundancy and inconvenient reading and understanding in the existing financial field information collection, and propose an information collection system and its control method based on financial heterogeneous big data

Images