Professional intelligence information acquisition method, apparatus and device, and storage medium

Abstract

The invention provides a display box and a professional intelligence information acquisition method. The professional intelligence information acquisition method comprises the following steps of S01, reading a task plan; S02, performing data acquisition according to the task plan; S03, judging whether data acquisition succeeds or not; the invention also provides a professional intelligence information acquisition device, professional intelligence information acquisition equipment and a computer readable storage medium. According to the method, the required professional information is automatically collected according to the task plan, the collected professional information is subjected to standard formatting, and the file content is judged, so that repeated storage of the repeated content is avoided, and subsequent analysis is facilitated; meanwhile, the time and the human resource cost for manually collecting, analyzing and sorting professional intelligence data are effectively saved; repeated collection of repeated information is effectively reduced through URL duplicate removal, and the collection efficiency is further improved; and in addition, through targeted acquisition configuration setting, the success rate and accuracy of acquisition are improved.

Description

【Technical field】 [0001] The present application relates to the technical field of professional intelligence, in particular to a method for collecting professional intelligence information, and also relates to a device, equipment, and computer-readable storage medium for collecting professional intelligence information. 【Background technique】 [0002] With the development of the times and technology, the Internet has become an important channel for public information collection among newspapers, books, maps, audio-visual materials and many other sources of public information. The computer network has spread all over the world, and the Internet has been widely used in various fields such as politics, economy, and military. [0003] However, with the Internet, information is becoming more and more complex, and at the same time, it is becoming more and more difficult to obtain various materials. Most monitoring based on open source crawler technology on the Internet cannot com...

AI Technical Summary

Problems solved by technology

[0003] However, with the Internet, information is becoming more and more complicated, and at the same time, it is becoming more and more difficult to obtain various materials.

Most monitoring based on open source crawler technology on the Internet cannot comprehensively and correctly handle various websites with different styles and technologies on the Internet, especially AJAX websites, where it is easy to collect blank data, garbage data or non-target data , so when users use this type of system, if they add the target website by themselves, once they encounter a slightly more complicated one, they will not be able to add it successfully

Images