Data acquisition and verification method and device, electronic equipment and storage medium

Abstract

The invention discloses a data acquisition and verification method, which comprises the steps of configuring access information of to-be-accessed data according to a preset interface configuration rule, the interface configuration rule comprising a corresponding relationship between the to-be-accessed data and the access information; generating a plurality of to-be-acquired data items in the dataacquisition queue according to the access information; and respectively verifying the acquired data files corresponding to the plurality of to-be-acquired data items to obtain a plurality of verifiedtarget acquired data. By implementing the scheme, access information is configured for all to-be-accessed data in an interface configuration mode; the access difficulty of the to-be-accessed data is reduced; a plurality of to-be-acquired data items corresponding to the to-be-accessed data are generated according to the access information, all to-be-accessed data are integrated, in addition, the to-be-acquired data items are verified by utilizing the access information respectively to obtain multiple pieces of verified target acquisition data, distributed management of the access data is achieved, the management efficiency of an access task is improved, and the reliability of the access data is ensured.

Description

technical field [0001] The invention relates to the technical field of data collection, in particular to a data collection and verification method, device, electronic equipment and storage medium. Background technique [0002] With the development of Internet technologies such as big data and cloud computing, relevant data information can be obtained through terminal search services, and data sharing or acquisition can be realized, which brings great convenience to users and enterprises. Since the search service is highly dependent on content data, it is first necessary to access a large amount of CP (Content Provider) service content data for processing, so that subsequent search services can perform searches and present results. [0003] The CP data access method of the related technology is through the access form of customized service data, that is, each CP data does not provide an interface, and it is accessed in the form of a single service, and the data interface cann...

AI Technical Summary

Problems solved by technology

[0004] This application provides a data collection and verification method, device, electronic equipment and storage medium, which can solve the technical problems that the data interface cannot access multiple content data, resulting in high difficulty in data access and low management efficiency of access tasks

Images