Anti-grabbing method and device, electronic equipment and storage medium

Abstract

The invention provides an anti-crawling method and device, electronic equipment and a storage medium. The method comprises the steps that after a flow layer receives a page access request, the page access request is sent to a service layer in response to the fact that the page access request does not hit a first interception strategy preset by the flow layer and does not hit a first interception list stored in the flow layer; and after the business layer receives a page access request, the first interception list is updated based on the page access request in response to a second interception strategy preset by the page access request hit business layer, so as to make the page access request with the same source as the page access request hit the first interception list. Therefore, the interception rate of the flow layer is improved, the data embezzlement condition is reduced, and the page access request entering the business layer is reduced, so that the performance loss of the business layer is reduced, and the condition that a machine for providing business service cannot be used due to overhigh load caused by overlarge flow consumed by crawling data is avoided, therefore, the stability is improved.

Description

technical field [0001] The invention relates to the technical field of computers, in particular to an anti-grabbing method, device, electronic equipment and storage medium. Background technique [0002] With the development of Internet technology, at present, various business services can already be realized through the Internet. On the webpage provided by business services, a lot of data will be displayed for users to browse, but there may be some abnormal browsing behaviors to crawl the data on the page, resulting in data theft, and the traffic consumed by crawling data Too many may directly cause the load of the machine providing business services to be too high to be used. Contents of the invention [0003] Embodiments of the present invention provide an anti-grabbing method, device, electronic equipment, and storage medium to solve problems in related technologies. [0004] The purpose of the present invention is achieved through the following technical solutions: ...

AI Technical Summary

Problems solved by technology

On the webpage provided by business services, a lot of data will be displayed for users to browse, but there may be some abnormal browsing behaviors to crawl the data on the page, resulting in data theft, and the traffic consumed by crawling data Too many may directly cause the load of the machine providing business services to be too high and unusable

Images