Website data anti-scrabbling method, device and equipment and storage medium

Abstract

The invention relates to a website data anti-scrabbling method, device and equipment and a storage medium, and is applied to the field of data anti-scrabbling, and the method comprises the steps that to-be-processed website information is acquired, and the website information comprises webpage content in a website page; randomly extracting characters from a preset character database, and constructing a mapping relation between the webpage content and the characters to form a character relation file; when a website front-end data acquisition request is received, acquiring interface information corresponding to the login request; comparing the interface information with pre-matched interface information; if the interface information is consistent with pre-matched interface information, outputting the webpage content; otherwise, confusing the webpage content according to the character relation file to generate a confused document, and outputting the confused document. The method and the device have the technical effects that the anti-scrabbling process is non-inductive to a normal user, and the influence of a website anti-scrabbling mechanism on real user operation is reduced.

Description

technical field [0001] The present application relates to the technical field of data anti-pickup, in particular to a website data anti-pickup method, device, equipment and storage medium. Background technique [0002] A web crawler is a program or script that automatically grabs Internet information according to certain rules. According to the crawler survey report released by AberdeenGroup based on the data of hundreds of companies in North America, real people only account for 54.4% of the total traffic, and the remaining traffic consists of 27% friendly crawlers and 18.6% malicious crawlers. [0003] From the perspective of website business security, while crawlers bring considerable traffic to the website, they also bring immeasurable threats and losses. For example, malicious crawlers can lead to crawling of the core text of the website, scanning of registered user information, and increased bandwidth burden on the website; therefore, in order to improve the security ...

AI Technical Summary

Problems solved by technology

[0003] From the perspective of website business security, while crawlers bring considerable traffic to the website, they also bring immeasurable threats and losses

For example, malicious crawlers can lead to crawling of the core text of the website, scanning of registered user information, and increased bandwidth burden on the website; therefore, in order to improve the security of website data, it is necessary to set up an anti-pickup mechanism to reduce the situation that website data is stolen by crawlers

[0004] The key point of the website anti-pickup mechanism is to identify whether the operator is a user or a crawler. It is necessary to avoid affecting the operation of the real user on the basis of identifying the crawler. However, the related technologies adopt limiting the number of user visits, adding image verification code verification and text messages. Anti-cheat methods such as verification code verification have problems affecting real user operations

Images