Method and device for updating index page

Abstract

The invention discloses a method for updating an index page, comprising the following steps of: reading the relevant information of an index page from an index page database according to a predetermined cycle, wherein the relevant information of the index page comprises any one or more of the Uniform Resource Locator (URL) of the index page, the page change probability of the index page within each predetermined time slot, the page fingerprint of the index page and the last updating time of the index page; determining whether the index page is needed to be updated at present according to the relevant information; and when the determination result is yes, updating the index page according to the relevant information. Accordingly, the invention also discloses a device for updating an index page. The method and the device of the invention, by updating the index page based on the probability and in different time slots, are capable of accurately predicting the change time points of the index page, reducing the updating time delay, improving the timeliness and enhancing the user experience.

Description

technical field [0001] The invention relates to the technical field of computer networks, in particular to an index page updating method and device. Background technique [0002] Web pages on the Internet are divided into index pages and information pages. Index pages refer to pages that continuously release new content (new links) on the website, such as: news channel homepage, sports channel homepage, forum page, blog log list page, etc. Information page refers to a page including text information, such as: a page opened by clicking a link on the home page of a news channel, a page opened by clicking a link on the home page of a sports channel, or a log opened by clicking a list on the blog log list page page etc. [0003] Search engine refers to the use of specific computer programs to collect information on the Internet according to certain strategies, organize and process the information, display the processed information to users, and provide users with retrieval ser...

AI Technical Summary

Problems solved by technology

For example: the homepage of most news channels changes quickly in the morning, but basically does not change at night. Using the existing scheme, since the page has not changed for a long time during the night, after multiple detections, the search engine will update the frequency of the homepage of this news channel. Lowered to a very low level, for example: it is updated only a few hours later, when the home page of this news channel is updated the next morning, there may have been a delay of several hours, and even the news released earlier may have been released from the news channel It was removed from the homepage of the website, and the search engine could not find the news, which caused a delay in updating, reduced the timeliness of the search engine's collection, and reduced the user experience;

[0009] 2. Consuming resources

As mentioned in 1, most index pages change frequently during the day and basically do not change at night; because frequent page changes are detected during the day, after multiple detections, the search engine will increase the update frequency of this index page to a high level, for example: It is updated every minute. At night, the index page is basically unchanged, but it will still be updated multiple times according to this frequency, which causes a waste of search engine resources and reduces the detection accuracy of the index page change time point.

Images