Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A crawler technology based on blockchain system

A crawler technology and blockchain technology, applied in the direction of transmission system, network data index, other database retrieval, etc., to achieve the effect of lowering the threshold

Active Publication Date: 2021-09-17
扬州杜罗新研网络科技有限公司
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

To sum up, the shortcomings of the existing technology: the existing web crawler technology itself is aimed at the Http / Https protocol, and crawls the website information resources, and the website resources often use a centralized network structure, which can be accessed through the network. address to access; in the blockchain, the network structure is a decentralized point-to-point network, and the communication protocols used in the network include Http / Https but are not limited to

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0014] The content of the present invention will be described below in conjunction with specific embodiments.

[0015] Example method:

[0016] Operation 1: Add a public key open node to the existing nodes of the blockchain, which is only open to trusted crawlers;

[0017] Operation 2: When the blockchain node is started, it needs to actively register with the nearest public key open node; at the same time, the public key open node will also initiate registration work notifications to the entire network from time to time, and give priority to the registered nodes;

[0018] Operation 3: When the crawler is started, it will request verification from the public key open node according to the configuration. After passing the verification and approval, it can download the public key information stored by some nodes from the node;

[0019] Operation 4: The crawler program searches according to the message information clues in the block header data, and decrypts the encrypted data i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a crawler technology based on a block chain system, and the steps are as follows: step 1: in the block chain network, on the existing nodes, an open public key node is added; step 2: when the block chain system After the node is started, it can visit nearby public key open nodes according to its own startup configuration, and register public key information with it; Step 3: When the crawler starts, it first looks for nearby public key nodes, and downloads the cached public key node information; step 4: Crawl data according to the clue information; Step 5: The crawler in the system uses the flood algorithm to process the crawling of nodes, and sets the corresponding value of TTL. When crawling in depth according to the clue information, if the TTL setting If it is a value, the crawling of the thread is terminated. The present invention is mainly used in the block chain system, greatly exerts the storage characteristics of the block chain, and is beneficial to the development of the block chain application.

Description

technical field [0001] The invention relates to a crawler technology based on a blockchain system, which belongs to the technical field of the Internet. Background technique [0002] In the blockchain system, data can be stored in the block header and block body, and each node in the blockchain system can be regarded as an independently running environment and individual, which has an independent network address, The operating system, memory required for operation, computing resources, etc.; at the same time, the data stored in the block header is generally abstract and descriptive, and the data stored in the block body is often encrypted by public and private keys; Nodes perform consensus calculations through continuous interactive calculations. Each node participating in blockchain consensus calculations can have relevant data, so there is a large amount of duplicate data in the blockchain network; since the blockchain is In a decentralized distributed network, there is a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/06H04L29/08G06F16/953G06F16/951
CPCH04L63/0442H04L67/02H04L67/10H04L69/26
Inventor 梅一多孙昊马敬东朱晓庆
Owner 扬州杜罗新研网络科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com