Token acquisition method, data acquisition system, proxy server and storage medium

A proxy server and acquisition method technology, applied in the field of data collection, can solve the problems of token difficulty, increase the difficulty of data crawling, and cannot simulate login acquisition.

Pending Publication Date: 2019-12-27
深圳市小赢信息技术有限责任公司
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The inventor found that there are at least the following problems in related technologies: some special tokens cannot be obtained through simulated login with account passwords. It is not public, it is difficult to understand its encryption algorithm, and encryption generally requires the use of a key, so it is very difficult to generate the correct token, which greatly increases the difficulty of data crawling

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Token acquisition method, data acquisition system, proxy server and storage medium
  • Token acquisition method, data acquisition system, proxy server and storage medium
  • Token acquisition method, data acquisition system, proxy server and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention more clear, various implementation modes of the present invention will be described in detail below in conjunction with the accompanying drawings. However, those of ordinary skill in the art can understand that in each implementation manner of the present invention, many technical details are proposed in order to enable readers to better understand the present invention. However, even without these technical details and various changes and modifications based on the following implementation modes, the technical solution claimed in the present invention can also be realized.

[0032] The first embodiment of the present invention relates to a token acquisition method, which is applied to such as figure 1 Shown is a proxy server 200 in the data collection system. The data collection system also includes a client 100 , a crawler server 400 and at least one target se...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention relates to the technical field of data acquisition, and discloses a token acquisition method, a data acquisition system, a proxy server and a storage medium. The methodis applied to a proxy server, a client communicates with at least one target server through the proxy server, the target server generates a token when the client requests service from the target server, the token is returned to the client through the proxy server, and the method comprises the steps that the token returned to the client by the target server is obtained through analysis; and sending the token to a crawler server, so that the crawler server crawls data from the corresponding target server according to the token. According to the embodiment of the invention, the token is acquiredthrough the proxy server, so that the token acquisition difficulty is greatly reduced, and data acquisition can be conveniently and effectively realized.

Description

technical field [0001] The invention relates to the technical field of data collection, in particular to a token acquisition method, a data collection system, a proxy server and a storage medium. Background technique [0002] Token (token) is a key used to identify the identity of the user to realize the communication between the customer service end and the server end. It is a string of strings generated by the server end as an identification of the client requesting service. When the user logs in for the first time, the server generates a token and returns the token to the client. In the future, the client only needs to carry the token to request data without carrying the user name and password again, thus playing a role of security and confidentiality. [0003] Crawler service is an important data collection method. With the advent of the era of big data, the application of crawler service will become more and more extensive, and it can provide various data intelligence f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L9/32H04L29/06H04L29/08G06F16/951
CPCH04L9/3213H04L63/0807G06F16/951H04L67/02H04L67/56
Inventor 陈国锋梁大钊胡郎平
Owner 深圳市小赢信息技术有限责任公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap