Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

APP data acquisition method and system

A technology for data acquisition and task data, applied in the computer field

Pending Publication Date: 2020-09-01
BEIJING GEHUA CATV NETWORK CO LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, traditional crawlers cannot crawl these data resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • APP data acquisition method and system
  • APP data acquisition method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] In order to make the technical problems solved by the present invention, the technical solutions adopted and the technical effects achieved clearer, the technical solutions of the embodiments of the present invention will be further described in detail below in conjunction with the accompanying drawings. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0031] refer to figure 1 , figure 1 It is a schematic flowchart of an APP data acquisition method. A method for obtaining APP data provided by this application includes the following steps:

[0032] Step 101: Obtain the keyword of the user task data and the entry address of the target APP.

[0033] The user's task data can be common informat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an APP data acquisition method and system. The method comprises the following steps: (1) acquiring a keyword of user task data and an entry address of a target APP; (2) creatinga headless browser, carrying basic information required by authentication to initiate an http request, and accessing an APP entry address; (3) judging whether task data exists in the skipped displaypage or not according to the keyword, and if yes, generating a crawler script according to the request address and the parent-child level relationship in combination with a default crawler script template; and (4) automatically and periodically executing the crawler script to obtain task data. According to the APP data acquisition method and system provided by the invention, all pages or requestsof the APP can be automatically and deeply traversed according to the entry address of the APP, the to-be-acquired data is searched, the concise script is generated, and the successful script is periodically executed to acquire the required information.

Description

technical field [0001] The invention belongs to the technical field of computers, and in particular relates to an APP data acquisition method and system. Background technique [0002] A crawler is a program that automatically extracts web pages. It downloads web pages from the World Wide Web for search engines and is an important part of search engines. Traditional crawlers start from the URL of one or more initial webpages, and obtain the URLs on the initial webpage. During the process of crawling webpages, they continuously extract new URLs from the current page and put them into the queue until certain stop conditions are met. It can be seen that traditional crawlers crawl data based on URLs, but a large number of data resources are stored in APPs. [0003] Furthermore, some of the data resources in the APP in the prior art are all from the server, and some are only core data from the server, and then rendered by the APP to the UI interface for presentation. Therefore, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/951G06F16/955
CPCG06F16/951G06F16/9566
Inventor 邹海川纪军张婷
Owner BEIJING GEHUA CATV NETWORK CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com