Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Method and apparatus for processing network resource address URL

A technology of network resource addresses and processing methods, which is applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of inaccurate de-duplication operation results, low efficiency of URL statistics, etc., and achieve quantity reduction and high accuracy , Improve the effect of deduplication accuracy

Active Publication Date: 2017-06-13
ALIBABA GRP HLDG LTD
View PDF4 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0016] The embodiment of the present application provides a method and device for processing URLs of network resource addresses, so as to at least solve the technical problem of inaccurate URL deduplication results resulting in low efficiency of URL statistics

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and apparatus for processing network resource address URL
  • Method and apparatus for processing network resource address URL
  • Method and apparatus for processing network resource address URL

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0035] According to the embodiment of the present application, a method embodiment of a method for processing a network resource address URL is also provided. It should be noted that the steps shown in the flow chart of the accompanying drawings can be implemented in a computer system such as a set of computer-executable instructions and, although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown or described herein.

[0036] The method embodiments provided in the embodiments of the present application may be executed in mobile terminals, computer terminals or similar computing devices. Take running on a computer terminal as an example, figure 2 It is a network environment diagram of a terminal applying a method for processing a network resource address URL according to an embodiment of the present application. Such as figure 2 As shown, the terminal 10 can be connected to the serve...

Embodiment 2

[0114] According to an embodiment of the present application, there is also provided a processing device for implementing a network resource address URL, such as Figure 9 As shown, the device includes: a directory obtaining unit 95 , a filtering unit 97 and a statistical unit 99 . Optionally, it may further include: an address obtaining unit 91 and an address processing unit 93 .

[0115] Wherein, the address obtaining unit is used to obtain each network resource address URL in the website traffic table; the address processing unit is used to remove the parameters in each URL, obtain the interface address of each URL, and deduplicate the interface address of the URL, Obtain a plurality of interface addresses to be processed; a directory acquisition unit is used to obtain an interface directory to which each interface address belongs in a plurality of interface addresses to be processed, wherein the interface address information records the interface directory to which the int...

Embodiment 3

[0137] Embodiments of the present application may provide a computer terminal, and the computer terminal may be any computer terminal device in a group of computer terminals. Optionally, in this embodiment, the foregoing computer terminal may also be replaced with a terminal device such as a mobile terminal.

[0138] Optionally, in this embodiment, the foregoing computer terminal may be located in at least one network device among multiple network devices of the computer network.

[0139] Optionally, Figure 10 It is a structural block diagram of a computer terminal according to an embodiment of the present application. Such as Figure 10 As shown, the server or terminal includes: one or more (only one is shown in the figure) processors 201 , memory 203 , and transmission device 205 .

[0140] Wherein, the memory 203 can be used to store software programs and modules, such as the program instructions / modules corresponding to the processing method of the network resource add...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present application discloses a method and an apparatus for processing the network resource address URL. The method comprises: obtaining an interface directory including each interface address in a plurality of to-be-processed interface addresses, wherein the information of the interface address is recorded with the interface directory including the interface addresses; according to the preset filter condition, filtering the interface addresses based on the interface directory, and obtaining the filtered interface addresses; and colleting statistics of the filtered interface addresses. According to the method and apparatus disclosed by the present application, the technical problem of low efficiency in collecting statistics of the URL caused by the problem that the de-emphasis operation result to the URL is inaccurate is solved.

Description

technical field [0001] The present application relates to the field of data processing, and in particular, relates to a method and device for processing a network resource address URL. Background technique [0002] In the prior art, when dealing with a large amount of access logs, it is usually necessary to deduplicate and organize the URLs of network resources in the access logs, so as to identify and eliminate interfaces with no statistical value, and extract effective interfaces from them. For example, website A has billions of access logs every day, about 6000 after deduplication. Through the above scheme, for some types of vulnerabilities that scanners cannot support (such as horizontal authority vulnerabilities), after controlling the number of interface addresses to a certain number (such as the above-mentioned 6000), it can be covered by manual incremental confirmation. It is possible to investigate such vulnerabilities on a large scale. In addition, when a securit...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/9566
Inventor 王意林余成章李攀龙齐杨亮
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com