Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method and system for collecting and publishing network information

A technology for information collection and network information, applied in digital data information retrieval, special data processing applications, instruments, etc., can solve problems such as time-consuming and labor-intensive, low efficiency, save labor and time consumption, and improve publishing efficiency Effect

Inactive Publication Date: 2019-03-08
郑州市景安网络科技股份有限公司
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a method and system for network information collection and release, which is used to solve the problem that the traditional information collection, screening, and even release processes are mainly realized manually, which requires a lot of time and manpower, and is inefficient

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and system for collecting and publishing network information
  • A method and system for collecting and publishing network information
  • A method and system for collecting and publishing network information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] A kind of network information collection and publishing method provided by the present invention is introduced below, see figure 1 , embodiment one includes:

[0043] Step S101: Receive and analyze the information collection request sent by the user, and determine the keyword and data platform of the information to be collected.

[0044] Step S102: Collecting data from the data platform to obtain a plurality of keyword webpages including the keyword.

[0045] Step S103: Perform information capture on each of the keyword webpages to obtain multiple webpage contents.

[0046] Step S104: Calculate the originality of each item of the webpage content.

[0047] It should be noted that, in the present invention, the degree of originality is a parameter reflecting the originality of webpage content. The calculation process of the degree of originality is not the key point of the present invention, so it will not be described in detail. For example, when the content of the c...

Embodiment 2

[0052] Based on the above considerations, the present invention provides a second embodiment of a method for collecting and distributing network information. The second embodiment will be described below, see figure 2 , embodiment two mainly includes:

[0053]Step S201: Receive and analyze the information collection request sent by the user, and determine the keyword and data platform of the information to be collected.

[0054] Step S202: Create multiple collectors according to the keyword and the data platform, wherein each collector adopts a different user ID.

[0055] Wherein, the collector refers to a web crawler program written by a python program.

[0056] Step S203: Every preset time period, use multiple collectors to collect data on the data platform once, and obtain multiple keyword webpages containing the keyword.

[0057] Wherein, the grabber refers to a program written in java language to grab pages.

[0058] The preset time period can be determined by a timer...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention discloses a method for collecting and publishing network information, comprising receiving the information collection request sent by the user and analyzing the information, determining the keywords and data platform of the information to be collected, and then collecting data from the data platform to obtain a plurality of keyword webpages including keywords, and then grasping the webpage content of the keyword webpage, finally calculating the originality of each webpage content, and publishing the webpage content whose originality meets the preset conditions, so that bythis method, users only need to set keywords and data platforms and send out information collection requests, subsequently, the information including the keyword on the data platform can be automatically collected, and the information whose originality satisfies the preset conditions can be screened out for publication, thus avoiding the process of manual collection, screening and publication, saving the consumption of manpower and time, and greatly improving the efficiency of information collection and publication. In addition, the invention also provides a system for collecting and publishing the network information, the function of which corresponds to the function of the method.

Description

technical field [0001] The invention relates to the field of network information collection, in particular to a method and system for network information collection and distribution. Background technique [0002] Today, with the highly developed Internet, information is constantly expanding, forming massive amounts of data, covering all aspects of people. This contains a large amount of valuable data, but there are also many worthless data at the same time. Therefore, when collecting information, it is often necessary to screen out valuable information. [0003] The traditional process of information collection, screening, and even release is mainly realized manually. When the amount of data is large, it takes a lot of time and manpower, and the efficiency is low. Contents of the invention [0004] The purpose of the present invention is to provide a method and system for collecting and publishing network information, which is used to solve the problem that the traditiona...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/9535
Inventor 杨小龙
Owner 郑州市景安网络科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com