A method and system for merging and turning pages of distributed search results based on sampling

A technology for distributed search and search results, applied in the field of the problem of merging pages of distributed search results, can solve the problems of large network bandwidth and computing consumption, and achieve the effect of reducing network bandwidth, reducing computing consumption, and ensuring efficiency

Active Publication Date: 2016-03-23
FOCUS TECH
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In order to solve the above problems, the present invention designs a method and system for merging and turning pages of distributed search results based on sampling, which aims to significantly reduce the problems of large network bandwidth and computational consumption in the process of merging and turning distributed search results , and the present invention can also be improved and applied to result merging and page turning of other distributed query systems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and system for merging and turning pages of distributed search results based on sampling
  • A method and system for merging and turning pages of distributed search results based on sampling
  • A method and system for merging and turning pages of distributed search results based on sampling

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be described in detail below with reference to the accompanying drawings and specific embodiments.

[0042] like figure 1 As shown, it is the system structure of the embodiment of the present invention. For the convenience of description, it is assumed that the index file data is divided into two slices in this embodiment, which are respectively deployed on two shard-search servers, including:

[0043] A gatherserver101 with built-in TopSamplesFetcher102, TopSamplesMerger103, ApproximateStartPointsCalculator104, PageFetcher105, PageMerger106 components; two slice search servers shard1-searchserver107, shard1-searchserver112, of which shard1-searchserver107 built-in TopSampler108, ​​TopSearcher109, TopResultTmpCache110, PageGetter110 The slice server shard2-searchserver112 has built-in TopSampler113, TopSearcher114, TopResultTmpCache115, and Pa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed type search result gathering and page turning method and system based on sampling. The distributed type search result gathering and page turning method and system can obviously solve the problem that network bandwidth and calculation consumption are large in a distributed type search result gathering and page turning process. Meanwhile, the distributed type search result gathering and page turning method and system can be improved to be applied to result gathering and page turning of other distributed type inquiring systems. The technical scheme is that index data are sliced to form index file slices to be distributed into shard-search servers to finish initializing index files, and search result gathering nodes receive gathering and page turning requests of an external system to carry out the specific steps of distributed search result gathering and page turning.

Description

technical field [0001] The invention belongs to the technical field of massive data processing, and in particular relates to a method and a system for the problem of merging and turning pages of distributed search results. Background technique [0002] The emergence of e-commerce platforms (B2B, B2C, etc.) has greatly facilitated people's lives. When people rely more and more on these platforms, they also put forward higher requirements on the platforms themselves: for example, transactions on Taobao, Jingdong, etc. On the platform, people hope to find the products they need more, faster and more accurately; for e-commerce companies, to meet these requirements of people, they usually need an efficient and accurate mass search at the technical level system. Due to the huge and rapid growth of retrieval data, traditional centralized search systems have become increasingly incapable of retrieval tasks on large e-commerce platforms. [0003] With the development of distributed...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
CPCG06F16/2228G06F16/24552G06F16/2471G06F16/248
Inventor 梁峰
Owner FOCUS TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products