Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Mass data information index system and index construction method

A technology of massive data and indexing system, which is applied in the field of massive data information indexing system and index construction, can solve the problems of insufficient retrieval server resources and difficulty in repairing, and achieves the goal of improving retrieval efficiency, reducing maintenance and use costs, and facilitating maintenance. Effect

Active Publication Date: 2016-02-03
CENTRIN DATA SYST +1
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Therefore, what the present invention is to solve is the technical problem of insufficient search server resources and difficult repair caused by the execution of the index function in one or more index servers, and provides a massive data information index system and index construction method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mass data information index system and index construction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] see figure 1 Shown is a massive data information indexing system according to an embodiment of the present invention, including a cluster of data distribution servers, including two data distribution servers 1, for splitting and distributing the data to be created to a data index creation server 2;

[0037] Create a data index server cluster, including four create data index servers 2, receive the data distributed by the data distribution server 1 and create an inverted index for the data; wherein, the inverted index is derived from the value of the attribute that needs to be used in practical applications To find records, each item in this index table includes an attribute value and each record address with the attribute value, because the attribute value is not determined by the record, but the location of the record is determined by the value of the attribute, so is the inverted index;

[0038] The retrieval server cluster includes four retrieval servers 3, which re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a mass data information indexing system and a construction method. The system comprises a data distribution server fleet, a construction data indexing server fleet, an indexing server fleet and a combination indexing result server fleet. The data distribution server fleet comprises a plurality of data distribution servers and is used for splitting data requiring to be constructed and distributing the data to construction data indexing servers. The construction data indexing server fleet comprises a plurality of construction data indexing servers and is used for receiving data distributed by the data distribution servers and constructing indexes for the data. The indexing server fleet comprises a plurality of indexing servers and is used for receiving indexes constructed by the construction data indexing servers and indexing the data indexes. The combination indexing result server fleet comprises a plurality of combination indexing result servers and is used for receiving indexing conditions and receiving and combining results indexed by the indexing servers. The system distributes the servers according to functions required to be finished in the indexing process to avoid resource robbing. Error servers can be quickly located according to error reasons in the indexing process once errors happen. The system is convenient to maintain and reduces maintenance and using cost.

Description

technical field [0001] The invention relates to a data index system and a construction method, in particular to a massive data information index system and an index construction method. Background technique [0002] With the advancement and development of technology, the amount of data is increasing, especially with the emergence of the cloud concept, the amount of centralized data is even greater. In order to quickly find the specific data you need in the vast amount of data, indexing is of great significance. [0003] Chinese patent document CN101576915B discloses a distributed B+ tree index system and construction method, specifically, it includes a main server, a transaction server cluster, an index service cluster and a version control server; the transaction server cluster includes multiple transaction servers, and the index server cluster includes multiple transaction servers. index server; the master server is responsible for managing META data and performing load b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 安旭叶嘉明陈德全
Owner CENTRIN DATA SYST
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products