A method and device for integrated processing of graph index flow and batch

A processing method and index technology, applied in the field of graph computing, can solve problems such as high network overhead and increase the complexity of business systems, and achieve the effect of reducing time cost, fast processing, and reducing processing time

Active Publication Date: 2021-06-18
南京冰鉴信息科技有限公司
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The first request is to obtain all input data combinations and cache them inside the business system, which may increase the complexity of the business system
When the graph database instance calculates the graph index, it will obtain the data participating in the calculation from the underlying distributed storage system, which may lead to large network overhead and some uncontrollable emergencies

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and device for integrated processing of graph index flow and batch
  • A method and device for integrated processing of graph index flow and batch

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.

[0044] Please refer to figure 1 , is a schematic flow chart of a method for integrated processing of graph index flow and batch provided by an embodiment of the present invention. Further, the method for integrated processing of graph index flow and batch may specifically include the content described in the following steps S21-Step S25.

[0045] Step S21, obtaining the edge table and t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A method and device for integrated processing of graph index flow batches according to the present application obtain edge table and point table according to the whole graph data and store them in the Hive database, input the edge table and point table into the calculation model to generate the first connected graph, and Input the edge table, point table and the first connected graph into the preset program to obtain the underlying file of the graph database, call the calculation model of the graph index and the parameter combination of the parameter list, and search for the target data matching the parameter combination in the underlying file of the graph database, According to the calculation model, calculate the graph index of the target data to obtain the graph index calculation result, and store the graph index calculation result into Hbase by calling the HBase API. Splitting the whole graph data to get the data of different connected graphs accurately generates different underlying files of the graph database. When calculating indicators, it is not necessary to pull data across the network. The performance is higher and the calculation results can be accurately stored.

Description

technical field [0001] The present application relates to the technical field of graph computing, and in particular to a method and device for integrated processing of graph index flow and batch. Background technique [0002] In the related graph index processing technology, for the calculation of each graph index, the business system needs to initiate two requests to the computing service. The first request is to obtain all input data combinations and cache them inside the business system, which may increase the complexity of the business system. When calculating graph indicators in a graph database instance, the data involved in the calculation will be obtained from the underlying distributed storage system, which may lead to large network overhead and some uncontrollable emergencies. Contents of the invention [0003] The present application provides a method and device for integrated processing of graph index flow and batch, so as to improve the above-mentioned techni...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/22G06F16/901G06F16/174G06F16/182
CPCG06F16/1744G06F16/182G06F16/2282G06F16/9024
Inventor 顾凌云郭志攀王伟张晓丰
Owner 南京冰鉴信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap