Predictive table pre-joins in large scale data management system using graph community detection

A pre-connection and community technology, applied in the field of prediction table pre-connection using graph community monitoring in large-scale data management systems, can solve problems such as poor performance

Active Publication Date: 2019-10-18
HUAWEI TECH CO LTD
View PDF6 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Traditional database pre-join techniques perform poorly when the number of tables increases significantly

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Predictive table pre-joins in large scale data management system using graph community detection
  • Predictive table pre-joins in large scale data management system using graph community detection
  • Predictive table pre-joins in large scale data management system using graph community detection

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037]The automatically repeated update graph of tables and table reference operations are connected to the corresponding one or more tables to perform a periodically repeated or event-triggered graph group detection process. Table reference operation density and / or urgency may indicate which tables are considered to be the most "important" (high weighted) and therefore, prioritized for high-speed storage. Likewise, table reference operation density and / or urgency can indicate which tables are considered generally "important" (slightly lower weighted) and thus, prioritized for storage with slower access speeds (slower storage is generally less expensive) low), and the indication may indicate which tables are considered to be the least "important" (lowest weighted) and therefore, preferentially not placed in storage reserved for preloading precomputed and / or prestored results.

[0038] The process is not as simple as determining the importance of each table individually or base...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A computer-implemented method for identifying pre-join operations, when accessing a database of relational tables, based on a usage history and/or a priority needs, comprises creating a graph of weighted edges and nodes, the nodes represent relational tables and edges represent join operations to be performed on the tables, partitioning the graph into a plurality of graph communities based on graph community densities, with a density indicating a number of edges touching a particular node, with the number of edges being greater than a predetermined edge number threshold, with each edge furtherincluding an edge weight indicative of a frequency of referencing within a predetermined recent duration of time and/or indicative of urgency of quick access to the corresponding join result within apredetermined recent duration of time, and generating pre-join results based on the partitioned graph communities and graph community densities.

Description

[0001] cross application [0002] This application claims priority to U.S. Nonprovisional Application No. 15 / 470,813, filed March 27, 2017, entitled "Predictive Table Pre-Joins in Large-Scale Data Management Systems Utilizing Graph Community Monitoring." Large Scale Data Management System Using Graph Community Detection), which in turn claims priority to U.S. Provisional Patent Application No. 62 / 435,606, filed December 16, 2016, entitled "Using Graph Community Detection in Large Scale Data Management Systems Predictive Table Pre-Joins in Large Scale Data Management System Using Graph Community Detection", the entire contents of these two patent applications are incorporated herein by reference. Background technique [0003] Large-scale data mining, sometimes referred to as 'big data', typically requires the maintenance of massive enterprise-scale databases in real time and the use of numerous data analysis programs to extract current meaningful information from the databases....

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2453
CPCG06F16/24544G06F16/9024G06F16/9038G06F16/24554G06F16/2453G06F16/2282
Inventor 夏应龙梁定裕
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap