Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Grid data copy generation method based on time and space limitation

A spatial locality and grid data technology, applied in the field of data management in a distributed environment, can solve problems such as increasing data access delay and bandwidth consumption, reducing grid system fault tolerance, and limited node storage capacity

Inactive Publication Date: 2009-01-07
NANJING UNIV OF POSTS & TELECOMM
View PDF0 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The number of data copies is affected by many factors: the storage capacity of the nodes in the grid is limited. Compared with the massive data in some applications, the storage capacity of most nodes is relatively weak, and the capacity that can store data is limited, which limits the data The number of copies of the data; the increase in the number of copies of data will inevitably increase the difficulty of maintaining the consistency of data copies; the frequency and mode of use of different data in the grid are almost completely different, and the use of the same number of copies of different data cannot meet the respective requirements of these data. Copy requirements; too few data copies will inevitably increase the delay of data access and bandwidth consumption, while reducing the fault tolerance of the grid system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Grid data copy generation method based on time and space limitation
  • Grid data copy generation method based on time and space limitation
  • Grid data copy generation method based on time and space limitation

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment approach

[0075] The collection of data to be managed in the grid {D 1 ,D 2 ,...,D n }, the set of nodes with storage capability {X 1 , X 2 ,...,X m }. At the same time, the data access sequences (S 1 , S 2 ,...,S k ). Then its specific implementation is as follows:

[0076] (1) Access sequence S to user t t (0≤t≤k), calculate the access distance of each access in the sequence in turn, and add its value to the data D of this access j (0≤j≤n) set of access distances Dis(D j )middle;

[0077] (2) For each data D j (0≤j≤n) access distance set Dis(D j ) according to the interval [2 i-1 ,2 i ) for grouping (except 0 and ∞), count the number of visits that occur in each group (3) From the data set {D 1 ,D 2 ,...,D n } choose two D p and D q (0≤p≤n, 0≤q≤n, p≠q), calculate their and Thus calculating Diff(D p ,D q ) value;

[0078] (4) Establish a neighboring relationship graph G=(V, E), where the vertex set V is the data set {D 1 ,D...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A grid data transcription generation method which is based on time and spatial locality is the method for determining the number of data transcriptions in a grid and the distribution thereof on grid nodes based on behavioral characteristics of data access of a grid user, therefore, the method of the generation of the data transcriptions is carried out. The method determines the number of the data transcriptions in the grid and the distribution thereof on the grid nodes based on the behavioral characteristics of the data access of the grid user. The basic idea is to utilize the time locality distribution of the user access data to obtain the spatial locality among the data in the grid, then the number of the data transcriptions and the distribution principles are determined based on the spatial locality, and the various transcriptions of the data are further replicated and distributed. Therefore, the number of the transcriptions needed by the data and the distribution method of the transcriptions can be obtained according to the grouping situation of the data on a neighboring relationship diagram, thereby utilizing less number of the transcriptions and the effective distribution of the transcriptions to achieve the delay of the data access in the grid and to reduce the network bandwidth consumption.

Description

technical field [0001] The invention is a solution to the problem of data copy generation in the grid, mainly used to solve the problem of data copy generation in the grid, especially in the data grid, and belongs to the field of data management in a distributed environment. Background technique [0002] Since the 1990s, with the rapid development of Internet technology, in order to solve the problem of high-performance resource sharing and collaborative solution in the network virtual environment, Grid (Grid) technology came into being and has been widely used. At present, various countries have established many grids for various applications. In China alone, multiple grids such as China National Grid, 973 Semantic Grid, 863 Grid, Shanghai Grid, and Vega Grid have been established. . Grid, a new type of distributed computing infrastructure, has been widely used in a variety of major applied research issues, and has become a national strategic infrastructure for high-perfor...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L29/08
Inventor 王汝传付雄任勋益邓松季一木易侃杨明慧
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products