Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

An efficient organization and management method of massive spatio-temporal data

A technology of spatiotemporal data and management methods, which is applied in electronic digital data processing, special data processing applications, structured data retrieval, etc. Bearing high concurrent access and other issues

Inactive Publication Date: 2019-01-04
GEOVIS CO LTD
View PDF7 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, high-intensity data storage management, high-performance computing, high-concurrent access, and high-intensity application technologies have weak support for big data. Storage applications and sharing cannot provide powerful geospatial analysis and computing services, and the scalability is weak. Bearing the pressure of high concurrent access, the application support ability is weak, and it cannot carry richer applications
[0004] However, the different storage methods of multi-source heterogeneous spatio-temporal data make management inconvenient; local (remote) files, management databases and other storage methods are mixed, making it difficult to perform unified and automated management, such as backup, security, data output and retrieval etc.; structured and unstructured data are often stored separately and in different ways, and the semantics, syntax, and capabilities of different spatial databases and file formats vary widely, which increases the difficulty of application development; under high concurrency, centralized data storage is Bottleneck, and the centralized storage method is likely to cause a sharp drop in application performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An efficient organization and management method of massive spatio-temporal data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0019] Such as figure 1 An efficient organization and management method for massive spatio-temporal data is shown. The overall steps of the method are as follows:

[0020] Step 1. Data upload:

[0021] For large concurrency, multi-source heterogeneous spatio-temporal information data with multiple and complex characteristics, the service center is used to store and manage the data, and the data center uploads the data through a unified data import interface; first select the data to be managed, calculate The hash value of the data, (the hash value is a unique and extremely compact numerical representation of a piece of data) compares the calculated hash value with the hash value in the data center, and if there is the same hash value, it proves the same If the data already exists in the data center, you only need to copy the real da...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an efficient organization and management method of massive spatio-temporal data. The overall steps of the method are as follows: step 1, uploading data; 2, data processing; 3,data storage; 4, dynamically dividing the spatial data into blocks; a, constructing a vector data Key-Value data model; B. HDFS vector data being stored in blocks. The invention aims at the information access safety in the large concurrent access, high concurrency access, multi-source heterogeneous spatio-temporal information fusion storage and updating, performs research on cloud-based solutions,to realize the effective integrated management of massive heterogeneous data and improve the distribution, access and operation performance of spatial data in the distributed environment, at the sametime, the technology of GIS data distributed dynamic partition is studied to optimize the distribution efficiency of GIS service engine, and to meet the smart city geospatial data efficient storage management and sharing distribution.

Description

technical field [0001] The invention relates to an efficient organization and management method, in particular to an efficient organization and management method for massive spatio-temporal data. Background technique [0002] In recent years, the rapid development of geospatial information technology has provided massive data sources for GIS (Geographic Information System). With the rapid expansion of the amount of spatial data and the deepening of people's dependence on spatial information, the contradiction between the characteristics of spatial information such as large data volume, complex structure, distributed heterogeneous storage and the acquisition efficiency of spatial data entities and their processing functions Increasingly prominent, the service of GIS functions and the intelligence of data and function acquisition provide a feasible idea for solving this contradiction. [0003] At present, high-intensity data storage management, high-performance computing, hig...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/182G06F16/13G06F16/27G06F16/909
Inventor 付琨巩志远齐红超李博
Owner GEOVIS CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products