Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Spatial data conversion method based on distributed architecture

A distributed architecture and spatial data technology, applied in the field of spatial data, can solve problems such as performance bottlenecks, low efficiency, and time-consuming problems, and achieve the effect of simple application and simple operation

Pending Publication Date: 2021-01-08
SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Moreover, there is a demand for spatial data exchange and sharing among various departments. Spatial data is mainly exchanged in the form of shapefiles. However, as the amount of GIS data increases, traditional GIS tools encounter performance bottlenecks when processing spatial data.
It takes a long time to import a large amount of spatial data stored in the SDE database into a shapefile, and the efficiency is relatively low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0032] This embodiment proposes a spatial data conversion method based on a distributed architecture, and its implementation process is as follows:

[0033] (1) First, based on the open-source nifi and kafka technologies, the B / S architecture is adopted to deploy the spatial data in a distributed cluster.

[0034] The spatial data described in this embodiment comes from any GIS platform of arcgis, supermap and mapgis.

[0035] (2) Subsequently, access the server with spatial data deployed through the browser, and perform the following operations:

[0036] (1) Define evaluation rules, and check the quality of spatial data through evaluation rules.

[0037] The evaluation rules defined in this embodiment include three aspects: topology rules, coding rules and metadata, among which:

[0038] Topology rules require that there can be no hanging points, no overlaps, and no intersections. When evaluating spatial data according to topology rules, it is necessary to perform correspon...

Embodiment 2

[0050] On the basis of the structure of the first embodiment, this embodiment proposes a spatial data conversion method based on a distributed architecture, which includes a task monitoring module for monitoring the progress of steps (2) and (3).

[0051] The task monitoring module, on the one hand, monitors and reports errors in real time during the process of accessing servers and nifi processors deployed with spatial data, and obtains the execution time, execution results, and storage directory of shapefiles from spatial data in the SDE database on the other hand .

[0052] In summary, it can be seen that the spatial data conversion method based on the distributed architecture of the present invention can quickly and conveniently export the spatial data from the SDE database and convert it into a shapefile file, and filter and convert the data during the export process And quality assessment, to solve the problem that existing GIS tools take a long time to import spatial da...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a spatial data conversion method based on a distributed architecture, and relates to the technical field of data processing, and the method comprises the steps: firstly, carrying out the distributed cluster deployment of spatial data based on an open-source nifi and kafka technology through employing a B / S architecture; then, accessing a server deployed with spatial data through a browser, and executing the following operations: on a task management page, creating a task based on the spatial data, on a task list, selecting a task to be scheduled, on a task scheduling page, starting the selected task, calling a nifi data flow template, creating a nifi task, and transmitting the spatial data to a nifi processor; and finally, enabling the nifi processor to create database connection, and split the data processing task, enabling the kafka processor to distribute the task, and enabling the nifi processor concurrently to execute the data processing task and quality evaluation to realize quick conversion of spatial data. According to the invention, the spatial data can be quickly and conveniently exported from the SDE database and converted into the shapefile, so that the processing efficiency of the spatial data is improved.

Description

technical field [0001] The invention relates to the technical field of spatial data, in particular to a spatial data conversion method based on a distributed architecture. Background technique [0002] Spatial data refers to the data used to represent the position, shape, size and distribution characteristics of spatial entities. It is a kind of basic spatial data structures such as points, lines, planes and entities to represent the natural world on which people live. It can be used to describe objects from the real world with properties such as location, qualitative, temporal and spatial relationships. [0003] With the country's emphasis on informatization and the development of data in China, GIS (Geographic Information System), as a data analysis, two-dimensional and three-dimensional visual display of data, has been widely used in the fields of land, water conservancy, transportation, agriculture, and smart cities. Auxiliary support for decision planning. Moreover, t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F16/29G06F16/909H04L29/08
CPCG06F16/258G06F16/29H04L67/10G06F16/909
Inventor 曲建龙宋海涛周明魏存挡王善美
Owner SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com