Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A system and method for parallel processing of multi-source remote sensing satellite data based on algorithm classification

A parallel processing and remote sensing satellite technology, applied in the field of satellite data processing and application, can solve the problem of unmatched satellite data types, satellite data processing algorithm data archiving and storage needs, low resource utilization, and poor scalability of satellite data comprehensive processing and application and other issues to achieve the effect of reducing data throughput bottlenecks, improving production efficiency, and reducing data migration

Active Publication Date: 2019-09-06
CHINA CENT FOR RESOURCES SATELLITE DATA & APPL
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The technical problem solved by the present invention is: to overcome the deficiencies of the existing technology, and provide a multi-source remote sensing satellite data parallel processing system and method based on algorithm classification, so as to solve the problem that the remote sensing satellite data processing system cannot match more and more complicated The types of satellite data, satellite data processing algorithms, and massive data archiving and storage requirements restrict the comprehensive processing and application of satellite data with poor scalability and low resource utilization, and realize the matching of massive satellite data and complex satellite data processing algorithms. Provide Capability of high-performance fast parallel computing of satellite data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A system and method for parallel processing of multi-source remote sensing satellite data based on algorithm classification
  • A system and method for parallel processing of multi-source remote sensing satellite data based on algorithm classification
  • A system and method for parallel processing of multi-source remote sensing satellite data based on algorithm classification

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0034] In view of the existing technology, the remote sensing satellite data processing system cannot match the increasingly complex satellite data types, satellite data processing algorithms, and massive data archiving and storage needs, which restricts the poor scalability and low resource utilization of satellite data integrated processing and applications. Shortcomings, the embodiments of this application implement matching massive satellite data, complex satellite data processing algorithms, and provide high-performance and fast parallel computing capabilities for satellite data.

[0035] Attached figure 1 The schematic diagram of the system framework further illustrates this embodiment. The method includes the following steps:

[0036] The algorithm registration module 101 supports new algorithm registration and stores and manages the registered algorithms. The main execution process of the new algorithm should not include human-computer interaction, and all parameters requir...

Embodiment 2

[0047] Based on the algorithm registration module 101 in the first embodiment supporting the registration of new algorithms, storing and managing the registered algorithms, and compiling the parameter list required by the algorithm in XML language according to the set interface specification, this embodiment provides A detailed XML language parameter definition is shown in Table 1. The algorithm parameter definition is as follows:

[0048] Table 1 parameter definition content

[0049]

[0050]

[0051] 1. The [ProductName] tag mentioned in the parameter definition is the algorithm name;

[0052] 2. The [ManualParams] tag contains all the required parameter values ​​of each sub-algorithm, including file type parameter [FileArg], numeric type parameter [ValueArg];

[0053] 3. The [ModelArgs] tag contains all the specified parameters of the sub-algorithm. If the algorithm contains multiple sub-operators, the parameter definition also contains multiple corresponding [ModelArgs] tag groups...

Embodiment 3

[0058] Based on the algorithm push module 102 in the first embodiment selecting one or more required algorithms from the algorithm registration module according to the needs of the task, this embodiment provides a specific selection strategy for different remote sensing algorithms. For complex satellite data processing algorithms, according to a pre-set strategy, it is decomposed into one or more series of sub-algorithms with a certain trigger mechanism. Each sub-algorithm can be described as the basic form of parallel computing—Map and transformation. Jane (Reduce). For example, algorithms such as marine oil spill simulation and storm surge monitoring must be decomposed into a series of sub-algorithm chains with a certain trigger mechanism;

[0059] The EOS soil water content inversion algorithm can be regarded as containing only one sub-algorithm.

[0060] Among them, for different algorithm types, there can be the following decomposition setting strategies:

[0061] 1. Single sc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A multi-source remote sensing satellite data parallel processing system and method based on algorithm classification, which supports new algorithm registration, stores and manages the registered algorithms; according to the needs of tasks, selects one or more algorithms from the algorithm registration module, and The remote sensing satellite data to be processed and the selected algorithm are pushed to the parallel processing node for processing; multiple parallel processing nodes simultaneously calculate the remote sensing satellite data to be processed in parallel according to the algorithm received by each node in accordance with the order of execution; The execution of the processing node algorithm is monitored; the processing results obtained by each parallel processing node are archived and stored. This solution supports various remote sensing algorithms and multi-source remote sensing data, and can simultaneously respond to and execute multi-source remote sensing data processing requests on distributed clusters, solve the problems of multi-source remote sensing satellite data multi-algorithm comprehensive processing, parallel computing and distributed storage, and achieve Effects of parallel processing of multi-source remote sensing satellite data.

Description

Technical field [0001] The invention relates to a multi-source remote sensing satellite data parallel processing system and method based on algorithm classification, belonging to the field of satellite data processing and application. Background technique [0002] Satellite data processing refers to the processing of the original data downloaded from the satellite into corresponding images, and the extraction of various types of information from the satellite data. The satellite data has global, high dynamic, continuous, all-weather, all-weather, Diversified data acquisition features are widely used to provide data support for professional fields such as agriculture, forestry, water conservancy, surveying and mapping, transportation, meteorology, and oceans. Its purpose is to be able to execute specific data processing algorithms as stably and quickly as possible under limited hardware conditions to produce high-quality satellite data products. [0003] After years of development,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V20/13G06F18/24
Inventor 曹宇王峰祝令亚孙业超
Owner CHINA CENT FOR RESOURCES SATELLITE DATA & APPL
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com