Large-scale base station data storage and analysis method and system based on distributed storage

A distributed storage and data storage technology, applied in the direction of electrical digital data processing, special data processing applications, digital data information retrieval, etc., can solve the problems of low data conversion efficiency, poor scalability of base station data storage level, etc., and achieve conversion efficiency Boost, High Availability Effects

Pending Publication Date: 2022-03-15
国汽大有时空科技(安庆)有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] Purpose of the invention: In order to solve the problems of poor expandability of base station data storage level and low data conversion efficiency, the present invention provides a large-scale base station data storage and analysis method and system based on distributed storage, and uses big data technology to process base station data. store, convert, analyze

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Large-scale base station data storage and analysis method and system based on distributed storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] Such as figure 1 As shown, a large-scale base station data storage and analysis method based on distributed storage includes the following steps:

[0031] (1) Base station data storage, store streaming base station data in the distributed storage system according to base station and time;

[0032] (2) Base station data conversion, merge small base station data files in the distributed storage system, use JAVA local call technology to call the C++ dynamic library of RTKLIB, convert RTCM format files to RINEX format files, and upload RINEX format files to HDFS distributed The storage system and MinIO share the storage system for storage;

[0033] (3) Base station data analysis, accept the message in the message queue, analyze the message content, call the SHELL analysis script, download the RINEX file, call the GNSS data preprocessing software to analyze the RINEX file, and obtain the base station data availability rate, base station data cycle slip ratio and The multi-...

Embodiment 2

[0038] A large-scale base station data storage and analysis system based on distributed storage, including:

[0039] (1) Base station data storage module: store streaming base station data in the distributed storage system according to base station and time;

[0040] (2) Base station data conversion module: merge small base station data files in the distributed storage system, use JAVA local call technology to call the C++ dynamic library of RTKLIB, convert RTCM format files into RINEX format files, and upload RINEX format files to HDFS distribution Storage system and MinIO shared storage system for storage;

[0041](3) Base station data analysis module: accept the message in the message queue, analyze the message content, call the SHELL analysis script, download the RINEX file, call the GNSS data preprocessing software to analyze the RINEX file, and obtain the base station data availability rate, base station data cycle slip ratio And the multipath value of the frequency div...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a large-scale base station data storage and analysis method based on distributed storage, which comprises the following steps: base station data storage: storing streaming base station data in a distributed storage system according to a base station and time; base station data conversion: combining small base station data files in the distributed storage system, calling a C + + dynamic library of RTKLIB by using a JAVA local calling technology, converting the RTCM format file into a RINEX format file, and uploading the RINEX format file to an HDFS distributed storage system and a MinIO shared storage system for storage; and the base station analyzes the data, receives the message in the message queue, analyzes the content of the message, calls an SHELL analysis script, downloads an RINEX file, calls GNSS data preprocessing software to analyze the RINEX file, outputs an analysis result and stores the analysis result into a database. According to the invention, the problems of poor data storage level expansibility and low data conversion efficiency of the base station are solved.

Description

technical field [0001] The present invention relates to the field of base station data processing, in particular to a method and system for storing and analyzing large-scale base station data based on distributed storage. Background technique [0002] In today's information age, the scale of data in all walks of life is growing explosively. Big data is a new data processing method, which has stronger decision-making power, insight discovery power and circulation optimization ability to adapt to massive, high growth rate and diverse information assets. The strategic significance of big data is not only the management of massive data, but also the professional processing of massive meaningful data, the discovery of data value, and the data-driven growth of enterprises. At present, the mainstream big data technologies on the market are based on a series of technical systems related to collection, storage, calculation, query, resource management and other functions in the Hadoo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/182G06F16/178G06F9/54
CPCG06F16/182G06F16/1794G06F9/546G06F2209/548
Inventor 杨宇锡
Owner 国汽大有时空科技(安庆)有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap