General and parallel parsing method, device and electronic equipment for airborne binary files

Abstract

The invention provides a universal and parallel parsing method, device and electronic equipment for an airborne binary file, and relates to the technical field of computer data processing; the method includes respectively configuring storage structures of binary files of different file types, including configuring a file header of a binary file, including The data block, as well as the data structure, data type and conversion function of the data block; read the data block according to the configuration information, add the topic information and timestamp tag and send it to the message queue, so that the consumer of the message queue can obtain the data in the queue in parallel block, and obtain the data structure, data type and corresponding conversion function of the data block according to the topic information, parse the data and save it to a text file. Realize custom file parsing rules through graphical configuration, realize generalized parallel parsing of binary files of different models; and use message queues to decompose binary file parsing into data block production and data parsing consumption, greatly shortening large file parsing time.

Description

technical field [0001] The invention relates to the technical field of computer data processing, in particular to a universal and parallel parsing method, device and electronic equipment for an airborne binary file. Background technique [0002] During the flight of the aircraft, the airborne equipment records a large amount of data sent from sensors, radar and other equipment during the operation of the aircraft. This type of data has the characteristics of large data volume and high storage frequency. Most of the airborne devices are embedded devices, and the storage resources and computing power of these devices are limited. Therefore, the common practice in the industry is to directly store these data in binary files according to the custom data structure, and wait for the aircraft to land. It is downloaded to the data center on the ground, analyzed and converted into readable semi-structured files by data processing software. [0003] At present, there are many airborn...

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to provide a universal parallel parsing method, device and electronic equipment for airborne binary files, so as to solve the problem that the traditional stand-alone data processing method is very inefficient when dealing with large file parsing, and cannot effectively utilize the distributed processing capabilities of the data center. Technical Issues for Improving Processing Efficiency

Images