A container-based data exchange method

Abstract

The invention provides a container-based data exchange method, comprising the following steps: 1) providing a data conversion tool for converting data from different data sources into data sets; 2) Providing a container management tool including application, image and management; 3) providing a data exchange tool for importing and export data set, private data and result data; 4) Providing a container environment containing data analysis tools, which can be used for data fusion, analysis and mining. The invention provides a container-based data exchange method, which solves the problems of data exchange, data set fusion processing, model base formation and the like, aiming at the problems that the traditional data exchange mode cannot directly operate the data set for analysis and mining and the non-public data needs isolation environment, etc. At the same time, the container technology is used to isolate the calculation process, improve the data security, simplify the analysis processof the analysis and mining workers, and reduce the risk of data theft.

Description

technical field [0001] This article relates to a cloud computing technology field and a big data technology field, specifically a container-based data exchange method. Background technique [0002] With the advent of the era of cloud computing, the emerging term "big data" has attracted more and more attention; the so-called big data refers to data that cannot be captured, managed and processed with conventional software tools within an affordable time frame. Data collection; the meaning of big data does not simply refer to mastering huge data information, but how to extract the key information contained in a large amount of data, that is, how to process and analyze big data. [0003] With the rapid development of the Internet and the rapid expansion of informatization data, there are more and more difficulties in the analysis and processing of massive data. As an emerging industry, big data is the key to gaining benefits through the "processing" of data. The quality of the...

AI Technical Summary

Problems solved by technology

[0004] The traditional data exchange platform integrates a number of application information systems that are scattered and built, which enables several application subsystems to transmit and share information / data, and improves the utilization of information resources, which has become the basic goal of informatization construction; but the traditional The data exchange platform is not suitable for data fusion and processing in the big data environment. This is because the data fusion and processing of big data requires the operation of data sets, which is the operation of large data volume and multiple data types. It exists in the form of a service and cannot be directly operated as a data set; and the new data exchange method solves the problems of data exchange, data set fusion processing, and model library formation at the same time; at the same time, using container technology, the analysis process of different users Isolate, improve user data security, and improve resource utilization; therefore, we need a new container-based data exchange method to make big data processing more convenient

Images