A data processing script program running method and a data processing container

A data processing and scripting technology, applied in the field of data processing, can solve the problems of server crash, low security, illegal access to sensitive data, etc., and achieve the effect of reducing impact and improving security.

Active Publication Date: 2019-04-02
BEIJING E TECHSTAR
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Usually, the data processing system runs in the application server. Due to the added script programming support, running the data processing script program written by the user may bring security risks to the data processing system and the application server where it is located, such as script program infinite loop, memory overflow Problems such as / leakage, illegal access to sensitive data, etc., will cause the server to crash in serious cases. At the same time, when the data processing script program written by the user needs to call the third-party program library, the relevant program library needs to be deployed in the application server, so the traditional method has cumbersome operations. , low security, poor controllability and low fault tolerance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data processing script program running method and a data processing container
  • A data processing script program running method and a data processing container

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] In order to make the technical problems, technical solutions and beneficial effects solved by the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0048] The present invention provides a data processing script program running method and a data processing container, a highly integrated data processing script program running container, which can ensure that the data processing script program runs within a safe and controllable range, consumes less resources, and is easy to configure and use. Wide range of applications.

[0049] refer to figure 1 , the present invention provides a method for running a data processing script program, comprising the following steps:

[0050] Step 1, create a data processing container ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data processing script program running method and a data processing container, and the data processing container communicates with a data processing system, receives a data processing script program submitted by the data processing system and returns a script running result; the data processing container comprises a starting module, a safe sandbox module, a third-party library management module, a container log module, an external data interface module, a script execution engine module, a script execution interface module and a container management module. The method has the advantages that the process CPU of the data processing container is arranged; according to the method and the device, the use access limits of the memory, the file, the network, the socket andthe program library are limited, so that the running safety, fault tolerance and controllability of the data processing script program are improved, the complex, flexible and personalized data processing requirements are met, and the influence of the data processing script program on a data processing system is reduced.

Description

technical field [0001] The invention belongs to the technical field of data processing, and in particular relates to a data processing script program running method and a data processing container. Background technique [0002] With the rapid development of information technology, analyzing the laws and trends contained in data has become a very important activity in all walks of life. Data processing is the basic link of data analysis, and complex, flexible and personalized data processing needs give data Processing systems present enormous challenges. [0003] In the traditional data processing system, the following methods are mainly used to meet complex, flexible and personalized data processing requirements: add script programming support in the data processing system, so that users can write data processing script programs in the data processing system, This allows for individualized data processing. [0004] In a traditional data processing system, adding script pro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/455H04L29/08
CPCG06F9/45512G06F9/45529H04L67/02
Inventor 钱苏晋刘爱军刘杰
Owner BEIJING E TECHSTAR
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products