Data processing and data analysis framework using data structure control

A data structure and data processing technology, applied in electrical digital data processing, special data processing applications, relational databases, etc., can solve problems such as poor scalability, improve versatility, avoid system-level overhead, and improve overall performance. Effect

Active Publication Date: 2017-07-21
成都优易数据有限公司
View PDF11 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of the above prior art, the purpose of the present invention is to provide a data processing and data analysis framework controlled by data structure, to solve the poor scalability of the prior art data processing framework due to the limitations of structure and protocol, and to solve how to integrate Technical issues such as data processing output and data analysis input to improve matching

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing and data analysis framework using data structure control
  • Data processing and data analysis framework using data structure control
  • Data processing and data analysis framework using data structure control

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0077] Metalanguage instance convention:

[0078] (1) Elementary process: "{instruction-mode parameter [-mode parameter][instruction-mode parameter[-mode parameter]]}" means a primitive process, where "{}" is mandatory, "[] " is optional, and the simplest primitive procedure is {instruction – mode parameter}.

[0079] (2) Operation expression: operator [field name[, field name]], for example max[profit] means the maximum value of profit in the sample data table is 1500. add[total input, profit] indicates the addition of total input and profit.

[0080] (3) Symbol comparison table Table 1:

[0081] Table 1

[0082] symbol meaning DS data source CM operation mode CC Math channel CP operation process OP output process VD check mode multiply multiplication division division add addition minus subtraction R primitive separator SEC Safety OP output , delimiter for parallel ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a technical framework using a data structure to control a data processing process and a data analysis process and belongs to the field of big data framework technology. The framework is named as Hyong. The business-based data analysis process is realized in the data processing process at the level of data operation, and meanwhile the data processing process and the data analysis process both need a series of standard control and protection mechanisms. Through high abstraction of the data processing process and the data analysis process, control and protection of the two processes are packaged in a data structure mode. By developing and implementing the Hyong technical framework, the data processing process and the data analysis process can be integrated in a systematic mode, and control is executed by use of the basic data structure mode, so that the technical framework has extremely high universality and excellent performance.

Description

technical field [0001] The invention relates to the technical field of data processing and data analysis process control, in particular to a data processing and data analysis framework controlled by a data structure. Background technique [0002] Data analysis and data processing use professional software (system) in their respective fields to complete professional technical tasks. For example, data analysis uses professional software such as SAS, SPSS, and MATLAB, while data processing uses computing frameworks such as Spark, Storm, and Hadoop. [0003] With the rapid development of business data analysis and information technology, business-based data analysis technology and information theory-based data processing technology have gradually entered a highly integrated stage. Traditional business analysis uses professional analysis software to complete the modeling and analysis process, while data processing technology is implemented by an independent data processing system...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/14G06F16/2246G06F16/285
Inventor 贺俊华傅玉生王永波鲜东
Owner 成都优易数据有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap