Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data analysis processing service platform under big data background

A technology of data analysis and processing and service platform, applied in the field of data analysis and processing service platform under the background of big data, can solve the problem of large computing power and time, and achieve the effect of convenient code backtracking and collaborative development

Pending Publication Date: 2022-07-22
河钢数字技术股份有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In order to make it easier for data developers to manipulate data computing frameworks, each framework has launched APIs suitable for different programming languages ​​(such as Java / Scala / Python) to facilitate data processing by data developers; especially for offline scene data In terms of processing, it often takes a lot of computing power and time to verify the data processing scheme. If the data processing process can be verified step by step and the key data is cached, it will be of great benefit to the data processing process; in view of this, We propose a data analysis and processing service platform under the background of big data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data analysis processing service platform under big data background
  • Data analysis processing service platform under big data background

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0026] It should be noted that all directional indications (such as up, down, left, right, front, back, etc.) in the embodiments of the present invention are only used to explain the relationship between various components under a certain posture (as shown in the accompanying drawings). The relative positional relationship, the movement situation, etc., if the specific posture changes, the directional indication also changes accordingl...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data analysis and processing service platform under a big data background, and relates to the technical field of data processing and analysis. The invention discloses a data analysis processing service platform under a big data background, which is a comprehensive data analysis service platform supporting various data processing frameworks and programming languages, and comprises a peripheral module, a zeppelin-server module, a zeppelin-interpreter module, a zeppelin-zengine module, a zeppelin-web module and a database module. The system comprises a zeppelin-server module, a zeppelin-interpreter module and a zeppelin-zengine module, the zeppelin-server module is an overall system entrance and provides a server function, an authority authentication function and a user verification function, the zeppelin-interpreter module is used for executing an interpreter, and the zeppelin-zengine module is used for persistence and retrieval service of notebook in zeppelin. According to the data analysis processing service platform under the big data background, the service platform is developed on the basis of a Zepeelin framework, supports various mainstream data processing frameworks including Hadoop, Spark, Flink, R and other frameworks, provides mainstream database manipulation ability, and includes PostgreSQL, HBase and MySQL.

Description

technical field [0001] The invention relates to the technical field of data processing and analysis, in particular to a data analysis and processing service platform under the background of big data. Background technique [0002] In the existing technology, "big data" has become a popular buzzword. Faced with the explosive increase in data scale, the requirements for data processing speed and quality are becoming more and more stringent. At the same time, as the scale of data continues to rise, it becomes more and more difficult to dig out effective data that is in line with its own development from numerous data, and to guide production practices. [0003] In order to meet the challenges brought by big data, various big data processing technologies are constantly being introduced. Starting from the speed of data processing, a series of data processing frameworks such as Hadoop, Spark and Flink are constantly flooding into the market. Starting from the data source side, fr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F8/38G06F8/34
CPCG06F8/38G06F8/34
Inventor 魏晓飞林亚团张杰祥彭晶李宏鹏刘培培刘发民王海燕
Owner 河钢数字技术股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com