Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Online data processing system generation method, device and equipment

A data processing system and data processing technology, applied in the computer field, can solve the problem that the MapReduce processing mechanism cannot meet the fast feedback requirements of the online system, and achieve the effect of meeting the fast feedback requirements

Active Publication Date: 2019-12-24
BEIJING DIDI INFINITY TECH & DEV
View PDF13 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The feedback time required by online systems is generally less than tens of milliseconds, so the MapReduce processing mechanism cannot meet the fast feedback requirements of online systems for processing concurrent online requests

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Online data processing system generation method, device and equipment
  • Online data processing system generation method, device and equipment
  • Online data processing system generation method, device and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0071] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present invention. Rather, they are merely examples of apparatuses and methods consistent with aspects of the invention as recited in the appended claims.

[0072] figure 1 It is a flowchart of a method for generating an online data processing system shown according to an exemplary embodiment of the present invention; this embodiment can be used for a server, and can also be used for a terminal (such as a mobile phone, a tablet computer, a personal computer, etc.), such as figure 1 As shown, the method includes the following steps S101-S104:

[00...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention relates to the technical field of computers, in particular to an online data processing system generation method, device and equipment. The method comprises the following steps: receiving configuration information used for constructing an online data processing system, wherein the configuration information comprises respective identifiers of a plurality of logic components and a serial / parallel relationship of the plurality of logic components, and the logic components are a pre-constructed set of program statements with a predetermined data processing function;calling the corresponding logic components according to the respective identifiers of the plurality of logic components; allocating thread pools to the plurality of called logic components respectively to form processing units corresponding to the plurality of logic components respectively; and based on the serial / parallel relationship, generating the online data processing system by utilizing the processing units respectively corresponding to the plurality of logic components. According to the invention, subsequent concurrent online request processing based on the generated online data processing system can be realized, and the rapid feedback requirement of the online system is met.

Description

technical field [0001] The embodiments of the present invention relate to the field of computer technology, and in particular to a method, device and equipment for generating an online data processing system. Background technique [0002] MapReduce is a software architecture proposed by Google. The concepts "Map (mapping)" and "Reduce (simplification)" and their main ideas are all borrowed from functional programming languages. The current MapReduce middleware implementation requires application developers to specify a Map (mapping) function, which is used to map a set of key-value pairs into some new key-value pairs, called intermediate key-value pairs; in addition, application developers are required to specify a The Reduce (simplification) function is used to further process the intermediate key-value pairs output by the Map function. The Map call automatically divides the input data into M pieces of input data fragments, and distributes these input data fragments to mul...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/38
CPCG06F9/3885
Inventor 张旭东
Owner BEIJING DIDI INFINITY TECH & DEV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com