Real-time data processing method and device

A technology of real-time data processing and real-time data, which is applied in the field of data processing, can solve problems such as the inability to know the progress of real-time data processing, and achieve the effect of increasing the evaluation dimension

Active Publication Date: 2021-10-26
ALIBABA GRP HLDG LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] The embodiment of the present application provides a real-time data processing method and device to at least solve the problem caused by the inability to know the progress of real-time data processing in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time data processing method and device
  • Real-time data processing method and device
  • Real-time data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0027] According to the embodiment of the present application, an embodiment of a real-time data processing method is provided. It should be noted that the steps shown in the flow chart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and, Although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown or described herein.

[0028] The method embodiments provided in the embodiments of the present application can be processed on the server. In order to provide a better user experience, a processing result query service can also be provided. For example, the calculation results on the server can be viewed through a webpage or a client. A server can be understood as a kind of computer. Of course, with the development of technology, cloud computing has been more and more widely used, and the method provided in the embodiment of ...

Embodiment 2

[0122] According to the embodiment of the present application, an embodiment of a real-time data processing device for implementing the real-time data processing method in the above-mentioned embodiment 1 is also provided, such as Figure 8 As shown, the apparatus 800 may include: a collection module 802 , an aggregation module 804 and a calculation module 806 .

[0123] Among them, the collection module 802 is used to collect real-time data received by one or more nodes in the distributed system; the summary module 804 is used to summarize the real-time data meeting the same predetermined condition on all nodes to obtain the corresponding real-time data under the same predetermined condition The total amount of data, wherein the predetermined condition is used to characterize the time when the real-time data is collected; the calculation module 806 is used to calculate the completeness of the real-time data that meets the same predetermined condition, wherein the completeness ...

Embodiment 3

[0152] Embodiments of the present application may provide a computer terminal, and the computer terminal may be any computer terminal device in a group of computer terminals. Optionally, in this embodiment, the foregoing computer terminal may also be replaced with a terminal device such as a mobile terminal.

[0153] Optionally, in this embodiment, the foregoing computer terminal may be located in at least one network device among multiple network devices of the computer network.

[0154] In this embodiment, the above-mentioned computer terminal can execute the program code of the following steps in the real-time data processing method: collect the real-time data received by one or more nodes in the distributed system; summarize the real-time data that meets the predetermined conditions on all nodes , to obtain the total amount of real-time data corresponding to the same predetermined condition, wherein the predetermined condition is used to characterize the time when the real...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The application discloses a real-time data processing method and device. Wherein, the processing method includes: collecting real-time data received by one or more nodes in the distributed system; summarizing real-time data satisfying the same predetermined condition on all nodes to obtain the total amount of corresponding real-time data under the same predetermined condition, Among them, the predetermined condition is used to characterize the time when the real-time data is collected; the completeness of real-time data satisfying the same predetermined condition is calculated, and the completeness is used to indicate: the processed real-time data satisfying the same predetermined condition is collected on all nodes proportion in the real-time data. The present application solves the problem caused by the inability to know the progress of real-time data processing in the prior art, thereby increasing the evaluation dimension of real-time data processing.

Description

technical field [0001] The present application relates to the field of data processing, in particular, to a real-time data processing method and device. Background technique [0002] In the existing field of real-time data computing, streaming data is continuous, and it is not known when it will end, so the real-time statistical data is also changing in real time. Since the real-time statistical data is constantly changing, the business side using these data is completely unaware of the progress of these data processing, so it is impossible to make some decisive behaviors based on these data, for example, the sales within the preset minutes of statistics Well, it is constantly changing, and decision makers cannot determine whether to change sales strategies based on these data; another example, if it is real-time data in the alarm monitoring system, due to continuous changes in real-time data, the system cannot make accurate decisions based on these data. Alarm behavior. T...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/30G06F11/34G06F16/2458G06F16/23
CPCG06F16/24568G06F16/2358G06F16/2462G06F11/302G06F11/3466G06F11/3476G06F2201/80G06F2201/805G06F11/30G06F11/34G06F9/485G06F9/5072
Inventor 李国忠
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap