Data stream merging method, device and equipment and computer storage medium

A data stream and computer program technology, applied in computing, database indexing, electronic digital data processing, etc., can solve the problem of poor data stream merging effect, and achieve the effect of ensuring the merging effect, merging efficiency, and avoiding time-consuming costs.

Pending Publication Date: 2021-08-31
WEBANK (CHINA)
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present application provides a data stream merging method, device, electronic equipment and computer storage medium, which can solve the problem of poor data stream merging effect in the related art when data stream merging is performed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data stream merging method, device and equipment and computer storage medium
  • Data stream merging method, device and equipment and computer storage medium
  • Data stream merging method, device and equipment and computer storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The present application will be described in further detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the embodiments provided here are only used to explain the present application, and are not intended to limit the present application. In addition, the embodiments provided below are some embodiments for implementing the application, rather than providing all the embodiments for implementing the application. In the case of no conflict, the technical solutions described in the embodiments of the application can be combined in any manner implement.

[0040] It should be noted that, in the embodiments of the present application, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion, so that a method or device comprising a series of elements not only includes the explicitly stated elements, but also include other elements not explicitly listed, or also includ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data stream merging method and a device, electronic equipment and a computer storage medium. The method comprises the steps that receiving multiple data streams sent from an flink data source, wherein the data structures of at least two data streams in the plurality of data streams are different; acquiring a configuration file used for merging the plurality of data streams; filtering the plurality of data streams according to the configuration file to obtain filtered data streams; and for the filtered data stream, acquiring the data stream stored in a Map data structure within a set waiting time, and based on the configuration file, carrying out merging processing on the data stream stored in the Map data structure within the set waiting time.

Description

technical field [0001] The present application relates to the field of big data real-time computing of financial technology (Fintech), and in particular to a data stream merging method, device, electronic equipment and computer storage medium. Background technique [0002] With the development of computer technology, more and more technologies are applied in the financial field, and the traditional financial industry is gradually transforming into financial technology. However, due to the security and real-time requirements of the financial industry, higher requirements are also placed on technology. [0003] In related technologies, there are mainly two types of multi-stream merging schemes: 1) multi-real-time stream merging scheme based on flink union; 2) multi-real-time stream merging scheme based on flink connect; scheme 1) union algorithm provided by flink The child performs multi-real-time stream merging processing, see Figure 1A , taking two real-time streams as an e...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2455G06F16/22
CPCG06F16/22G06F16/24568
Inventor 徐翔宇黄国财陈政
Owner WEBANK (CHINA)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap