Data collision flow analysis method and device, storage medium, and terminal
A technology of data collision and flow analysis, applied in the field of data circulation, can solve problems such as easy loss of data, large cost investment, poor transactional performance, etc., to achieve the effect of avoiding loss and improving accuracy
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment Construction
[0028] Those skilled in the art understand that, as mentioned in the background, there are mainly two existing big data analysis methods. The first method is to save the data obtained in circulation in the batch processing platform first, and then take out the data regularly for analysis. This method cannot realize real-time stream analysis of data. The second method usually puts the data in circulation into the distributed message subscription publishing system kafka, and then cooperates with the data stream processing system Storm or Spark-Streaming to perform real-time stream analysis. However, when kafka stores multiple batches of data under multiple different upper-level business IDs, it is easy to lose data, and kafka itself is not transactional when it is applied in the field of data circulation; Storm or Spark-Streaming is usually used for unlimited Analysis of the data stream, different batches of data to be analyzed will be continuously added to the analysis machine ...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com