Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Real-time data processing method and apparatus

A real-time data processing and data technology, applied in the direction of electrical digital data processing, special data processing applications, database management systems, etc., can solve the problems of operators' sales loss, low processing efficiency, and wrong results of price maintenance, etc., to reduce sales Loss, the effect of improving processing efficiency

Inactive Publication Date: 2018-02-09
SUNING COM CO LTD
View PDF4 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, in the process of actual use, whether it is the repeated collection of upstream data or the repeated delivery of data due to delays in the business process, it will cause the problem of inaccurate downstream data of GMV. Inaccurate data will cause errors in the results of price maintenance, making it impossible for operators and users to obtain correct prices
And because the data stream is delivered in real time, it is not convenient to troubleshoot the cause of abnormal data
The wrong price result caused by abnormal data will cause sales loss to the operator
[0004] The current solution to the problem of repeated delivery of data in price maintenance is mainly to monitor the page displaying prices in real time through web crawlers or manual inspectors, passively discover abnormal data that has appeared, and then notify the personnel of the operation and maintenance department of the abnormality data, the processing efficiency is low, and it is difficult to reduce the sales loss caused by abnormal data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time data processing method and apparatus
  • Real-time data processing method and apparatus
  • Real-time data processing method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] In order to enable those skilled in the art to better understand the technical solutions of the present invention, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. Hereinafter, embodiments of the present invention will be described in detail, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention. Those skilled in the art will understand that unless otherwise stated, the singular forms "a", "an", "said" and "the" used herein may also include plural forms. It should be further understood that the word "comprising" used in the description of the present invention refe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Embodiments of the invention disclose a real-time data processing method and apparatus, which relates to the field of internet e-commerce and can improve abnormal data processing efficiency and reducesale loss caused by abnormal data. The method comprises the steps of importing received real-time stream data to STORM, and obtaining a business main key corresponding to the real-time stream data; when it is detected that the business main key does not exist in REDIS, storing the business main key in the REDIS, and when a two-layer detection switch is switched on, detecting whether the businessmain key exists in DB or not; when it is detected that the business main key does not exist in the DB, storing the business main key in the DB; and when it is detected that the business main key exists in any one of the REDIS and the DB, determining the received real-time stream data as the abnormal data. The method and the apparatus are suitable for duplicate removal of the real-time stream data.

Description

technical field [0001] The invention relates to the field of Internet e-commerce, in particular to a real-time data processing method and device. Background technique [0002] With the development of e-commerce technology, real-time streaming data has been promoted and used in scenarios with high real-time requirements such as order processing and price maintenance. Especially for price maintenance on online shopping platforms, GMV (Gross Merchandise Volume, website transaction amount) the system processes real-time streaming data. [0003] However, in the process of actual use, whether it is the repeated collection of upstream data or the repeated delivery of data due to delays in the business process, it will cause the problem of inaccurate downstream data of GMV. Inaccurate data will cause errors in the results of price maintenance, making it impossible for operators and users to obtain correct prices. And because the data stream is delivered in real time, it is not eas...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30G06F8/20
CPCG06F8/22G06F16/25
Inventor 孙迁叶国华钱津津吴金迎范东
Owner SUNING COM CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products