User portrait data monitoring method, system and device and storage medium

A data monitoring method and data storage technology, applied in the field of big data processing, can solve the problems of data inaccuracy, time and labor cost, business performance impact, etc., and achieve the effect of improving the efficiency of data statistics

Active Publication Date: 2020-03-24
JIANGSU MANYUN SOFTWARE TECH CO LTD
View PDF2 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the existing monitoring system, the downstream business system will provide data anomaly verification in the business logic when using data, such as data duplication judgment, data volume abnormal judgment, data inaccurate judgment, etc., but this is only based on specific business logic The above judgment is applicable to A business but not necessarily applicable to B business, there is no uniform standard
In addition, in the existing system, if there is a problem in the data transfer process, you need to rely on testing or code review (review), or dot the necessary information in the code, and output the information to a local file in the form of an output log. When a problem occurs Look through the logs and find possible problem points according to the logs; these methods are time-consuming and labor-intensive. When data anomaly verification is coupled to the business system, it will affect the performance of the business, and every time the data is used, it will improve. Development costs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • User portrait data monitoring method, system and device and storage medium
  • User portrait data monitoring method, system and device and storage medium
  • User portrait data monitoring method, system and device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0046] Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus repeated descriptions thereof will be omitted. Some of the block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a user portrait data monitoring method, system and device and a storage medium. The user portrait data monitoring method comprises the following steps: collecting user portraitdata from each node in a user portrait data link; storing the user portrait data in a message queue; performing real-time statistics on the user portrait data in the message queue by adopting a data flow calculation engine; and storing a statistical result of the data flow calculation engine in a statistical database. By adopting the scheme of the invention, full-link monitoring is carried out onthe user portrait data link, and the data statistics efficiency is improved by combining the message queue and the data flow calculation engine, so that the data of each node in the user portrait datalink can be captured and analyzed in time, and problems can be found in time.

Description

technical field [0001] The present invention relates to the technical field of big data processing, and in particular to a user portrait data monitoring method, system, device and storage medium. Background technique [0002] The importance of big data to the company is increasing day by day, empowering various business departments within the company, and the security of data assets is also frequently mentioned. After the data of the user portrait system is calculated by the big data department, it is pushed to various business systems for use. It is specifically applied to usage scenarios such as operations, advertisements, and reports. Downstream business systems have higher requirements for upstream data quality. If the data lacks the necessary monitoring during the flow of various systems, the data quality of key nodes cannot be controlled. [0003] In the existing monitoring system, the downstream business system will provide data anomaly verification in the business l...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/34G06F11/32G06F16/182
CPCG06F11/3438G06F11/327G06F16/182
Inventor 董延峰
Owner JIANGSU MANYUN SOFTWARE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap