Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for merging various business index data in real time and computer equipment

A technology of business indicators and indicator data, applied in the field of data processing, can solve problems such as large data delay, HiveSQL consumes large computing resources, and affects the response time of business systems

Pending Publication Date: 2021-08-06
深圳市云网万店科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method is to process the data corresponding to T-1 time at T time, resulting in large data delay; and the traditional operation is to extract the index data of each business system to the local system for combined calculation, which requires massive extraction of business system data. It will put a lot of pressure on the database of the business system that provides the data, thus affecting the response time of the business system when receiving external information queries, and Hive SQL will consume a lot of computing resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for merging various business index data in real time and computer equipment
  • Method and device for merging various business index data in real time and computer equipment
  • Method and device for merging various business index data in real time and computer equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] In this embodiment, the method of real-time merging multiple business index data provided by this application can be applied to such as figure 1 shown in the application environment. Wherein, the local server 102 communicates with the service server 104 through the network, and the local server 102 may also communicate with the downstream system 106 and / or the terminal 108 through the network. There are multiple business systems running in the business server 104, and each business system has one or more business index data, and the above multiple business index data are respectively stored in a plurality of external data tables, and the multiple external data tables are provided with The same business primary key field, and the above-mentioned multiple external data tables may exist in the same or different business systems, the local server 102 is preset with multiple local data tables, and the multiple local data tables are the same as the multiple external data tabl...

Embodiment 2

[0090] This embodiment provides a device for merging multiple business index data in real time. The multiple business index data are stored in multiple external data tables respectively. The multiple external data tables are provided with the same business primary key field, which is preset locally. Multiple local data tables, one-to-one correspondence between multiple local data tables and multiple external data tables; for example Figure 4 As shown, the device includes:

[0091] The real-time acquisition module 402 is used to store the updated business index record in any external data table in the local data table corresponding to the external data table in real time, and each business index record includes business primary key field information and business index field information.

[0092] The intermediate table generation module 404 is used to periodically obtain the incremental business index records in each local data table, merge and deduplicate the business primary ...

Embodiment 3

[0108] In this embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as follows Figure 5 shown. The computer device includes a processor, memory, network interface and database connected by a system bus. Wherein, the processor of the computer device is used to provide calculation and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer programs and databases. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, it can realize the steps of a method for merging multiple types of service indicator data in real time as introduce...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a method and device for merging various business index data in real time, computer equipment and a storage medium. The method comprises the following steps of: storing a business index record updated in any external data table into a local data table corresponding to the external data table in real time; obtaining incremental business index records in all the local data tables regularly, enabling business primary key field information of all the incremental business index records to be subjected to combination and deduplication processing, generating an intermediate incremental data table, wherein the intermediate incremental data table comprises multiple pieces of updated business primary key field information; and obtaining corresponding business index field information from each local data table according to each piece of updated business primary key field information, and carrying out merging calculation on the business index field information obtained from each local data table to obtain composite business index data corresponding to each piece of updated business primary key field information. By adopting the method, various business index data can be merged in real time in a low-invasion and low-delay manner.

Description

technical field [0001] The present application relates to the technical field of data processing, in particular to a method, device, computer equipment and storage medium for merging multiple business index data in real time. Background technique [0002] In recent years, with the rapid development of Internet technology, the amount of data to be processed has also increased significantly. Especially in the process of enterprise operation, it is often necessary to perform real-time combined calculations on multi-system and multi-dimensional data. However, the traditional real-time merging calculation method of multi-system and multi-dimensional data usually extracts data to HDFS periodically, and then associates these data through Hive SQL to realize data processing, cleaning and merging between multiple systems, and finally forms a complete Dimension data is provided to the reporting system for query. This method is to process the data corresponding to T-1 time at T time,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/242G06F16/23G06F16/25
CPCG06F16/2425G06F16/2358G06F16/256
Inventor 凌志伟杭军吴金迎钱津津司孝波
Owner 深圳市云网万店科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com