Data import method, device and equipment and computer storage medium

A data import and data technology, applied in the field of financial technology, to achieve the effect of improving efficiency

Pending Publication Date: 2020-10-13
WEBANK (CHINA)
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The main purpose of the present invention is to propose a data import method, device, equipment and computer storage medium, aiming at solving the technical problem of how to improve the efficiency of data import

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data import method, device and equipment and computer storage medium
  • Data import method, device and equipment and computer storage medium
  • Data import method, device and equipment and computer storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0037] Such as figure 1 as shown, figure 1 It is a schematic structural diagram of the data importing device of the hardware operating environment involved in the solution of the embodiment of the present invention.

[0038] The data import device in the embodiment of the present invention may be a PC or a server device on which a Java virtual machine runs.

[0039] Such as figure 1 As shown, the data importing device may include: a processor 1001 , such as a CPU, a network interface 1004 , a user interface 1003 , a memory 1005 , and a communication bus 1002 . Wherein, the communication bus 1002 is used to realize connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 ma...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of Fintech, and discloses a data import method, which comprises the following steps of performing data conversion processing on original data to be subjected to data import to obtain target data, carrying out classification processing on the target data to obtain a plurality of division data, and sequentially distributing each division data to a partition table corresponding to each division data, sequentially creating indexes for the partition tables with the division data to obtain target partition tables with the indexes, and performing snapshotprocessing on the target partition tables to obtain target snapshots corresponding to the target partition tables, and sending the target snapshots to a target cluster corresponding to the original data, the target cluster performing snapshot recovery on the received target snapshots in sequence. The invention further discloses a data import device and equipment and a computer storage medium. Thedata import efficiency is improved.

Description

technical field [0001] The present invention relates to the technical field of financial technology (Fintech), in particular to a data import method, device, equipment and computer storage medium. Background technique [0002] With the development of computer technology, more and more technologies (big data, distributed, cloud computing, artificial intelligence, etc.) Security and real-time requirements also put forward higher requirements for data import technology. At present, when data is imported, the data to be imported in hive (data warehouse) is generally determined first, and then the distribution method of the data is calculated through spark (computing engine), and the data is imported to the target according to the distribution method calculated. cluster, and convert the format of the imported data through the java application in the target cluster, and then store it in the index file corresponding to the data. However, when the amount of data is large, as the d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/22G06F16/25G06F16/28G06F16/27G06F16/182
CPCG06F16/182G06F16/2282G06F16/258G06F16/27G06F16/285
Inventor 陈文浩
Owner WEBANK (CHINA)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap