Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data exchange method, device, equipment and medium

A data exchange and database technology, applied in the database field, can solve problems such as low data exchange performance and single-point performance bottlenecks

Active Publication Date: 2019-11-19
HANGZHOU DT DREAM TECH
View PDF8 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the overall proxy capability of the middleware can be improved through the horizontal expansion capability of the middleware, the data exchange of a specific data table can only be performed by one middleware agent, which has a single-point performance bottleneck and low data exchange performance.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data exchange method, device, equipment and medium
  • Data exchange method, device, equipment and medium
  • Data exchange method, device, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0046] At present, when using ETL tools to process distributed database data exchange tasks, middleware needs to be used to parse SQL semantics and perform SQL business proxy, and the use of middleware will have a single-point performance bottleneck. Therefore, the present application accordingly provides a data exchange method, which can directly and concurrently access the source database and the destination database, realize concurrent data reading and writing, and improve the dat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data exchange method and device, equipment and a medium. The method comprises the steps of obtaining back-end database information in a distributed database; then, accordingto the back-end database information, controlling ETL working nodes to create data exchange task threads of which the number is equal to that of the back-end databases; and controlling the ETL workingnode to execute the data exchange task thread so as to directly extract target data from a source database in a concurrent manner and directly load the target data to a target database in a concurrent manner. Visibly this, after back-end database information in a distributed database is obtained, the ETL working nodes are controlled to create data exchange task threads with the number equal to that of the back-end databases; the data exchange task threads are executed to directly read and write the database in a concurrent mode, the data exchange task threads do not pass through middleware, middleware single-point performance limitation does not exist any more, concurrent reading and writing of data are achieved, and the data exchange performance of the distributed database is improved.

Description

technical field [0001] The present application relates to the technical field of databases, in particular to a data exchange method, device, equipment, and medium. Background technique [0002] ETL (Extract-Transform-Load) is used to describe the process of extracting, transforming, and loading data from the source to the destination. When using ETL tools to process data exchange tasks in distributed databases, it is necessary to use middleware to parse SQL semantics and perform SQL business proxying. Although the overall proxy capability of the middleware can be improved through the horizontal expansion capability of the middleware, the data exchange of a specific data table can only be performed by one middleware agent, which has a single-point performance bottleneck and low data exchange performance. Contents of the invention [0003] In view of this, the purpose of this application is to provide a data exchange method, device, equipment, and medium, so that the perfor...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/25G06F16/27
CPCG06F16/254G06F16/27
Inventor 林鹏程
Owner HANGZHOU DT DREAM TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products