Data synchronization system

A data synchronization and data source technology, applied in the field of cloud data, can solve the problems of not supporting data source management, directory recursive synchronization, unable to achieve file incremental synchronization, etc., to achieve the effect of unified management

Active Publication Date: 2020-10-16
CHINA ACADEMY OF ELECTRONICS & INFORMATION TECH OF CETC +2
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For cross-network and cross-device scenarios, in order to realize data interconnection among distributed heterogeneous systems, complete data extraction and establish a central database, existing ETL tools such as kettle cannot realize incremental synch...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data synchronization system
  • Data synchronization system
  • Data synchronization system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015] According to one or more embodiments, such as figure 1 As shown, an FTP-based incremental synchronous exchange system for unstructured data. Specifically, it includes a data source management module, a synchronization task management module and a synchronization task execution module.

[0016] The data source management module is used for the creation, connection test, query and deletion of FTP data sources; the synchronization task management module is used for the creation, list, query, details, scheduling, start and stop, log viewing and visualization of result statistics of synchronization tasks ; The synchronization task execution module is used for configuration reading, calculation of incremental files, directory structure synchronization, processing of Chinese file names, synchronization process log records, synchronization error records and statistical records of synchronization results. It also includes a heterogeneous FTP module and a business data storage m...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data synchronization system, which is used for FTP unstructured data synchronization, and specifically comprises a data source management module used for creating, connecting, testing, querying and deleting an FTP data source; a synchronous task management module which is used for visualization of creation, listing, query, details, scheduling, starting and stopping, log viewing and result statistics of synchronous tasks; and a synchronization task execution module which is used for configuration reading, incremental file calculation, directory structure synchronization, Chinese file name processing, synchronization process log recording, synchronization error recording and synchronization result statistical recording. The system further comprises a heterogeneous FTP module and a service data storage module.

Description

technical field [0001] The invention belongs to the technical field of cloud data, and in particular relates to a data synchronization system, that is, an FTP-based incremental synchronization exchange system for unstructured data. Background technique [0002] With the country's support and continuous investment in Internet technology and smart cities, the government's government affairs system has also continued to deepen the construction of smart government affairs clouds. Due to historical reasons, various units and institutions in the government affairs system currently have a variety of unstructured data, and these data are located in different physical locations, forming many data islands. [0003] With the continuous construction of smart government cloud, these data need to be managed in a unified manner. For cross-network and cross-device scenarios, in order to realize data interconnection among distributed heterogeneous systems, complete data extraction and estab...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/178G06F16/182H04L29/08
CPCG06F16/178G06F16/182H04L67/06
Inventor 王鹏达李鹏董义明戴永恒李成帮
Owner CHINA ACADEMY OF ELECTRONICS & INFORMATION TECH OF CETC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap