Data extraction tool on basis of data modeling and data increment implementation

A data modeling and data extraction technology, applied in data processing applications, electrical digital data processing, special data processing applications, etc., can solve the problems of huge data volume and slow data extraction, so as to improve execution efficiency, ensure timeliness, The effect of optimizing query efficiency

Inactive Publication Date: 2017-05-17
SHANDONG INSPUR COMML SYST CO LTD
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] (2) Full synchronization generally does not cause data inconsistency, but as the amount of data increases, the full data will often be very large in the end, resulting in slow data extraction

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention clearer, the present invention will be described in detail below in conjunction with the embodiments. It should be noted that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0026] The application of the data extraction tool based on data modeling and data increment includes the following steps:

[0027] (1) Create a data structure, which includes basic table information, field information and index information;

[0028] (2) Create extraction rules, the extraction methods include incremental extraction and full extraction, the extraction rule components include query components, update components, delete components and extension components, and establish the corresponding relationship between the source table and the target table;

[0029] (3) Customize the extraction plan...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention particularly relates to a data extraction tool on the basis of data modeling and data increment implementation. Application of the data extraction tool on the basis of the data modeling and the data increment implementation includes creating data structures; creating extraction rules and customizing extraction plans; carrying out scheduling management; analyzing assemblies and data formation rules used by data templates; generating explanation documents. The data extraction tool on the basis of the data modeling and the data increment implementation has the advantages that the data templates are classified and customized, reasonable extraction modes are selected according to the data volumes of source tables, accordingly, the execution efficiency of the data templates can be improved, the consistency of the data can be guaranteed regardless of incremental or full-volume modes, the inquiry efficiency can be optimized, and the timeliness of the business data can be guaranteed.

Description

technical field [0001] The invention relates to the technical field of data modeling and information collection, in particular to a data extraction tool based on data modeling and realizing data increment. Background technique [0002] Due to the large amount of business data generated by taxpayers handling tax business every day, the data volume of the source business table is increasing, the pressure on the server is increasing, and the query speed is getting slower and slower. [0003] There are two methods of data synchronization: one is incremental synchronization, and the other is full synchronization. Both approaches have their own advantages, but also their own problems: [0004] (1) Incremental synchronization, mainly based on the original data, uses the self-incremental field for data extraction. If the source table data is modified, it is easy to cause data inconsistency; [0005] (2) Full synchronization generally does not cause data inconsistency, but as the a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06Q40/00
CPCG06F16/254G06Q40/123
Inventor 吕志凯邹建军杨培强
Owner SHANDONG INSPUR COMML SYST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap