Large-batch data importing method and system for database

A data import and database technology, applied in the field of information, can solve the problems of insufficient use efficiency of database data conversion, long waiting time, reduced database data import efficiency, etc., to achieve the effect of improving speed, improving efficiency, and meeting diversified requirements

Inactive Publication Date: 2018-04-17
TVM BEIJING TECH
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The amount of data supported by these database import methods is limited, and the file format of the imported data is also limited. The waiting time in the process of data import is long, which reduces the efficiency of database data import and cannot fully utilize the efficiency of database data conversion.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Large-batch data importing method and system for database
  • Large-batch data importing method and system for database

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The preferred embodiments of the present invention will be described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described here are only used to illustrate and explain the present invention, and are not intended to limit the present invention.

[0036] figure 1 It is a flowchart of a method for importing large batches of data into a database in Embodiment 1 of the present invention. like figure 1 As shown, the process includes the following steps:

[0037] Step 101, write data into cache.

[0038] Step 102, converting the data into a binary data file.

[0039] Binary data files are in the same format as the data files of the database.

[0040] During the conversion process, set the quantity unit of data conversion, and convert the data of one quantity unit into a binary data file each time.

[0041] After the accumulatively read data in the memory reaches the number of units, it will automatically star...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a large-batch data importing method and system for a database. The method comprises the steps of writing data in a cache; converting the data into binary data files, wherein the binary data files are consistent with data files of the database in format; when the data in the cache accumulatively reaches a quantity unit, automatically executing the data conversion; and storing the binary data files as database data files. According to the technical scheme, the batch data importing process of the database is optimized; the data importing speed is increased; large-batch data importing is supported; diversified requirements of data processing are met; the database data conversion time is shortened; the data importing efficiency is improved; and the demands of database application in multiple scenes are met.

Description

technical field [0001] The invention relates to the field of information technology, in particular to a method and system for importing large batches of data from a database. Background technique [0002] A relational database is a database built on the basis of the relational database model. Relational database products are widely used for their simple and clear concept and easy-to-understand and easy-to-learn database language. [0003] Relational databases process data in the database by means of concepts and methods such as set algebra, and are also organized into a set of formally descriptive tables. The essence of this form of tables is to load special collections of data items. These tables The data in the database can be accessed or recalled in many different ways without reorganizing the database tables. The definition of a relational database results in a table of metadata or in a formal description of tables, columns, scopes and constraints. Each table (sometim...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/258
Inventor 杨井
Owner TVM BEIJING TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products