Method and device for loading database text table data

A database and table data technology, applied in the database field, can solve the problem of large I/O resource consumption, and achieve the effects of reducing I/O resource consumption, improving data processing efficiency, and improving data loading efficiency

Active Publication Date: 2017-06-30
BOCO INTER TELECOM
View PDF5 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the object of the present invention is to provide a data loading method and device for a text table in an in-memory database to solve the technical problem of excessive consumption of I / O resources when the same text table is repeatedly loaded in an in-memory database in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for loading database text table data
  • Method and device for loading database text table data
  • Method and device for loading database text table data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0056]The principle of loading text table data in other existing databases is relatively simple, that is, each SQL execution thread initializes its own file reader. The file reader is responsible for reading string data line by line from the text file and parsing it into a line of structured memory data; if the text table is associated with a file list (more than 1 text file), the file read The reader reads each file in turn; if multiple SQL execution threads ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and device for loading database text table data. The method includes the steps that a to-be-loaded target text table in a database is determined, wherein the target text table comprises N text files, and N is a positive integer larger than or equal to 1; N first queues are established in a memorizer, and a one-to-one mapping corresponding relation exists between each first queue and the corresponding text file; each text file is subjected to read operation, and then data read out from each text file is written in the corresponding first queue; M second queues are established in the memory, wherein M is a positive integer larger than or equal to 1; the data is sequentially read out from the N first queues, and the read-out N data is simultaneously copied in each second queue, wherein the data in the M second queues can be read respectively and used for corresponding concurrence requirements.

Description

technical field [0001] The invention relates to the technical field of databases, in particular to a method and device for loading text table data in a database. Background technique [0002] With the further improvement of the centralization of network operation and maintenance, the application functions of network management integration continue to increase, the amount of data that needs to be managed by operation and maintenance is also rapidly increasing, and the demand for multi-dimensional reading of data is also emerging. [0003] However, when the existing traditional databases face large concurrency requirements of orders of magnitude, they usually provide data loading for each concurrent task in turn, so there will be a large operating load. Insufficient parallel processing capability of high-level data; or providing data loading for each concurrent task through memory at the same time, but there will be a problem that the data loading efficiency will be greatly re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/254G06F16/273
Inventor 张凤桥高建军
Owner BOCO INTER TELECOM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap