Data reading method and device, electronic equipment and storage medium

A data reading and data cube technology, applied in the field of big data, can solve the problems of single node performance, affecting data reading efficiency, and data reading time-consuming, etc., to achieve the effect of ensuring reading and improving efficiency

Pending Publication Date: 2021-12-31
PING AN TECH (SHENZHEN) CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, data reading is usually based on the big data platform as the calculation method to pull the required data from the data source, but this method is prone to single-node performance problems, that is, the data will be in a serial state during the reading process. This will easily cause the local loading of data reading to take a very long time, which will affect the efficiency of data reading

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data reading method and device, electronic equipment and storage medium
  • Data reading method and device, electronic equipment and storage medium
  • Data reading method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0045] An embodiment of the present application provides a data reading method. The subject of execution of the data reading method includes, but is not limited to, at least one of electronic devices such as a server and a terminal that can be configured to execute the method provided by the embodiment of the present application. In other words, the data reading method can be executed by software or hardware installed on the terminal device or server device, and the software can be a block chain platform. The server includes, but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, and the like. The server can be an independent server, or it can provide cloud service, cloud database, cloud computing, cloud function, cloud storage, network service, cloud communication, middle...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of big data, and discloses a data reading method and device, electronic equipment and a storage medium, and the method comprises the steps: receiving a data reading request transmitted by a client, converting the data reading request into a data query statement, constructing an index of the data query statement, and obtaining a target query statement; according to a query object in the target query statement, splitting the target query statement to obtain a plurality of sub-query statements, and reading query data of each sub-query statement from a source data party corresponding to the client to obtain a plurality of pieces of query data; performing relation integration on the plurality of query data to generate a query file of the target query statement; and fragmenting the query file to obtain a plurality of sub-fragmented files, and returning the plurality of sub-fragmented files to the local disk of the client. In addition, the invention also relates to a block chain technology, and the sub fragment files can be stored in a block chain. According to the invention, the data reading efficiency can be improved.

Description

technical field [0001] The present invention relates to the field of big data, in particular to a data reading method, device, electronic equipment and computer-readable storage medium. Background technique [0002] With the development of big data, data reading has become an indispensable process. The data reading can be understood as obtaining the data needed by the business side from the data source. For example, in the process of user location analysis, how to read efficiently It is particularly important to extract the user's label data to realize user analysis. [0003] At present, data reading is usually based on the big data platform as the calculation method to pull the required data from the data source, but this method is prone to single-node performance problems, that is, the data will be in a serial state during the reading process. In this way, it is easy to cause the local loading of data reading to take a very long time, which will affect the efficiency of d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/242G06F16/22G06F16/27
CPCG06F16/2433G06F16/2228G06F16/27
Inventor 魏勇楚克明甘琪秦斌
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap