Data storage method and device, storage medium and server

A data storage and data technology, applied in the field of data processing, can solve the problems of long time and data unavailability for a long time

Pending Publication Date: 2021-03-30
RUN TECH CO LTD BEIJING
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

As the amount of data grows, after batch processing the full amount of data and extracting the association relationship, the time required to store the full amount of data will become longer and longer; and the method of clearing the existing data first and then storing the full amount will lead to long data storage. time unavailable

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and device, storage medium and server
  • Data storage method and device, storage medium and server
  • Data storage method and device, storage medium and server

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0027] figure 1 It is a schematic flow chart of the data storage method provided by the embodiment of the present invention. This method is applicable to the situation where the server stores data and can be executed by a data storage device. The device can be implemented by software and / or hardware, and generally can be integrated in the server middle. Such as figure 1 As shown, the method includes:

[0028] S101. Acquire target data; wherein, the target data includes at least one piece of external input data and at least one piece of local storage data.

[0029] Wherein, the external input data is data to be stored, the external input data may be data transmitted from other servers or terminal devices, and the local storage data has been stored in the local database. Optionally, acquiring target data includes: reading at least one piece of external input data and at least one piece of locally stored data from the distributed file system based on different path information...

Embodiment 2

[0044] figure 2 It is a flowchart of a data storage method provided by Embodiment 2 of the present invention, such as figure 2 As shown, the method includes the following steps:

[0045] S201. Read at least one piece of external input data and at least one piece of locally stored data from the distributed file system based on different path information respectively.

[0046] S202. Determine at least one key field involved in the target data, and use any one key field in the at least one key field as the target key field.

[0047] S203. Group the target data based on the target key field; wherein, group the target data corresponding to the same field information as the target key field.

[0048] S204. For each set of target data, fill in the target data with empty field information based on the non-empty field information corresponding to the same key field, and add identification information whether the target data is changed data according to the filling operation; wherei...

Embodiment 3

[0059] image 3 It is a schematic structural diagram of a data storage device provided in Embodiment 3 of the present invention. Such as image 3 As shown, the device includes: a data acquisition module 301, a field filling module 302, a data merging module 303 and a data storage module 304, wherein:

[0060] A data acquisition module 301, configured to acquire target data; wherein, the target data includes at least one piece of external input data and at least one piece of local storage data;

[0061] The field filling module 302 is used to fill in the target data whose field information is empty based on the non-empty field information corresponding to the same key field, and add identification information of whether the target data is changed data according to the filling operation; wherein, the field The target data whose information is empty is the same as the field information corresponding to other key fields of the target data to which the non-empty field information...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a data storage method and device, a storage medium and a server. The method comprises the steps of obtaining target data; filling in target data with null field information based on the non-null field information corresponding to the same key field, and adding identification information about whether the target data is changed data or not to the target data according to the filling operation, wherein the field information of the target data with null field information is the same as the field information corresponding to other key fields of the targetdata to which non-null field information belongs; merging the target data with the same field information corresponding to all the key fields in the target data after the filling operation is executed, and determining the type information of the merged target data according to the identification information and the source of each piece of target data in the merged target data; and storing the merged target data according to the type information. Through the scheme, the resource consumption of data storage can be reduced, and the availability of locally stored data during data storage is ensured.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of data processing, and in particular, to a data storage method, device, storage medium, and server. Background technique [0002] With the development of computer technology, the amount of data that the system needs to process has been increasing, and the correlation between the data that needs to be extracted is also increasing. As the amount of data grows, after batch processing the full amount of data and extracting the association relationship, the time required to store the full amount of data will become longer and longer; and the method of clearing the existing data first and then storing the full amount will lead to long data storage. Time is not available. Contents of the invention [0003] Embodiments of the present invention provide a data storage method, device, storage medium, and server, which can reduce the resource consumption of data storage and ensure the avail...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/23
CPCG06F16/2282G06F16/23
Inventor 张超万月亮火一莽
Owner RUN TECH CO LTD BEIJING
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap