Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data storage method and device, data query method and device, equipment and medium

A data storage device and data storage technology, applied in file metadata retrieval, file access structure, file system, etc., can solve the problems of low operation efficiency and operation, and achieve the effect of reducing the amount of operation data

Active Publication Date: 2020-05-19
HANGZHOU HIKVISION DIGITAL TECH
View PDF12 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the present invention provides a data storage and data query method, device, equipment, and medium to solve the problem of low operating efficiency caused by the inability to operate on the data of the time period of interest

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and device, data query method and device, equipment and medium
  • Data storage method and device, data query method and device, equipment and medium
  • Data storage method and device, data query method and device, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present invention. Rather, they are merely examples of apparatuses and methods consistent with aspects of the invention as recited in the appended claims.

[0062] The terminology used in the present invention is for the purpose of describing particular embodiments only and is not intended to limit the invention. As used herein and in the appended claims, the singular forms "a", "the", and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood that the term "and / or" as use...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data storage method and device, a data query method and device, equipment and a medium, and the method is applied to electronic equipment and comprises the steps: determininga target time interval where to-be-stored target data is located according to a target timestamp; sending the target time interval to a spark engine loaded by the device, so as to enable the spark engine to obtain target data from a spark data file according to the target time interval and convert the target data into a target elastic distributed data set RDD; and obtaining a target RDD from the spark engine, and storing the target RDD in an RDD cache space corresponding to the spark engine. The problem that the operation efficiency is low due to the fact that operation cannot be conducted onthe data in the interested time period is solved.

Description

technical field [0001] The present invention relates to the technical field of distributed data processing, in particular to a data storage and data query method, device, equipment, and medium. Background technique [0002] Spark is a fast and general-purpose distributed computing engine. Spark Streaming is an extension of the Spark core API for scalable, high-throughput, and fault-tolerant processing of online stream data. Spark Streaming can obtain data in batches from data sources in real time, and the obtained data is recorded in spark data files. In order to facilitate data query and other operations, the data in the spark data file needs to be processed and stored accordingly. [0003] In the related data storage method, the spark engine uses its own fixed logic execution method to realize data storage. Specifically, the spark engine reads the data within the specified time window from the spark data file, and then stores the data and other operations. [0004] Since...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/13G06F16/14
CPCY02D10/00
Inventor 李森郭峰陈小龙
Owner HANGZHOU HIKVISION DIGITAL TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com