33results about How to "Efficient data storage" patented technology

The present application provides a power network security monitoring method and system based on ELK log collection and analysis. The method comprises the following steps: adopting a centralized log management method to collect a network security equipment log of a power monitoring system; Filtering, normalizing and storing the collected network security equipment logs of the power monitoring system; Using the distributed log retrieval method, the stored logs are retrieved and counted; displaying the log data in a summarized manner. The electric power network security monitoring method and system based on ELK log collection and analysis provided by the application adopts a cluster mode, data storage, query is efficient and fast, realizes real-time log monitoring and storage, and meets log storage requirements; and through the visualization mode for log display, friendly interface, simple and easy to use, log analysis rules can be customized to facilitate staff real-time monitoring of network security events, improve the network security monitoring level of power monitoring system.

The invention discloses a log storage method and a log storage system. The log storage method comprises the following steps: after receiving log data, a program starts a data receiving thread for datatransmission; Receiving the transmitted data and performing queue processing; invoking The data after the queue processing is stored in the form of multi-node shunt. The log storage method of the invention is convenient for programs to call and process log data, reduces data packet loss, enhances service high availability, and realizes efficient data storage and extremely strong expansion.

The invention discloses a large-scale knowledge graph storage scheme based on a distributed key value library. A "KG over SQL" unified storage scheme or a "KG over KV" unified storage scheme is adopted; the unified storage scheme of "KG over SQL" comprises the following steps: reading knowledge graph data; extracting metadata in the mapping knowledge domain, and generating a corresponding SQL statement; extracting data in the knowledge graph, storing the data in a data structure, and generating a corresponding SQL statement; executing an SQL statement through an external SQL interface of the Cockroach DB database, and establishing a relation table; mapping the data in the relation table into a key value pair form by using an original data coding mapping scheme in a Cockroach DB database, and storing the data in a Cockroach DB bottom layer; By means of the "KG over KV" unified storage scheme, knowledge graph data are read, a knowledge graph is converted into a graph containing index nodes, index node graph data are stored in a data structure, and the data are mapped into a key value pair form through an optimized data coding mapping scheme and stored in a Cockroach DB bottom layer. According to the method, efficient data storage compatible with the RDF graph model and the attribute graph model can be realized.

The invention belongs to the technical field of data processing, and discloses a verifiable deletion method and system supporting efficient update of outsourcing data, and the method comprises the steps that a data owner encrypts a file to protect sensitive information in the file, and outsources a ciphertext to a cloud server; the cloud server maintains the received data and returns a storage evidence, and the storage evidence is used for verifying a storage result; the data owner sends an updating request to the cloud server, and the cloud server updates the data according to the updating request and returns updating evidences; the data owner can verify whether the data is correctly updated or not; if the data is not needed any more, the data owner sends a data deleting command to the cloud server to delete the data; the cloud server executes deletion operation and returns deletion evidences; and the data owner can verify the deletion result according to the returned deletion evidence. Verifiable data storage and deletion and efficient data updating can be realized at the same time, and public verifiability can be realized without any trusted third party.

A frame memory successively stores post-filter data in such a manner that 1-column / 1-row pre-filter data extending along the right and lower sides of each block are not overwritten by the post-filter data. Thus, the frame memory stores both the post-filter data used for inter-prediction and the pre-filter data remaining for intra-prediction of a next block. The inter-prediction and the intra-prediction can be simultaneously executed based on the data stored in the frame memory.

The invention discloses a multi-sensor fusion road extraction and indexing method based on global and local grid maps, which uses global and local grid maps for data storage and preprocessing, and obtains the real-time position and attitude of unmanned vehicles through a differential positioning system , Obtain high-precision road boundaries, lane lines, and road sign position information through the lidar point cloud related data stored in the raster image, and project them into the monocular vision image, judge the lane line type and recognize the road sign based on the deep learning method Semantic information, so as to obtain high-precision road maps with semantic information. At the same time, multiple global sections and road sets are established to achieve efficient storage and indexing.

The invention provides a parallel computing hardware structure based on a separation and combination thought, which comprises a plurality of first parallel computing units, a plurality of second computing units, a task dispatcher used for controlling a plurality of the first parallel computing units and a plurality of the second parallel computing units, a global memory used for storing global data, a local memory for storing intermediate results computed by a plurality of the first parallel computing units and providing the intermediate results to a plurality of the second computing units after starting computation, and a data controller used for providing data for a plurality of the first parallel computing units and the task dispatcher. By adopting the hardware structure applied in parallel computing and provided by the embodiment of the invention, design thoughts such as dispatching, synchronizing and communicating can be effectively covered, so a designer can directly focus on the description of a computation part of an algorithm, thus reducing design complexity of a parallel circuit and shortening circuit design and realization time to a large degree.