197results about How to "Improve storage space utilization" patented technology

The invention discloses a file processing method, which comprises the following steps of: encoding a file into a plurality of data blocks by utilizing an erasure code algorithm, and storing the plurality of data blocks in at least two storage nodes which at least comprise storage nodes in a distributed file system; wherein one data block is only stored once; and storing the file index of the file,the respective storage address of each data block in the plurality of data blocks and the hash value related to the file in a block chain network. Therefore, the data redundancy is greatly reduced, higher data reliability is obtained with lower data redundancy, and the utilization rate of the storage space is improved. Moreover, the method adopts a mode of combined storage of the block chain network and the out-of-chain distributed storage system, so that the storage pressure of the block chain network is reduced, and the storage capacity is expanded by introducing the distributed file system. The invention further discloses a file processing device, equipment, a medium and a computer program product.

Provided is a symmetrical searchable encryption method for supporting result high-efficiency sequencing in hybrid cloud storage. A hybrid cloud storage system based on a data owning party, a data retrieving party, a private cloud platform and a public cloud platform is involved in the steps of design file preprocessing, security packing, file security storage, security inquiring and sequencing ciphertext retrieving, and the security packing and high-efficiency retrieving of a mass of file sets are organically integrated. Dual-layer security indexes are established to serve high-efficiency sequencing of ciphertext retrieving, and operations of adding, deleting, inquiring and changing dynamic indexes can be supported; the retrieving history and retrieving interests of a data user serve as subjective characteristics of ciphertext search sequencing and participate in the sequencing computation of retrieving results; the file uniqueness testing step is added to the file preprocessing step, and therefore a data repetitive deletion redundancy mechanism is achieved, the high efficiency of packing the file sets of the data owning party is ensured, and the technical support is provided for increasing the utilization rate of storage space of public cloud.

The invention discloses an improved method for achieving copy-on-write (COW) snapshot, which comprises the following steps: setting up the bitmaps for a source data area and a snapshot area, wherein each bit in the bitmap corresponds to N data blocks; and indicating that data are written in the corresponding data blocks if the bit is valid, and if not, indicating that the data are not written in the corresponding data blocks, wherein N represents a natural number. Based on the bitmaps for the source data area and the snapshot area, the following functions can be performed: when a writing request is received by the source data area, whether the corresponding data blocks are required to be copied to the snapshot data area is judged, and the copy operation is carried out only when necessary. The invention further discloses an improved device for achieving the copy-on-write snapshot. The improved scheme provided by the invention is capable of directly responding to most writing request of a host computer instead of copying the data blocks to the snapshot data area. By making the improvement, the invention can reduce the delay in the writing request of a user, reduce the size of the snapshot citation index and the snapshot data area and increase the utilization rate of the memory space.

The invention provides a data processing method based on a distributed storage system. The method comprises the following steps: defining a compressed configuration item that comprises at least a compression mode, off-line compression start time and off-line compression termination time; when to-be-processed data is written in, using a client or a server, or the client and the server to successively perform chain type compression processing on the to-be-processed data, and determining the time of the server intervening to perform the chain type compression processing only in the off-line compression mode according to the off-line compression start time and the off-line compression termination time; when the to-be-processed data is read, at least enabling the client to perform chain type decompression processing; after the chain type compression processing or the chain type decompression processing is performed, responding to an opposite end device through a network. After the data processing method based on the distributed storage system is used, the bandwidth utilization rate is increased, the memory space is saved, the data reconstruction speed is accelerated, and the data handling capacity of the distributed storage system is improved when a write operation or read operation is performed.

The invention provides a file cleaning method. The file cleaning method comprises the following steps of receiving a file cleaning instruction of a user; scanning a file stored in a storage card of a mobile terminal so as to extract feature information of the file according to the file cleaning instruction; sending the feature information of the file to a cloud-side server; receiving file information fed back by the cloud-side server, obtained by the cloud-side server according to the feature information of the file and matched with the feature information; determining cleanable files in the file according to the received file information; cleaning the determined cleanable files. By means of the file cleaning method, the cleanable files in the storage card can be looked up and cleaned and can be thoroughly cleaned, and cleaning efficiency is high. The invention further provides a file cleaning device, the mobile terminal and the cloud-side server.

The invention provides a data storage method and system. The method comprises the following steps of: dividing each stored file into a data segment with a preset size; generating unique identification information corresponding to the data segment for each divided data segment, wherein the identification information is used for carrying attribute information corresponding to each data segment; comparing the content of each data segment, and finding out repetitive data; grouping two or more than two portions of data with the same content; keeping one data for the repetitive data of each group, and storing a physical storage position of the portion of data as redundant data watermarks of the other portions of data in the group; and if one data segment has the repetitive data, replacing the repetitive data in the data segment with the redundant data watermarks of the repetitive data. The method benefits the saving of space resource of the data on a physical storage entity, thereby improving the efficiency and safety of remote data replication.

The invention discloses an intelligent sample storage cabinet system. The system comprises a sample storage unit for storing samples, a sample storage / taking movement unit for shifting the samples, and an intelligent control unit; the sample storage unit includes multiple storage bins arranged in an array form; the sample storage / taking movement unit includes a pneumatic manipulator mechanism; the pneumatic manipulator mechanism is provided with a storage cavity and a negative-pressure production component; and after an opening end of the storage cavity is tightly connected with opening ends of the storage bins, the negative-pressure production component extracts air in the storage cavity and the storage bins to form vacuum negative pressure so as to suck the samples in the storage bins to the storage cavity. The system has the advantages of high space utilization rate, high intelligent modular degree, capability of synchronously storing and taking one or more samples and safe and efficient sample storage and taking.

The invention relates to a splicing method and a splicing system for a HTTP real-time streaming media fragment. A splicing device splices data of transmission stream (TS) fragment files introduced in an HLS sub index file, and one or more media file is obtained; a modifying device modifies the HLS sub index file, and the media file where each introduced TS fragment file is located and the position information in the media file are recorded in the modified HLS sub index file. Through splicing the HLS fragments and correspondingly modifying the HLS sub index file, the system supporting the HLS protocol can be better implemented, pressure on the file system is reduced, the storage space utilization rate of the system is improved, the magnetic IO speed is improved, and the content distribution efficiency among CDN nodes can be improved.

Provided are an intelligent integrated monitoring and controlling system and a surveillance video processing method. Entrance guard attendance checking, video monitoring, and office computer screen, office mobile phone and office vehicle monitoring are comprehensively provided in a group. A group personnel management database is shared and correlated. Under the same bottom layer operation system, storing system, certification system, communication system and warming system, office computer screen video and camera shooting monitoring video are synthesized, then a cloud storage center is used for carrying out real-time big data storing, data are processed into video images which can be recognized by a machine, a retrieval tag is attached, various aspects of monitoring information are cooperated for quick retrieval, and retrieval and storage efficiency is effectively improved. For large-data-number video data, after maximum-frequency using time, the video data are subjected to local depth compression storage, original video data are reserved through cloud storage, corresponding data can be transmitted back through cloud storage at any time when needed, and the problems that local storage resources are limited, and large-data-number video retrieval is difficult are solved.

The invention relates to a placing method of a hot data copy in a cloud storage system. The placing method of the hot data copy in the cloud storage system comprises the following steps: classifying the files through the reading and writing numbers; and selecting appropriate files with higher hot to increase the number of copies to balance the load of the storage nodes. By means of the placing method of the hot data copy in the cloud storage system, the communication cost of the internal system is reduced, and the overall performance of the cloud storage system is improved. The principle of the placing method of the hot data copy in the cloud storage system is making a record according to the access condition in a recording period, and adding additional temporary copies according to the appropriate hot files selected from the records. The placing method of the hot data copy in the cloud storage system disclosed by the invention can effectively control the consumption caused by the sharp rise of the hot of part files when the extra cost is avoided as much as possible.

Embodiments of the invention disclose a method and device for multiplexing electronic equipment on the basis of multiple accounts as well as the electronic equipment. The method comprises the following steps: receiving an application program privacy setting request and setting an application program locking password for an application program, wherein the set application program locking password is associated with a user account; setting privacy data for one or more application programs mapped by the user account; receiving an application program locking password input by a user when accessing to the application program, and if the input application program locking password is same as any application program locking password in a preset application program locking password set, entering the accessed application program according to a user account mapped by the input application program locking password, and calling the privacy data of the accessed application program mapped by the mapped user account. Through applying the method and device as well as the electronic equipment disclosed in the invention, the storage space utilization rate of the electronic equipment can be enhanced.

The invention discloses a data processing method and device applied to a data warehouse, and relates to the technical field of computers. The data processing method includes the specific steps that real-time data is received, and historical data related to the real-time data is determined; a file of the historical data is determined, and the real-time data is transmitted to a real-time data layerof the file; a version of the real-time data and a version of the historical data are obtained respectively, real-time data or historical data of the latest version is extracted and serves as the latest data record of the file, and the latest data record is written into a historical data layer for record updating. According to the data processing method and device in the embodiment, combination between a traditional data warehouse and a real-time computing technology is achieved, the ETL timeliness of the data warehouse is improved, and the requirement when a user conducts real-time-data queryanalysis is met; in addition, based on existing off-line data, the development cost of real-time computing of the data warehouse can be reduced, and the business requirement of the data warehouse isbetter met.

The invention discloses a content delivery method, a content delivery device and a content delivery system, and relates to the technical field of communication. The problem that an edge cache server is overloaded due to too many accesses in the prior art is solved. The content delivery method comprises the following steps: a first center node acquires to-be-delivered content in a first content delivery network CDN and operation statistical data in a second CDN, wherein the operation statistical data is statistical data of accesses to the to-be-delivered content in the second CDN, and the first center node belongs to the first CDN; the first center node gets the delivery result of the to-be-delivered content according to the operation statistical data and status information of all edge nodes in the first CDN, wherein the delivery result includes at least one determined to-be-delivered edge cache server and content needing to be delivered to each to-be-delivered edge cache server; and the first center node delivers content needing to be delivered to each to-be-delivered edge cache server in the to-be-delivered content to the to-be-delivered edge cache server according to the delivery result.

The invention discloses a method and a system for reducing garbage collection and write amplification of a key-value separation storage system, and belongs to the field of computer storage, the systemcomprises a memory, an NVM and an SSD; and a first storage area and a second storage area in the NVM manage data according to an LSM-tree and a memory pool respectively; the method comprises the steps of judging whether the size of a to-be-inserted key value pair is greater than or equal to a first threshold value or not, if so, inserting the key value pair into the second storage area, and theninserting a key and a key value address into LSM-tree; otherwise, directly inserting the key value pair into LSM-tree; when the key value pair in the memory pool is deleted, marking the correspondingstorage unit as an idle memory unit; when the data volume in the second storage area is higher than a second threshold value, brushing down the key value pair with the least frequent access to the SSD, and updating the storage address of the key value pair; and setting a flag bit segment on the NVM, and identifying the validity of the key value pair of the data segment on the SSD. Garbage collection and write amplification of the key value storage system can be reduced, and the overall performance of the key value separation storage system is improved.

Embodiments of the invention provide a data storage method and device, a data storage system and a readable storage medium. The method comprises the following steps of: firstly, receiving to-be-storeddata sent by a client, and writing the to-be-stored data into a copy storage pool to carry out copy storage; secondly, when the to-be-stored data is successfully written in the copy storage pool, sensing a data writing success response to the client; and finally, sending at least a part of data stored in the copy storage pool to an erasure code storage pool and storing the part of data through erasure codes. According to the method, the to-be-stored data is firstly written into the copy storage pool with a high storage speed so as to ensure that the client can receive the data writing successresponse in time, so that favorable experience of high data storage speed is provided for the users; and meanwhile, data in the copy storage poo is sent to the erasure code storage pools to be stored, so that the data storage redundancy can be reduced, and the data storage space utilization rate can be improved.

The invention discloses an adjustable adaptive high-capacity intelligent express item case capable of automatically achieving storage and picking of express items. The express item case includes a case body and a manipulator arranged at the rear end of the case body; a storage and picking window is formed in the case body; a conveyor belt is arranged at the bottom of the storage and picking window, and a detection unit is arranged on the top and used for detecting the size of the express items; a bracket is arranged in the case body; multiple columns of storage boxes for storing the express items are also arranged in the case body; clapboards are detachably connected to the case body; each storage box is separated by a clamping groove; a retractable mechanism is arranged in the storage andpicking window and connected to a push plate; after the detection unit detects the size of the express items during storage of the express items, the manipulator moves to grasp trays on the bracket and conveys the trays to the rear end of the conveyor belt, and the conveyor belt conveys the express items onto the trays; then, the manipulator conveys the trays on which the express items are placedinto the corresponding storage boxes, and the trays are placed into different clamping grooves respectively; during picking of the express items, the manipulator grasps the trays and moves the traysinto the storage and picking window, and after the express items are placed on the trays, the trays are put back onto the bracket by the manipulator. The spatial utilization rate of the express item case is high, and convenience is provided for users to pick and store the express items.

The invention discloses a distributed file system oriented to access and application of multiple data types. A master node of the distributed file system comprises various kinds of metadata wherein each kind of metadata comprises a metadata hash table and a corresponding metadata control structural body. Every kind of metadata corresponds to the corresponding data type, and the data types are classified according to the access characteristics of the data. Every kind of metadata control structural body is used for conducting classified management according to the corresponding data type. When the system receives an application program accessing request, the metadata control structural body of the corresponding type is determined according to the type of files needing to be accessed in the application process accessing request, the information of the metadata control structural body of the corresponding type is returned to an application program, and therefore the application program can conduct corresponding file operation on a corresponding data storage node according to the control information. According to the distributed file system oriented to access and application of the multiple data types, the data retrieval speed is doubly improved, the load capacity of the system is obviously improved, and the scalability is good.

The invention discloses a relational database encryption method and an encrypted database query method, and the method comprises the steps of building a data encryption scheme in a safety agent; enabling a user to select the encryption security level of to-be-encrypted plaintext data at a client and then to send the to-be-encrypted plaintext data to be transmitted to the safety agent; and enablingthe safety agent to encrypt the plaintext data to be encrypted according to the data encryption scheme and the encryption security level to obtain ciphertext data, sendiing the ciphertext data to a server, and storing a key in the security agent. By means of the mode, the encryption time can be greatly shortened, the data encryption efficiency and the storage space utilization rate are improved,the data safety is guaranteed, a safety agent mechanism is introduced, a safety agent only needs to decrypt a query result once during data query, decryption does not need to be conducted at a serverside, and the query efficiency and the data security are improved.

The invention discloses an article ex-warehouse method and device, and relates to the technical field of computers. A specific implementation mode of the method comprises the following steps: determining an ex-warehouse strategy of articles in a to-be-ex-warehouse task according to a working state of carrying equipment, a working state of a workstation and a storage distribution state of the articles in the to-be-ex-warehouse task; determining an ex-warehouse storage medium of the article in the to-be-ex-warehouse task according to the ex-warehouse strategy; determining carrying equipment matched with the ex-warehouse storage medium according to a preset matching strategy; and carrying the ex-warehouse storage medium to a workstation corresponding to the to-be-ex-warehouse task through carrying equipment matched with the ex-warehouse storage medium to carry out article picking so as to ex-warehouse the picked articles. According to the method, the corresponding ex-warehouse strategy can be automatically adopted according to the busy and idle conditions of hardware resources, so that the cellular inventory is reduced under the condition that the ex-warehouse efficiency is not influenced, and the warehouse storage space utilization rate is increased.

The invention aims at providing a delivering device, self-service equipment and a control method of the self-service equipment. The delivering device comprises a box body, and the box body comprises opposite front opening and rear opening; the front opening is communicated with the rear opening to form an article delivering channel; a gate is arranged in the rear opening and is used for closing oropening the rear opening. By means of the delivering device, the self-service equipment and the control method of the delivering device, the problem in the prior art that the storage space of the self-service equipment is low in utilization rate can be solved.

The invention provides an intelligent-card data storing method and device and an intelligent card. The method includes the steps that the intelligent card receives an application data package sent by a reliable service platform, wherein the application data package comprises method assembly data; the intelligent card obtains assembly identification information corresponding to the method assembly data, wherein the assembly identification information comprises application identifiers of the application data package and checking values of the method assembly data; the intelligent card compresses the method assembly data with the data compression algorithm; the intelligent card stores compressed recorded information and the compressed method assembly data, wherein the compressed recorded information comprises the assembly identification information, the storage addresses of the compressed method assembly data and the length of the compressed method assembly data. By means of the intelligent-card data storing method and device and the intelligent card, the storage space occupied by application data can be reduced, and the utilization ratio of the storage space of the intelligent card is increased.

The invention provides a data storage system and data storage method based on hybrid cloud storage. The system comprises a dynamic public cloud monitoring module for dynamically monitoring performancedifference of various public clouds and selecting the public cloud with the optimal performance; a hot-cold data distinguishing module for separating cold data from hot data; a storage scheduling module for controlling all storage operations; a user access interface module for transmitting a user storage request; a redundancy encoding module for encoding / decoding data needing to be uploaded / downloaded; a hybrid cloud storage resource access module for providing a unified hybrid cloud storage service access interface; a metadata management module for providing metadata information of the data;a safety encryption / decryption module for encrypting / decrypting the data. Through the system provided by the invention, the system storage performance is improved while the user storage demand is guaranteed, the overall storage cost of the hybrid cloud storage is reduced, and a set of efficient hybrid cloud storage system is realized.

The invention discloses a CAPWAP-based shared key using method and device. The method is applied to a CAPWAP communication process between a plurality of APs and an AC; random number resource pools are pre-distributed to the AC and the APs so that the AC and the APs are capable of choosing random numbers from own resource pools and calculating own DTLS encryption / decryption keys using the corresponding random numbers; when the DTLS encryption / decryption key of each AP is stored in an AC terminal chip, the same key index value is distributed to the APs having the same key, thereby realizing that the same DTLS encryption / decryption key can be shared by a plurality of APs; as a result, the area, power consumption and cost of the AC chip can be reduced and the network security is also guaranteed.

The invention relates to a temporary contact person management method and system. The method comprises the steps of establishing a temporary address book by a mobile terminal; adding a certain temporary number to the temporary address book; judging whether to set a valid period for the temporary number or not; setting the valid period for the temporary number if it is judged that the valid period needs to be set for the temporary number; detecting whether current system time reaches the valid period or not in real time; and deleting the temporary number when it is detected that the current system time reaches the valid period. According to the method and the system, the storage space of the mobile terminal is saved by establishing the temporary address book, setting the valid period for the temporary number and deleting the temporary number exceeding the valid period, and the utilization rate of the storage space is improved.

The invention discloses a secure deletion method for data in a solid-state disk on the basis of a flash memory. The characteristic that multiple data channels in the solid-state disk can be operated in parallel is utilized, an improved secrete sharing scheme is adopted to conduct conversion processing on data, and encoded data is distributed to all the data channels; on one hand, data redundancy is guaranteed through encoding, the converted data is ciphertext, and the reliability and the security of the data are improved; on the other hand, the error-resilient encoding characteristic is utilized, covering on the whole data is not needed any more for deletion of the data, partial data is deleted, the data integrity is destroyed, and the data cannot be recovered. Even though an attacker obtains partial encoded data, the attacker cannot obtain plaintext, and the purpose of securely deleting the data is achieved. By means of the secure deletion method for the data in the solid-state disk on the basis of the flash memory, the data storage security problems that storage of the solid-state disk is unreliable, and files cannot be deleted securely are solved.

The invention discloses a traceability anti-channel conflict system and method based on the Internet of Things and a block chain. The system comprises an SAAS service module, a block chain alliance chain platform and a traceability terminal device. The traceability terminal device is internally provided with a GPS antenna, a GSM antenna, a GSM module, a GPS positioning module, an MCU module, a charging management module, a battery module, an activation trigger switch, an RFID tag, an NFC tag and a two-dimensional code identification module. The GPS antenna and the GMS antenna are respectivelyconnected with the GSM module and the GPS positioning module; the MCU module is connected with the GSM module, the GPS positioning module, the charging management module, the activation trigger switch, the RFID tag, the NFC tag and the two-dimensional code identification module, and the charging management module is connected with the battery module. According to the invention, through the uniqueidentification of the traceability device for the product, one object and one code can be truly realized, one-to-one correspondence between physical world commodities and the system is realized, collection of track data of the commodities from delivery to use is realized, and channel conflict sales is prevented.

The invention discloses a warehouse video monitoring system based on edge computing. The warehouse video monitoring system comprises a monitoring acquisition terminal module, an edge node module, a peripheral network transmission module and a terminal control end display module which are connected in sequence, and the system also comprises a power supply module supplying power to each module. By migrating the analyzed and processed task to the edge node module, on the premise of ensuring the data reliability, a large amount of real-time edge data generated by the monitoring acquisition terminal module in a short time is preprocessed, so that the video analysis speed is improved, the processing and transmission time delay is reduced, and the real-time performance of the monitoring video stream is ensured. Meanwhile, an improved two-frame difference method and projection method fused algorithm is applied to detect the moving object, and the moving object is stored only when the moving object is detected in the monitoring picture, so that the credibility of evidence information is enhanced, the storage space utilization rate of video data is improved, and a large amount of storage space is saved.

The invention discloses a Delta compressed storage component based on block-level data de-duplication. The Delta compressed storage component comprises a container access module. The container accessmodule uses the similar index, the similar buffer and the container buffer data structure to run the container storage algorithm and the container recovery algorithm. The container storage algorithm receives the block-level data of the upper layer to rewrite the writing container command sent from the storage system, compresses the container by Delta, and writes the container compressed by Delta into the container storage pool on the disk. The container recovery algorithm receives the block-level data of the upper layer to re-store the read container command sent from the storage system, readsthe specified container from the container storage pool on the disk through the container index, and returns the read container to the block-level data of the upper layer to re-store the storage system. The component of the invention can perform Delta compression on similar data blocks, eliminate byte-level duplicate data, and further improve the deletion ratio of duplicate data and the utilization ratio of storage space.

The invention discloses a distributed storage system heterogeneous acceleration method. The method comprises the steps that a client divides to-be-stored data into blocks and sends the blocks to datanodes; the data node calls the FPGA heterogeneous acceleration unit to input the data block into the data compression unit; the data compression unit compresses the data block and stores the compressed data block in a storage disk. The invention further discloses a distributed storage system. The method and the system can meet the system performance and improve the storage space utilization rate.