35results about How to "To achieve deduplication" patented technology

The invention discloses a cloud data duplication elimination and integrity auditing method based on convergence encryption. According to the method, through adoption of a convergence key encapsulation / de-encapsulation algorithm based on blind signatures, convergence keys can be securely stored and moreover convergence key duplication elimination can be realized; and through utilization of a BLS signature algorithm based on the convergence keys, auditing public keys are stored by a trusted third party TTP, the TTP carries out proxy auditing, and duplication elimination of auditing signatures and the auditing public keys is realized. The method comprises the specific steps of carrying out system initialization; carrying out key initialization; carrying out file initialization; carrying out authentication evidence initialization; carrying out key encapsulation; carrying out data storage; carrying out duplication challenge; carrying out duplication response; carrying out duplication authentication; carrying out request auditing; carrying out proxy auditing; carrying out auditing response; carrying out auditing authentication; and carrying out file downloading. According to the method,a utilization rate of a cloud storage space is improved, the duplication elimination of auditing signatures and the auditing public keys is realized, and the storage and computing cost of a client arereduced.

The invention relates to an online transaction message deduplication method and device, a medium, a product and equipment. And caching a message de-reconfiguration list in a key value pair database, and storing a hash value corresponding to a specified primary key value of the received online transaction message by using a first bit vector table in a first vector table filter. When an online transaction message is newly received, the message deduplication configuration list is obtained from the key value pair database, and a corresponding message deduplication index primary key is determined. And determining whether the first hash value corresponding to the primary key value is stored or not, and if the first hash value is determined to be stored, indicating not to process the new online transaction message so as to realize message de-duplication. Due to the fact that the key value pair database can provide the message deduplication configuration list with low delay and high response speed, and the vector table filter can achieve quick search of the bit vector table, the timeliness of message deduplication can be effectively guaranteed.

The invention provides monitoring video file generation and playing methods and devices and terminal equipment. The monitoring video file generation method comprises the steps of: acquiring a real-time video frame shot by a monitoring camera; inquiring a prior video frame consistent with the real-time video frame in a de-duplicated video frame set; if the prior video frame consistent with the real-time video frame is not inquired, storing the real-time video frame into the de-duplicated video frame set, and recording a mapping relationship between playing time and the real-time video frame ina playing index; if the prior video frame consistent with the real-time video frame is inquired, abandoning the real-time video frame, and recording a mapping relationship between the playing time andthe prior video frame in the playing index; and according to the de-duplicated video frame set and the playing index, generating a monitoring video file. According to the invention, a size of the monitoring video file can be reduced, and duration of a storable monitoring video is prolonged.

The present application provides a data transmission method and device, and a readable storage medium. In this data transmission method, on the one hand, the proxy server detects the corresponding interface function for the request data of the business system, and performs deduplication processing on the request data of the interface with the same function, and then transmits it; or for the functions that need to be excluded On the other hand, the response data of the business system is detected for sensitive information, and the response data containing sensitive information is desensitized and then transmitted. Realize information desensitization of business systems. Therefore, the data transmission method can realize functional desensitization of the business system and improve the security of data transmission in the business system.

The invention discloses an outsourced data deduplication cloud storage method supporting privacy and integrity protection. First of all, the deduplication of data files on the client side and the deduplication of security authentication tags are realized, which greatly reduces the communication overhead and the storage burden of the cloud server. Secondly, the use of extractor technology makes the ciphertext of the outsourced stored data not depend on the encryptor and encryption algorithm, but on the data itself, so that the deduplication of ciphertext data can be realized, and the deduplication process and integrity audit process are guaranteed. Data Privacy. Finally, RS erasure coding technology is used to improve the fault tolerance of deduplication cloud storage, and it also supports cloud service providers to spontaneously and regularly entrust third-party auditors to conduct batch public cloud audits of data stored in cloud servers to ensure data integrity. At the same time, it also supports data owners to initiate public cloud audits on the integrity of files anytime and anywhere, and can always protect the privacy of data during the audit and deduplication process. The method provided by the invention is effective in deduplication and efficient in integrity cloud auditing.

The embodiment of the present invention discloses a data deduplication method, device, electronic equipment, and computer-readable storage medium. The method includes: obtaining a data container to be processed; The data container whose data similarity meets the preset condition is used as the target data container; the data container to be processed is compared with the target data container, and duplicate data is confirmed and deleted in the post-processing process. This technical solution can realize deduplication of massive data on a global scale, and achieve the purpose of saving storage space without reducing user IO performance.

The embodiment of the invention provides a safe and reliable multi-party data deduplication system, method and device, which are applied to the field of data processing, and the system comprises a data processing end and at least two data providing ends. And the data processing end is used for sending a data request for requesting the object data of the target object to each data providing end. And the data providing end is used for receiving the data request sent by the data processing end. And the object data of the target object is obtained in the locally stored object data. And conversionprocessing is performed on the object data by adopting a preset data conversion mode to obtain converted object data. And the converted object data is sent to a data processing end. The data processing end is used for receiving the converted object data sent by each data providing end; and repeated data in the received converted object data is determined to obtain a repeated data set. And other data in each repeated data group is removed. By applying the scheme provided by the embodiment of the invention, repeated data in the object data can be removed.

The invention relates to a resource processing method and device, electronic equipment and a storage medium, relates to the technical field of information processing, and aims to at least solve the problem of low accuracy when a social platform performs duplicate removal on video resource recommendation in related arts. The method comprises the following steps: acquiring identification information of candidate resources; according to the generation time of the candidate resources, progressively increasing the identification information corresponding to the candidate resources; under the condition that the identification information of the candidate resources is not stored in the identification information set, comparing the identification information of the candidate resources with the minimum value of the identification information corresponding to the hash value in the filter; when the identification information of the candidate resource is greater than or equal to the minimum value of the identification information corresponding to the hash value in the filter, determining whether the identification information of the candidate resource is stored in the filter; and under the condition that the identification information of the candidate resource is stored in the filter, determining that the candidate resource is not used as the recommended resource of the target account.

The embodiment of the invention discloses a method and device for determining recalled interest point information, equipment and a medium, and relates to the field of retrieval. The method comprises the following steps: selecting a current main word from words included in a query sentence, and taking interest point information including the current main word as candidate interest point information; And selecting recall interest point information from the candidate interest point information according to the historical main word state of each word in the query sentence and the occurrence condition in the candidate interest point information. The embodiment of the invention provides a determination method and device for recall interest point information, equipment and a medium. The determined recall interest point information is different.

The invention belongs to the technical field of information management, and discloses a radiotherapy information management system and management method. The radiotherapy information management systemcomprises a registration login module, a system configuration module, a central control module, a network communication module, a treatment module, an information storage module, a medical accident alarm module, a display module and an information management server. According to the radiotherapy information management system and management method, patient and treatment information is encrypted via a data encryption module, so the security of the patient information is greatly improved, the privacy security of a patient is guaranteed, and the security problem such as a threat due to leakage isavoided; through the medical accident alarm module, the occurrence of a disease deterioration condition due to an artificial treatment error is greatly reduced; and if the treatment has an error, analarm may be sent out timely to notify a worker of taking a remedial measure.

The invention discloses a cloud data duplication elimination and integrity auditing method based on convergence encryption. According to the method, through adoption of a convergence key encapsulation / de-encapsulation algorithm based on blind signatures, convergence keys can be securely stored and moreover convergence key duplication elimination can be realized; and through utilization of a BLS signature algorithm based on the convergence keys, auditing public keys are stored by a trusted third party TTP, the TTP carries out proxy auditing, and duplication elimination of auditing signatures and the auditing public keys is realized. The method comprises the specific steps of carrying out system initialization; carrying out key initialization; carrying out file initialization; carrying out authentication evidence initialization; carrying out key encapsulation; carrying out data storage; carrying out duplication challenge; carrying out duplication response; carrying out duplication authentication; carrying out request auditing; carrying out proxy auditing; carrying out auditing response; carrying out auditing authentication; and carrying out file downloading. According to the method,a utilization rate of a cloud storage space is improved, the duplication elimination of auditing signatures and the auditing public keys is realized, and the storage and computing cost of a client arereduced.