202 results about "Data repair" patented technology

Embodiments provide methodologies for reliably storing data within a storage system using liquid distributed storage control. Such liquid distributed storage control operates to compress repair bandwidth utilized within a storage system for data repair processing to the point of operating in a liquid regime. Liquid distributed storage control logic of embodiments may employ a lazy repair policy, repair bandwidth control, a large erasure code, and / or a repair queue. Embodiments of liquid distributed storage control logic may additionally or alternatively implement a data organization adapted to allow the repair policy to avoid handling large objects, instead streaming data into the storage nodes at a very fine granularity.

Embodiments provide methodologies for reliably storing data within a storage system using liquid distributed storage control. Such liquid distributed storage control operates to compress repair bandwidth utilized within a storage system for data repair processing to the point of operating in a liquid regime. Liquid distributed storage control logic of embodiments may employ a lazy repair policy, repair bandwidth control, a large erasure code, and / or a repair queue. Embodiments of liquid distributed storage control logic may additionally or alternatively implement a data organization adapted to allow the repair policy to avoid handling large objects, instead streaming data into the storage nodes at a very fine granularity.

A method, system, device, and computer code product is disclosed in which a sender transmits data to a plurality of receivers via a point-to-multipoint session. The receiver sends data repair requests to the sender requesting data expected but not received and the sender retransmits the expected but not received data via the point-to-multipoint session. The sender can also schedule point-to-point data repair sessions with individual receivers if the retransmission via the point-to-multipoint session does not correct all errors. The sender can be configured to delay point-to-point repair sessions using a randomization mechanism based on the number of receivers using the point-to-multipoint session.

Methods and systems of using machine learning to create a trusted model that improves the operation of a computer system controller are provided herein. In some embodiments, a machine learning method includes training a model using input data, extracting the model, and determining whether the model satisfies the trust-related constraints. If the model does not satisfy the trust-related constraint, modifying at least one of: the model using one or more model repair algorithms, the input data using one or more data repair algorithms, or a reward function of the model using one or more reward repair algorithms, and re-training the model using at least one of the modified model, the modified input data, or the modified reward function. If the model satisfies the trust-related constraints, providing the model as a trusted model that enables a computer system controller to perform system actions within predetermined guarantees.

The invention relates to a method for data repair in a system capable of one-to-many transmission. The method comprises transmitting data from a sender to at least one receiver and provides for various sender driven or receiver driven repair methods of missing data.

Embodiments provide methodologies for reliably storing data within a storage system using liquid distributed storage control. Such liquid distributed storage control operates to compress repair bandwidth utilized within a storage system for data repair processing to the point of operating in a liquid regime. Liquid distributed storage control logic of embodiments may employ a lazy repair policy, repair bandwidth control, a large erasure code, and / or a repair queue. Embodiments of liquid distributed storage control logic may additionally or alternatively implement a data organization adapted to allow the repair policy to avoid handling large objects, instead streaming data into the storage nodes at a very fine granularity.

The invention discloses a distributed storage method and a distributed storage device based on network coding, and belongs to the technical field of computer storage. The method and the device solve the problem that disk IO (Input / Output) of storage nodes is too large in the existing distributed storage method based on the network coding. The distributed storage method is suitable for a distributed storage system, and comprises the steps of data coding, data decoding and data repair. The distributed storage device comprises a data coding module, a data decoding module and a data repair module. According to the method and the device, when a data node is damaged, data not more than the size of a primary file D is downloaded from d data nodes, and the damaged data is repaired, so that the repair band width is reduced effectively; and randomly selected gamma coded data blocks are downloaded directly from the d data nodes, and the data blocks are not subjected to linear operation in the data nodes, so that the disk IO of the storage nodes can be reduced on the premise that the high usability of the data is ensured, and the disk IO efficiency of the data nodes is improved effectively.

The application relates to a method and a device used for point cloud data repair. A method of generating a point cloud data repair model includes: obtaining at least one 2D image associated with a first point cloud data frame; dividing the first point cloud data frame into at least one point cloud data set according to attributes of objects in the 2D image; and for each point cloud data set, determining a matching image with the first point cloud data frame in the 2D image, determining 3D position data of pixel points in the matching image according to the first point cloud data frame and atleast one second point cloud data frame associated therewith, using 2D position and 3D position data of the corresponding pixel points in the matching image as training input and output data of training the model, and generating the point cloud data repair model which is used for the objects corresponding to the point cloud data set, through a deep learning network, wherein the matching image matches the first point cloud data frame on a data collection position and / or time. By utilizing the built model, repair of point cloud data can be realized, and thus accuracy and universality can be improved.

The invention provides a program updating method of a vehicle and a system thereof, an on-board terminal, an electronic device and a non-temporary computer-readable storage medium. The program updating method of the vehicle comprises the following steps: the vehicle terminal receives a first request for updating the vehicle controller; The on-board terminal obtains a first data packet for updatingthe vehicle controller from the cloud server according to the first request. The on-board terminal sends a first data packet to the vehicle controller so that the vehicle controller performs programwriting using the first data packet. In accordance with an embodiment of that present invention, the vehicle controller program is upgraded or repaired by automatically downloading the corresponding upgrade package or data repair package from the cloud, Under the condition of no need of after-sale or engineer control, the vehicle can write the whole vehicle controller program by itself, which greatly reduces the problem of high cost of manual brushing and facilitates the unified management of the whole vehicle controller program platform at the same time.

The present invention relates to a method and device for repairing missing data in time-space sequence data, wherein the method includes: separately determining the contribution weights of space peripheral points and time peripheral points to the missing data points; The contribution weights of the points are sorted from large to small, and the spatial dimension estimation data of the points to be obtained are calculated; according to the contribution weights of the points to be obtained, the first multiple points are sorted from large to small Calculate the estimated data of the time dimension of the point to be sought for the surrounding points in time; calculate the data of the point to be sought based on the estimated data of the spatial dimension and the estimated data of the time dimension. The invention makes full use of the time-space correlation and heterogeneity of the time-space sequence data, and the obtained data of the point to be sought has high precision.

The invention provides a storage system with a data-repairing function and a data-repairing method thereof. A testing and repairing flow is mainly utilized to perform once or for many times to reduce errors in a memory medium to a repairable range of the generally used error checking and correcting (ECC) function so as to ensure the reading correctness of data and effectively improve the reliability of the data. An optimal mode of the data-repairing step comprises the following steps: utilizing a test data generator in the storage system to provide test data, writing the test data to a memoryblock with data errors; finding error positions by reading the test data; and positioning the error positions in the repairable range of the ECC technology by a repairing program. However, the memoryblock is marked as a damaged block if the error positions can not be found or the errors can not be repaired in the repairable range of the ECC technology when a test number exceeds a test upper limit.

The present invention relates to a repair method for a distributed data storage system, which comprises the following steps of: S1, providing a management node and a plurality of storage nodes, wherein the storage nodes comprise a storage node set for repairing damaged data blocks and a storage node set for storing erasure code data required for data repair; S2, monitoring and searching the damaged data blocks in the system by the management node and when the management node searches the damaged data blocks, selecting the optimal storage node by adopting a LeDiR algorithm and carrying out authorization on the optimal storage node to carry out data repair work; S3, carrying out repair work by the optimal storage node through adopting an erasure code algorithm; and S4, after the optimal storage node completes data repair, sending the data repair condition to the management node. According to the repair method disclosed the present invention, damaged storage nodes are detected by the means of the management node, repair is carried out on the basis of the erasure code algorithm and the repair process on different nodes can be carried out concurrently, so that repair capacity of the storage system is improved and a load of a management server is reduced.

This invention discloses a data protecting method for embedded device. It consists of the following steps: divide the operation of data modification to stable status and temporary status; add a marker to each operation step and read in this marker when operation finish; the temporary status marker of the former operation was rewritten to be stable status marker when the last step in the multi step operation finish; startup, scan all the data, abandon unfinished action (temporary status operation marker) and come back to the former status. This invention could increase data repair speed.

An embodiment method for data repair in a storage system includes determining, by a processor, a minimum number of missing data blocks needed to repair a corrupted object in a first portion of the storage system, wherein the missing data blocks are not available in the first portion of the storage system, retrieving only the minimum number of missing data blocks needed to repair the corrupted object from a second portion of the storage system, and repairing the corrupted object in the first portion of the storage system using erasure codes and the retrieved minimum number of missing data blocks.

The invention relates to a data repair method, apparatus and equipment and a storage medium, wherein the method comprises the steps of determining the missing data in original electric power data; determining a date type corresponding to the missing data according to the date of the missing data; according to the date type and the preset repair method, repairing the missing data. Different date types use different repair methods to repair the missing data, so that the missing data can be effectively identified and corrected. By identifying and repairing the missing load data in the original electric power data, the integrity and accuracy of the electric power measurement data can be guaranteed, the false be eliminated and the truth can be retained, and the changing law of load can be highlighted. Thus, the reliability of household power demand analysis, market transaction and value-added service is ensured.

The invention relates to a data repairing method for a distributed erasure code storage system. The data repairing method comprises the following steps: 1) acquiring an updated strip repairing queue, wherein the strip repairing queue comprises strip records corresponding to strips, the strips keep original data, and the number of verifying blocks in each strip is greater than or equal to 3; 2) judging whether the strip repairing queue is null, and if yes, executing the step 5), otherwise, executing the step 3); 3) taking out a first strip in the strip repairing queue, and according to the strip record corresponding to the strip, acquiring a data loss state of the strip; 4) according to the data loss state, correspondingly repairing the strip, and returning to the step 1); 5) after repairing all the strips, quitting. Compared with the prior art, the data repairing method has the advantages as follows: the downgrade reading frequency is reduced and the resource expenses are reduced.

A data repair and synchronization method of dual flash ROM is provided, which includes a first flash ROM and a second flash ROM that store the same system data, wherein one of the first flash ROM and the second flash ROM is used to perform a data repair on the other flash ROM with damaged data and perform a data synchronization between the two flash ROMs, thereby ensuring that once the data in one flash ROM is damaged during the system operation, the complete system data stored in the other flash ROM is used to recover the damaged operating system and the files in the system. Meanwhile, through performing the data synchronization periodically, important configuration files in the system stored in the two flash ROMs are kept to be updated and completed.

The invention discloses a method and system for self-repairing down of a network server. The method comprises the following steps that: a, the server is started in a normal mode; b, the server starts to provide service, stores data to a shared memory, and simultaneously monitors whether the service is normal or not, if so, monitoring is carried out continuously, or otherwise, a step c is carried out; c, a restart script is called, and the server is started in a repair mode; d, the server uploads data from the shared memory and carries out data repair; and e, after the completion of repair, back to the step b. Due to the adoption of the method or system, a spare machine has no need to be configured for the server, so that the cost is low; when the server uploads data from the shared memory and carries out data repair, the repair speed is fast, the repair can be completed in a very short time, and further the service is recovered; and in addition, when the service needs to be migrated to other servers, reliable base guarantee for data replication can be provided, the data is transmitted to the other servers through reading the data of the shared memory, same service is started, so that working migration can be completed.

The invention relates to an anti-interference infrared remote-control decoding method and system. In existing infrared remote-control decoding methods, the problem of resisting outside interference is seldom taken into consideration generally; current infrared remote-control decoding is generally instant decoding, in other words, instant decoding is performed when each pulse reaches, and this mode is difficult for interference resisting and error correction; error correction can be performed only when previous and later pulses are compared, so that decoding is low in anti-interference performance. The method includes that effective infrared remote-control data pulse sections are cut out from a pulse sequence containing infrared remote-control data and repaired to obtain decoded data, and then decoding is performed. In the method, influence of outside interference is taken into consideration, and a data repair algorithm is used to repair the infrared remote-control data, the infrared remote-control data which are interfered can be correctly repaired and decoded with high probability.

The invention provides a method and system for safely distributing and repairing data in a multi-cloud storage environment, and a medium. The method comprises the following steps: a data distributionstep: distributing data information into a multi-cloud storage system; a data recovery step: when user data need to be accessed, adopting a data recovery technology to recover user original data according to obtained data fragments; and a data repair step: when certain public cloud data are damaged or inaccessible, using a data repair process to repair node data. The method for safely distributingand repairing the data in the multi-cloud storage environment provided by the invention has storage confidentiality, reliable redundancy, low storage cost, high repair security and low repair cost, and supports single-node damaged repair.

Systems and methods which implement storage system data repair control techniques, such as may provide a feedback control structure for regulating source object redundancy and / or repair bandwidth in the storage system. Embodiments control a source object redundancy level to be used in a storage system by analyzing source objects represented in a repair queue to determine repair rate metrics for the source objects and determining a source object redundancy level based on the repair rate metrics. For example, embodiments may cause more redundant fragments for each source object to be generated and stored during repair where the repair rate metrics indicate an increase in storage node failure rate. Additionally, embodiments may determine a per storage object repair rate (e.g., a repair rate preference for each of a plurality of source objects) and select a particular repair rate (e.g., a maximum repair rate) for use by a repair policy.

The invention is applicable to the technical field of data patch, a parking data patching method, a device, equioment and storage medium based on DCGAN are provided. The method comprises: the parkinglots in the collection of city parking lots are clustered into parking lot clusters, car parks include sample car parks and car parks to be repaired, according to the parking data of the sample parking lot, according to the vacancy rate curve image of the sample car park in the car park cluster, training the generative countermeasure network based on depth convolution, to generate a vacancy rate curve simulation image of each parking lot cluster, these empty car rate curve simulation images are processed and mapped to corresponding one-dimensional empty car rate data, according to the one-dimensional empty vehicle rate data, the parking lot to be repaired in each parking lot cluster is repaired, so that the parking lot to be repaired is repaired with more accurate data when the prior knowledge of the parking lot to be repaired is not relied on, the parking data repairing at the city level is realized, and the data collection cost of the parking lot is saved.

The invention discloses a data distribution management system, which comprises a data collection module, a data repair module, a data verification module, a temporary storage module, a data screeningmodule, a picture storage module, a document storage module, an audio data storage module, a controller, a display and a data inquiry module. After the data to be stored is obtained by the data collection module, the damaged files are repaired by the data repair module, the data files are screened by the data screening module, and the data files are classified into picture files, document files, audio files and other files after screening. After that, the picture file is stored by the picture storage module, the document file is stored by the document storage module, and the audio file is stored by the audio data storage module. Through the classification, different files can be effectively stored in the corresponding storage module, which is convenient for effective storage.

A system includes server 10 that manages data and check information for checking damage to the data, terminal apparatus 20 that acquires the data and the check information from server 10, and memory device 30 that stores the data acquired by terminal apparatus 20 into non-tamper-resistant memory area 31 and the check information acquired by terminal apparatus 20 into tamper-resistant memory area 32. Memory device 30 detects data in which data damage has occurred using the check information. Terminal apparatus 20 acquires the detected data from server 10, and memory device 30 repairs the data damage using the data acquired by terminal apparatus 20. This improves the storage efficiency of memory device 30, and furthermore, reduces the data communication time taken for acquiring normal data for repair from server 10.

A method, system, device, and computer code product is disclosed in which a sender (10) transmits data to a plurality of receivers (20) via a point-to-multipoint session. The receiver sends data repair requests to the sender (10) requesting data expected but not received and the sender (10) retransmits the expected but not received data via the point-­to-multipoint session. The sender (10) can also schedule point-to-point data repair sessions with individual receivers if the retransmission via the point-to-multipoint session does not correct all errors. The sender (10) can be configured to delay point-to-­point repair sessions using a randomization mechanism based on the number of receivers using the point-to-multipoint session.

The invention provides an urban perception data processing method based on a space-time causal relationship. The urban perception data processing method is used for repairing vehicle space-time trajectory behavior data. The method comprises steps of learning the spatial correlation of the trajectory acquisition equipment through a skip graph model, and outputting equipment distributed vector representation for subsequent processing; taking the noise data detection problem as a sequence marking problem, detecting error data and potential missing data through a bidirectional LSTM sequence marking model, marking vehicle track points, and predicting missing track points by using a bidirectional LSTM-based sequence predictor; and finally, correcting wrong track points in combination with the predicted missing data. According to the method, the noisy data is automatically detected, and the missing data is repaired from the perspective of the space-time causal relationship, so that the unreasonable vehicle trajectory is prevented from being generated, and the correct rate of wrong trajectory data repair is improved.

The invention discloses method, a device and a system for detecting and treating RAM invalidation, which is applicable to the detection and treatment of RAM invalidation of CPU / DSP; wherein, the method includes obtaining RAM program content and comparing the obtained program content with accurate program content; conducting data repair of the error program content by using the accurate program content if the error rate of the RAM program content is lower than the preset value; evaluating whether the data repair is successful or not through detecting CPU / DSP data treatment after the data repair; reloading and repairing the RAM program content by a resetting way if the data repair fails according to the evaluation result. The technical proposal provided by the invention can timely and accurately conduct the automatic repair based on RAM invalidation, reduce the impact of RAM invalidation on business and decrease the labor cost.