326 results about "Data differencing" patented technology

A method and system for monitoring and maintaining the consistency of replicated databases in a shared-nothing database cluster architecture is presented. The method involves the continuous monitoring of the database transaction logs that are maintained by the autonomous database managers that manage the individual database replicas in the cluster. In the event that data discrepancies are detected via the comparison of the transaction logs of the individual database replicas, remedial action is carried out according to configured rules in the main cluster controller. These remedial actions may include, but are not limited to, making a database node inactive within the cluster, or automatically repairing any data discrepancies that are detected among the database replicas in the cluster.

A difference information receiver, a difference information transmitter and a difference information synchronizer which cooperate in a system or device to update data in the device with data received from other systems, or provide data for other systems to use in updating themselves are disclosed. A difference receiver in a device having at least one application data destination having a format includes a difference engine receiving difference information associated with a change to said at least one application data destination; and an application interface, applying said difference information to said at least one data destination. A method for updating data files in a system is also disclosed. The method may include the steps of: receiving difference information for a subset of said data files; and applying said difference information to said subset of said data files. In particular said step of receiving may comprise: receiving a change log detailing changes to data files on another system; and applying said changes to a data store containing data identical to said data files to generate changed data. A difference transmitter comprises an application in a system having a data source in a source format. The application may include an application interface, extracting data from said data source; and a difference engine receiving said data and outputting difference information associated with changes to said data source. A method for updating a data source in a system is also disclosed. The method may include the steps of extracting difference information from at least a subset of said data source; and outputting difference information for at least the subset of said data source. The step of extracting may comprise determining whether changes have been made to the subset of data source in the system; and generating a change log detailing changes to the subset of data source on another system. A difference synchronizer includes an extraction routine for extracting a first set of difference information resulting from changes to the data files; a differencing transmitter for transmitting said first set of difference information to an output; a differencing receiver for receiving a second set of difference information from an input; and a reconstruction routine for applying the second set of difference information to the data files. In a particular embodiment, the invention comprises a device engine including an application object; an application object store; and a delta module.

A method for monitoring and protecting a designated real estate Title (Deed / Transfer) against title theft, fraudulent transaction, mortgage fraud includes process and steps of compiling selected data records associated with a designated real estate Title from plurality of predefined sources and storing the compiled data into an associated file within a computer database, number referencing stored selected data to further facilitate confirmation and authentication of the data records, execute monitoring process for an authenticated Title by preparing and registering security Charge / Mortgage on the Title, Issue transaction permit code, registering with local and national lender data base, Mortgage default insurers and Title insurance companies as protected Title, protect an authenticated Title from fraudulent transaction, mortgage fraud and illegal activity by further verifying transactional data of the requesting party with the stored authenticated data, stop transaction on detection of data discrepancies, issue transaction completion permit and discharge registered security charge by obtaining consistency in obtained data records. A system comprising of confirmation, authentication and verification algorithm and ID validation hardware components. The system further includes a computer database for storing data records, computer software to validate ID cards, reference number data records, execute confirmation, authentication and verification algorithm and issue transaction completion permit / Termination warning and security charge / discharge documents.

A method and system for monitoring the consistency of replicated databases in a shared-nothing database cluster architecture is presented. The method involves the continuous monitoring of the database transaction logs that are maintained by the autonomous database managers that manage the individual database replicas in the cluster. In the event that data discrepancies are detected via the comparison of the transaction logs of the individual database replicas, remedial action is carried out according to configured rules in the main cluster controller. Additionally, if the database management system running within each node of the cluster possesses a database history file that records key events pertaining to a database replica, such as the occurrence of non-logged bulk loads of table data, or the modification of tables, a method can be instituted for the monitoring of the history files for discrepancies between the database replicas.

Techniques and mechanisms described herein facilitate the replication of data between storage nodes. According to various embodiments, a request to provide a data chunk to a target storage node may be received at a source data storage node. A reference data chunk may be identified based on fingerprint information associated with the requested data chunk. The reference data chunk may be stored on the target storage node. The reference data chunk and the requested data chunk may each include a first data portion. Data chunk reconstruction information may be transmitted from the source data storage node to the target data storage node. The data chunk reconstruction information may identify the reference data chunk. The data chunk reconstruction information may include data difference information for constructing the requested data chunk at the target data storage node based on the reference data chunk.

Embodiments are directed to efficiently backing up portions of data and to performing a scoped data recovery. In an embodiment, a computer system preloads data images with data corresponding to various different software applications or operating systems. The computer system chunks the data images, so that each data image is divided into multiple data chunks, and where each data chunk is represented by a hash value. The computer system then receives, from a user, portions of delta data representing data differences between the received user data and the data in the preloaded data images. The computer system also generates a logical backup representation that includes the data chunk hash values for the preloaded data images as well as the delta data received from the user. This logical representation allows restoration of the user's data using only the hash values and the delta data.

It includes display layer, data storage / procession layer (SP) and system interface layer (SI). SP includes data collect module (DL), data pre-processing module (DP), data comparison module (DM), data sync, module (DS) and assistant module. Via SI, the business backup and bearing nets (BBB) realize mutual comm. between net elements (NE). From BBB, DL collects NE data requiring keeping coincident. DP / DM pre-processes and compares these data. Non-coincident data are recorded in the error list. According to availability test rule, DS verifies availability of data difference, generates corresponding synchronization data against valid data difference base on sync. rule and sends to related NE to keep coincidence of data between NEs. This invention raises data comparison synchronization level, system running efficiency and resource utilization. It ensures accuracy and coincidence of system data. It extensively is applied in multi-NE cooperation fields, such as comm., insurance and banking.

A method and system are described for centrally managing data in an adaptive clinical trial or other adaptive process that is conducted at a plurality of geographically remote sites. The invention includes (1) flexible means for collecting data from remote sites; (2) processing, tracking, and validating such data and meta-data at a processing location; (3) interacting between central and remote sites to manage and resolve data discrepancies (4) reporting data to managers and remote sites; and (5) facilitation of special services to clinical research such as flexible randomization of patients, patient participation eligibility verification and double-blind trials. The invention is of particular relevance to adaptive clinical trials and other applications that demand the ability to quickly collect, process, and respond to various forms of data in order to adjust actions such as randomization schedules, interim analyses, treatment arm pruning, editing subpopulations, and other adaptive measures.

The invention discloses a method and a device for updating application programs. The method comprises the following steps of: acquiring one or more first files of a first version of the application programs, and one or more second files of a second version of the application programs; generating the update difference files of the one or more first files and the corresponding one or more second files; issuing the update difference files comprising download addresses; generating configuration files comprising the version information of the second version and the download addresses of the update difference files; issuing the configuration files. According to the method and the device disclosed by the invention, clients are prevented from blindly accessing a server to request to update service, thus reducing the response frequency of the server and decreasing the resource consumption of the server; meanwhile, the volume of each of the update difference files produced by data difference is greatly reduced compared with a complete version update data package, thus greatly reducing network bandwidth resources, and increasing download success rate and update success rate.

The invention relates to a rapid synchronization method of logical volumes based on data difference, which belongs to the technical field of computer data storage. The method comprises steps of finding out used data blocks on each logical volumes according to file system information of source volumes and destination volumes, comparing corresponding data block pairs on the source logical volumes and the destination logical volumes, then computing two eigenvalues of a data block pair, synchronizing the data block pair if the two eigenvalues are varied, or not synchronizing if not. The invention only compares the used data blocks in case of data synchronization, thereby obviously reducing the range of data comparison, and simultaneously only the changed data blocks are synchronized during synchronization, thereby effectively reducing the quantity of synchronized data.

The invention provides a lithium battery residual life prediction method based on an LSTM neural network and transfer learning. The lithium battery residual life prediction method comprises the following steps: step 1, carrying out data acquisition and data preprocessing; 2, dividing the data into a training set and a test set in proportion; 3, building a source domain LSTM neural network model, inputting the source domain data training set into a neural network for training, and inputting the data of the test set into the neural network for testing; 4, measuring the data difference between the source domain and the target domain by using the maximum mean value difference to obtain the distribution distance between the source domain and the target domain; and step 5, adjusting the source domain network model according to the maximum mean value difference to obtain a target domain network model, migrating source domain network model parameters, and inputting target domain data into themodel to perform residual life prediction. By migrating the structure and parameters of the network model, the network training time is reduced, and the efficiency is improved.

The present leverages data hierarchies to provide a systematic means to determine data differences between equivalent data. This allows disparate data storage systems to efficiently determine divergent data locations by utilizing, for example, data signatures representative of varying degrees of data granularity. Comparative analysis can then be performed between the databases by employing an iterative approach until the desired level of data granularity is obtained. This allows, in one instance of the present invention, discrepant data to be determined without the transfer of large amounts of data and without requiring homogeneous data storage systems. Another instance of the present invention utilizes equivalent logical data views from non-identical data sets to determine data discrepancies. Yet another instance of the present invention determines discrepancies of a federated and / or integrated data system by employing reversible data statistical signatures, providing a simplistic transfer protocol and sheltering each data system from the other's complexities.

The invention discloses a data index exception monitoring method and system, a storage medium and electronic equipment. The data index exception monitoring method comprises the following steps that: obtaining a data index which needs to be monitored and the historical data of an associated data index corresponding to the data index which needs to be monitored; according to the data index which needs to be monitored and the historical data of the associated data index, generating a scatter diagram; according to the data index which needs to be monitored, the historical data of the associated data index and the scatter diagram, through a quantile regression algorithm, selecting an upper tail, a lower tail and a median, and taking the upper tail, the lower tail and the median as parameters togenerate a learnt monitoring sample model through machine learning; and comparing a data difference between the data index which is obtained in real time and needs to be monitored and the monitoringsample data, and carrying out exception detection on the data index which needs to be monitored, wherein the exception detection on the data index which needs to be monitored comprises exceptional fluctuation point detection and exceptional fluctuation tendency detection.

A modified data synchronization system having data security and proxy capabilities has a delivery server, a PC, and at least one mobile phone. The PC sends out the exchange data through the Internet to a remote location where the delivery server is installed, and then one mobile phone compliant with SyncML protocols dials in to conduct data synchronization with the delivery server through wireless means, through which the existing data discrepancy between the mobile phone and the PC can be eliminated. The PC does not need to install a dedicated SyncML server, and data security can be ensured in the synchronization process, as data transfer between the PC and the delivery server through secured protocol over the Internet, and that between the mobile phone and the delivery server is through a dedicated channel.

The invention discloses a method for detecting a composite insulator based on multi-spectrum. The method comprises: selecting a detection device; under a same operation condition, performing visible light detection, infrared detection, and UV detection of the same composite insulator by using the detection device to obtain detection images of the composite insulator; performing comparison of a partial discharge lighting spot of the visible light image, a partial hot spot of the infrared image, and an electric corona spot of the UV image; performing comparison of visual light images, infrared images, and UV images of different composite insulators of the same pole tower of the same line under the same operation condition; establishing a multi-spectrum detection database according to each composite insulator; and performing data comparison and finding out existing data difference according to detection data in a certain period. According to the method, visual light detection, infrared detection, and UV detection can be organically combined; advantages are complemented; and electrified detection of the insulator is easy to perform. A defect of the composite insulator can be discovered in time, so that large-area tour-inspection is convenient to develop.

The invention discloses a processing method of data consistency, which comprises the following steps: testing the consistency of differential data according to the comparing result or differential list of net data; combining synchronous rule to generate synchronous data to transmit to the relative net; executing data adding / deleting / repairing request of synchronous rule consistency at net; eliminating the consistent net data according to the eliminated data difference. The invention can clean the rubbish data of net in time, which improves the resource utility.

A data differencing technique enables a response from a server to the request of a client to be composed of data differences from previous versions of the requested resource. To this end, data differencing-aware processes are positioned, one at or near the origin server (on the sending side) and the other at the edge closest to the end user (on the receiving side), and these processes maintain object dictionaries. The data differencing-aware processes each execute a compression and differencing engine. Whenever requested objects flow through the sending end, the engine replaces the object data with pointers into the object dictionary. On the receiving end of the connection, when the data arrives, the engine reassembles the data using the same object dictionary. The approach is used for version changes within a same host / path, using the data differencing-aware processes to compress data being sent from the sending peer to the receiving peer.

The invention discloses a data storage method and a data warehouse system. The data storage method comprises the steps that independent processing commonality data among all application markets in the data warehouse system is determined; the commonality data is classified according to the different business themes and stored in corresponding theme markets, wherein the theme markets are located between the application markets and a basic data warehouse in the data warehouse system and used for supplying data to the application markets and serving as supplementation of the basic data warehouse; the commonality data stored in the application markets is deleted. The theme markets are basic data organization and storage for the business themes and are used for isolating influences of business need changes on an application system architecture; the theme markets emphasize to establish a shared data market shared by application system co-construction, therefore, island-type data communication among systems is eliminated, the uniform data standard is established, and the problems of data islands, repeated processing, data differences and high cost are solved.

Techniques and mechanisms described herein facilitate the replication of data between storage nodes. According to various embodiments, a request to provide a data chunk to a target storage node may be received at a source data storage node. A reference data chunk may be identified based on fingerprint information associated with the requested data chunk. The reference data chunk may be stored on the target storage node. The reference data chunk and the requested data chunk may each include a first data portion. Data chunk reconstruction information may be transmitted from the source data storage node to the target data storage node. The data chunk reconstruction information may identify the reference data chunk. The data chunk reconstruction information may include data difference information for constructing the requested data chunk at the target data storage node based on the reference data chunk.

Financial instruments are indexed to a standardized measure of publicly available longevity and mortality demographic data. A first financial instrument includes a zero-coupon bond and Experience Coupons. The zero-coupon bond accrues interest over its term at a base interest rate. The Experience Coupons, which are responsive to differences in actual and projected longevity / mortality data, either supplement or erode the value of the zero-coupon bond according to the direction of the differences in actual and projected longevity / mortality data. A second financial instrument is a swap in which counterparties trade expectations that actual mortality or longevity experience will be better or worse than projected mortality or longevity experience for a selected population cohort.

The invention is applicable to the technical field of computer application. A data synchronization method based on block chain, a terminal apparatus and a computer readable storage media are provided, wherein the method includes constructing a block chain P2P network according to node information of each distributed node, and carrying out data synchronization for the distributed nodes with largedata difference in the block chain P2P network. Then, the synchronized data is verified based on the well-known mechanism of the block chain, and the data synchronization is confirmed to be successfulafter the verification, which ensures the consistency of the data of the distributed nodes in the block chain P2P network, makes the distributed nodes work cooperatively, and improves the efficiencyof the data synchronization and processing of the distributed system.

A system and method for determining execution path differences in a computer-implemented software application is provided herein. A software application under analysis is executed at least twice, thereby generating first and second call tree data and associated first and second sets of execution data describing the at least two executions of the software application. This data is then compared to determine a set of differences between the first and second executions of the program, the set of differences comprising one or more nodes that are either called differently in the first and second execution paths or executed differently in the first and second sets of execution data. For each node identified in the set of differences, the first and second call trees are then analyzed to identify at least one parent node that is the root cause of the difference in the execution data.

A word cloud diagram of a word frequency visual text summary is represented by a word size, and the use efficiency of mass non-structured data is increased remarkably by means of initial screening and induction. Intersection detecting is a difficult point of word cloud visualization, and the conventional algorithm has the defects of high time complexity and low speed since overlapping is performed through pairwise comparison of word groups. The invention discloses a word cloud diagram visualizing method based on an occupation matrix. In the method, intersecting work clouds, word clouds of any angles and word clouds based on occupation matrixes are related. One-by-one comparison is converted into one-time calculation by adopting an occupation matrix, side boundary detection, random positions, rotation canvas and a coordinate conversion technology, so that the complexity is lowered, and overlapping of any angle is eliminated. Inputs are text statistics data of certain formats, outputs are randomly-combined layout word clouds which have the characteristics of profile adaptability, transverse and longitudinal intersection, any angle, dot-matrix abstraction, near big and far small and classification tags, key points of texts are presented on a macro level, and data differences are compared intuitively. The word cloud diagram visualizing method can be widely applied to the fields of text mining and visualization.

The invention belongs to the field of data compression, more particularly relates to a method for carrying out data difference analysis by adopting a sliding window. In a plurality of applications of a computer, if differences among different data can be analyzed, great help for reducing data redundancy and improving the processing efficiency of the computer can be brought. The method adopted by the invention comprises the steps of dividing original data into equivalent data blocks and calculating the hash value of each data block; adopting the method of the sliding window in the original data to position whether the data block which is equivalent to sliding window data exists or not; further positioning the matching range around the equivalent data block if the data block which is equivalent to the sliding window data exists and recording the matching situation into differential data; moving the sliding window and then continuously comparing if the data block which is equivalent to the sliding window data does not exist; and repeating the operations till the data is over. By adopting the method of the invention, the difference between the original data and the target data can be analyzed rapidly.

The method comprises: BOSS and other net elements collects the net element data required to keep consistent; according to the state of net element, making a pre-treatment for the net element data; comparing said net element data with the data in BOSS, and saving the inconsistent data into the discrepancy list; in cooperation with the validity verification rule, making the validity verification for the data discrepancy; for the data needing to be synchronized, using synchronous rule to generate synchronous data which is transmitted to BOSS and other net element; BOSS and other net elements executes data synchronizing operation to keep the data consistent.

The invention is applicable to the data processing field, and provides a data synchronization control method, a device and a single-point logging system. The method comprises the steps: setting the corresponding synchronous state mark for data according to the synchronous state of the data; and carrying out data synchronization processing according to the synchronous state mark of the data, and updating the synchronous state mark of the data according to the result of data synchronization processing. The method not only avoids the data difference in the system needing data synchronization, ensures the real-time property and the accuracy of data synchronization and improves the stability of the system, but also improves the real-time property of data synchronization, reduces the cost of data synchronization and increases the efficiency thereof.

The invention relates to a data comparison method. The data comparison method comprises the following steps of: 1, setting a configuration table for data comparison, wherein the configuration table comprises data comparison control flow information, address information of a data comparison content and data difference threshold value information; 2, extracting data to be checked from a database at first according to the data comparison control flow information in the configuration table, and sequencing the data according to a same field, wherein the field comprises an index field and a property field; 3, comparing the data according to data comparison rule information in the configuration table; 4, judging whether a difference of the data is greater than a data difference threshold value set in the configuration table, if the difference of the data is greater than the data difference threshold value set in the configuration table, recording a comparison result of the data, and if the difference of the data is not greater than the data difference threshold value set in the configuration table, keeping comparing the data; and 5, judging whether second comparison is required according to the property of the data after the comparison, if the second comparison is not required, storing the comparison result, and if the second comparison is required, returning to the step 3. The data comparison method has the advantages that: because the data comparison is uniformly managed by the configuration table, the comparison speed and the reuse rate are high.

The invention proposes an abnormal data detection method and device and a data pre-processing method and system. The abnormal data detection method comprises the following steps of performing dimension reduction processing on a data set to be detected by a principal component algorithm to form a first data set; reconstructing the first data set by the principal component algorithm to form a second data set, wherein the second data set has the same dimension as the data set to be detected; calculating correlation between corresponding data of the data set to be detected and corresponding data of the second data set; and acquiring abnormal data, having big difference with the corresponding data in the second data set, from the data to be detected. According to the invention, a hypothesis that a data set to be analyzed conforms to certain specific distribution is not needed, and reliability, universality and stability are high.