401 results about "Dataspaces" patented technology

Briefly, the present invention relates to an information dispersal sytem in which original data to be stored is separated into a number of data “slices” in such a manner that the data in each subset is less usable or less recognizable or completely unusable or completely unrecognizable by itself except when combined with some or all of the other data subsets. These data subsets are stored on separate storage devices as a way of increasing privacy and security. In accordance with an important aspect of the invention, a metadata management system stores and indexes user files across all of the storage nodes. A number of applications run on the servers supporting these storage nodes and are responsible for controlling the metadata. Metadata is the information about the data, the data slices or data subsets and the way in which these data subsets are dispersed among different storage nodes running over the network. As used herein, metadata includes data source names, their size, last modification date, authentication information etc. This information is required to keep track of dispersed data subsets among all the nodes in the system. Every time new data subsets are stored and old ones are removed from the storage nodes, the metadata is updated. In accordance with an important aspect of the invention, the metadata management system stores metadata for dispersed data where: The dispersed data is in several pieces. The metadata is in a separate dataspace from the dispersed data. Accordingly, the metadata management system is able to manage the metadata in a manner that is computationally efficient relative to known systems in order to enable broad use of the invention using the types of computers generally used by businesses, consumers and other organizations currently.

A system and method for generation of URL context queries. A request is received over a network from a user for generation a URL based context query, wherein the request comprises at least one query generation criteria. A multidimensional dataspace having a spatial axis, a temporal axis, a topical axis and a social axis is searched for clusters of related data objects using the query generation criteria, wherein at least one cluster of data objects relating to the query generation criteria is identified. Permissions are checked relating to each data object cluster of related data objects. If the user does not have permission to view the data object, it is removed from the cluster. A URL having a context query comprising at least one context criteria is generated from the properties of the cluster of data objects. The URL having a context query is then transmitted to the end user.

A system and method for configuring a cluster of computer nodes to save and restore state in the cluster in the event of node failures. The system and method are implemented through an application programming interface that includes a membership application, a locks application and a dataspace application. The membership application maintains a set of nodes in the cluster. The lock application provides a means for service applications running on the nodes to synchronize access to dataspaces. The dataspaces provide a cluster-wide shared regions in the memory of the cluster members. The API is configured to monitor the cluster members and to coordinate reallocation of a service application if a node running the service application fails.

A method, apparatus, and program product are provided for preserving a query plan cache on a backup system having a dataspace containing a copy of data and a copy of a query plan cache from a production system. An update is initiated of at least a portion of the copy of the data on the backup system with a portion of the data on the production system. A merge is initiated of updated query plans in the query plan cache from the production system with corresponding query plans in the copy of the query plan cache on the backup system. Objects are correlated in the updated query plans in the copy of the query plan cache with the updated copy of the data on the backup system.

Described is an information dispersal system in which original data to be stored is separated into a number of data “slices” in such a manner that the data in each subset is less usable or less recognizable or completely unusable or completely unrecognizable by itself except when combined with some or all of the other data subsets. These data subsets are stored on separate storage devices as a way of increasing privacy and security. A metadata management system stores and indexes user files across all of the storage nodes. The metadata management system stores metadata for dispersed data where: the dispersed data is in several pieces; and the metadata is in a separate dataspace from the dispersed data.

A system for obfuscating data across an enterprise, comprising a rule evaluator; an active rule editor; and an active rule editor repository; wherein the rule evaluator evaluates active rules and optimizes its behavior based on both user-specified guidance and properties learned during system execution; wherein the active rule editor provides functionality for specifying, examining, maintaining, simulating and testing active rule behavior and for documenting rules that are bound to any named and typed data spaces of the enterprise that are accessible through connectors to the data systems of the enterprise; and wherein the active rule editor and repository provide functionality for promoting a candidate rule to an active rule and managing the rule in its active state. A method for obfuscating data across an enterprise using the system described above.

Systems and methods for data augmentation in a neural network system includes performing a first training process, using a first training dataset on a neural network system including an autoencoder including an encoder and a decoder to generate a trained autoencoder. A trained encoder is configured to receive a first plurality of input data in an N-dimensional data space and generate a first plurality of latent variables in an M-dimensional latent space, wherein M is an integer less than N. A sampling process is performed on the first plurality of latent variables to generate a first plurality of latent variable samples. A trained decoder is used to generate a second training dataset using the first plurality of latent variable samples. The second training dataset is used to train a first classifier including a first classifier neural network model to generate a trained classifier for providing transaction classification.

A method, apparatus and program product to optimize a database query. In a first system having a first dataspace, a query plan is generated for the database query. Remote statistics collection associated with the database query is initiated on a second system having a second dataspace. The remote statistics collection uses the second dataspace, which includes a current copy of at least a portion of the first dataspace on the first system. Database statistics are collected for the first system by analyzing the second dataspace and then communicating the collected database statistics to the first system for use in optimizing database queries executed by the first system.

A method and apparatus provide data security on a parallel computer system using virtual private networks. An access setup mechanism sets up access control data in the nodes that describes which virtual networks are protected and what applications have access to the protected private networks. When an application accesses data on a protected virtual network, a network access mechanism determines the data is protected and intercepts the data access. The network access mechanism in the kernel may also execute a rule depending on the kind of access that was attempted to the virtual network. Authorized access to the private networks can be made via a system call to the access control mechanism in the kernel. The access control mechanism enforces policy decisions on which data can be distributed through the system via an access control list or other security policies.

A method and service for enabling a smallest unit of variable data within a data space of a user application to be dynamically updated using an external source. The application GUI is enhanced with a dynamic update utility (DUU) that enables the data unit to be selected and linked to the broker topic. A list of available topics is presented for selection by the user, and the data unit automatically linked to the selected broker topic without requiring user knowledge of the specific linking parameters of the external source. A JMS client application is provided containing a message listener and an application writing protocol. A subscriber is defined for the data unit and subscribes to the particular event broker topic hosted at a JMS provider. When the event broker receives a publication from the data publication source, a copy of the published data is forwarded to the message listener associated with the subscriber, and the message listener provides the data to the application writing protocol. The application writing protocol then automatically overwrites the data unit with the published data.