120 results about "Scalable distributed" patented technology

In general, in one aspect, the invention provides a modular application collaborator for providing inter-operability between applications including a plurality of connectors for communicating with a like plurality of applications and an interchange server. The interchange server includes an application collaboration module and service module. The service module transfers messages between connectors and the application collaboration module. The application collaboration defines the inter-operability between two or more applications. The interchange server service module includes a transaction service and an error service. Transactions are executed in the application collaboration module and the transaction service records each action and a compensating action for undoing an associated action. An error service monitors for errors in the interchange server, and, upon detection of an error, stops the execution of a transaction and initiates the execution of any required compensating actions to undo the interrupted transaction. The compensating transactions may be executed at the connectors and are not required to be overseen by the interchange server.

The present invention relates to a scaleable automatic method of using multiple techniques to generate models and combinations of models from data and prior knowledge. The system provides unprecedented ease of use in that many of the choices of technique and parameters are explored automatically by the system, without burdening the user, and provides scaleable learning over distributed processors to achieve speed and data-handling capacity to satisfy the most demanding requirements.

A distributed gateway for controlling computer network data traffic dynamically reconfigures traffic assignments among multiple gateway machines for increased network availability. If one of the distributed gateway machines becomes unavailable, traffic assignments are moved among the multiple machines such that network availability is substantially unchanged. The machines of the distributed gateway form a cluster and communicate with each other using a Group Membership protocol word such that automatic, dynamic traffic assignment reconfiguration occurs in response to machines being added and deleted from the cluster, with no loss in functionality for the gateway overall, in a process that is transparent to network users, thereby providing a distributed gateway functionality that is scalable. Operation of the distributed gateway remains consistent as machines are added and deleted from the cluster. A scalable, distributed, highly available, load balancing network gateway is thereby provided, having multiple machines that function as a front server layer between the network and a back-end server layer having multiple machines functioning as Web file servers, FTP servers, or other application servers. The front layer machines comprise a server cluster that performs fail-over and dynamic load balancing for both server layers.

An intercom system is provided having a plurality of intercom stations coupled to a digital network, each station transmitting intercom data onto a channel of the network. Each station receives intercom data from each other station and selects channels to be amplified and output to a speaker. Each station may listen to and talk to any other station or any selected group of stations. Processing of signals from the network is performed in each station, thereby eliminating the need for a centralized mixing and switching device. Stations may be added merely by connecting them to the network. The intercom system may be configured in a non-blocking mode or in a blocking mode.

A scalable distributed multimedia streaming system employs at least one media station having a media director and a plurality of media engines. Each media engine incorporates media content storage, communications channels for retrieving and streaming media content over a network. The media director has a controller adapted for directing retrieval over the network of media content by a selected media engine, tracking content stored on the media engines and redirecting a content request from a media console connected to the one media station over the network to a selected one of the media engines storing content corresponding to the request for streaming. Multiple media stations are employed to expand the network using a media location registry as a central repository for storing the location of all media content in the media stations. Intercommunication between the media stations for transfer of content is accomplished through the network.

The present invention is directed toward a system on chip architecture having scalable, distributed processing and memory capabilities through a plurality of processing layers. One application of the present invention is in a novel media processing device, designed to enable the processing and communication of video and graphics using a single integrated processing chip for all visual media.

The invention relates to the technical field of network communications, in particular to a cluster communication system and method for improving message transfer performances. The system comprises a message release end, a message server cluster containing a plurality of message servers, a message subscribing end and a distributed coordination service cluster. The cluster communication system and method for improving message transfer performances have a global single point-free clustering expandable distributed design; if one or more nodes of the message release end or subscribing end have a fault, other nodes in the same group can continue to send or receive messages, and a processing flow of the messages is not interrupted; by adopting an index-based distributed file storage solution, the defects of the existing DB and file storage are effectively avoided, so that the read and write efficiency of the messages is higher; and by using a long poll PULL message transfer manner, the throughput is ensured while the message instantaneity is ensured.

A system and method for providing an Application Programming Interface (API) that allows users to write complex graphics and visualization applications with little knowledge of how to parallelize or distribute the application across a graphics cluster. The interface enables users to develop an application program using a common programming paradigm (e.g., scene graph) in a manner that accommodates handling parallel rendering tasks and rendering environments. The visualization applications written by developers take better advantage of the aggregate resources of a cluster. The programming model provided by APT function calls handles scene-graph(s) data in a manner such that the scene and data management are decoupled from the rendering, compositing, and display. As a result, the system and method is not beholden to one particular graphics rendering API (e.g. OpenGL, Direct X, etc.) and provides the ability to switch between these APIs even during runtime.

A computer-implemented method and a distributed file system in a distributed data network in which file metadata related to data files is distributed. A unique and non-reusable mode number is assigned to each data file that belongs to the data files and a directory of that data file. A key-value store built up in rows is created for the distributed file metadata. Each of the rows has a composite row key and a row value (key-value pair) where the composite row key for each data file includes the mode number and a name of the data file. When present in the directory, the data file is treated differently depending on size. For data files below the maximum file size the entire file or portion thereof is encoded in the corresponding row value of the key-value pair. Data files above maximum file size are stored in large-scale storage.

The present invention is a system on chip architecture having scalable, distributed processing and memory capabilities through a plurality of processing layers. In a preferred embodiment, a distributed processing layer processor comprises a plurality of processing layers, a processing layer controller, and a central direct memory access controller. The processing layer controller manages the scheduling of tasks and distribution of processing tasks to each processing layer. Within each processing layer, a plurality of pipelined processing units (PUs), specially designed for conducting a defined set of processing tasks, are in communication with a plurality of program memories and data memories. One application of the present invention is in a media gateway that is designed to enable the communication of media across circuit switched and packet switched networks. The hardware system architecture of the said novel gateway is comprised of a plurality of DPLPs, referred to as Media Engines that are interconnected with a Host Processor or Packet Engine, which, in turn, is in communication with interfaces to networks. Each of the PUs within the processing layers of the Media Engines are specially designed to perform a class of media processing specific tasks, such as line echo cancellation, encoding or decoding data, or tone signaling.

The disclosed embodiments provide a system for processing data. During operation, the system identifies a query type of a query of a graph database storing a graph, wherein the graph comprises nodes, edges between pairs of nodes, and predicates. Next, the system determines, based on the query type, a number of clusters on which the graph database is replicated for fanning out of the query. The system then selects a set of storage nodes in the determined number of clusters for processing of the query. Finally, the system generates a fan-out of the query to the selected storage nodes.

Embodiments of the disclosure relate to storing and sharing data in a scalable distributed storing system using parallel file systems. An exemplary embodiment may comprise a network, a storage node coupled to the network for storing data, a plurality of application nodes in device and system modalities coupled to the network, and a parallel file structure disposed across the storage node and the application nodes to allow data storage, access and sharing through the parallel file structure. Other embodiments may comprise interface nodes for accessing data through various file access protocols, a storage management node for managing and archiving data, and a system management node for managing nodes in the system.

A system for performance testing of scalability implementations and testing of stability in blockchain database implementations. The testing system comprises a cluster of private blockchain nodes instantiated on a network and a control console that allows the user to set the number of nodes in the network and the number of clients for testing of a particular blockchain implementation. Performance metrics are established and tested. The test system allows for staged testing using generated databases, wallets, and accounts starting with simple 5-node networks, expanding to larger networks, then testing with decreased block validation times, continuing to testing using alternative, faster trust schemes, then testing implementation on divided blockchains, and finally testing on shared blockchains.

An eventing method and system is provided that enables resource-constrained CE devices, at home, away from home, on-the-go, or behind a firewall, to communicate through asynchronous events with each other and / or with other type electronic devices, at home or on the Internet. Further, a scalable distributed system is provided that supports asynchronous eventing over the Internet efficiently and at low cost.

Systems and methods are provided for managing user information comprising presence information, wherein authentication of requesting parties is based on public-private key pair encryption and key Domain Name Service (kDNS) infrastructure. Thus, a response to a request for presence information may be dependent on the authentication status of the requesting party. Presence information stored on a presence server or other network element may be stored or updated upon receiving a request from a user which includes the requestors identify, and is signed with the private key of the requestor. After authentication of a user having a registered unique identifier and an associated public key, presence information may be stored or updated, in either encrypted or unencrypted form. Presence information is preferably stored with user specified policy information for managing access to the presence information by other users, e.g. what information may be shared with anonymous or unauthenticated other users, or with other specific authorized users, or authorized user groups. Advantageously, all communications between communication parties and network elements of the system are encrypted. A scalable and distributed system and method is provided for managing exchange of dynamic information, such as presence information, between users of communications and network services, with improved reliability, security, and personalization. Systems and methods are particularly applicable for securely managing exchange of presence information and other information for multiparty communications service and for peer-to-peer network services.

A multiprocessor system comprises at least one processing module, at least one I / O module, and an interconnect network to connect the at least one processing module with the at least one input / output module. In an example embodiment, the interconnect network comprises at least two bridges to send and receive transactions between the input / output modules and the processing module The interconnect network further comprises at least two crossbar switches to route the transactions over a high bandwidth switch connection. Using embodiments of the interconnect network allows high bandwidth communication between processing modules and I / O modules Standard processing module hardware can be used with the interconnect network without modifying the BIOS or the operating system. Furthermore, using the interconnect network of embodiments of the present invention is non-invasive to the processor motherboard. The processor memory bus, clock, and reset logic all remain intact.

The invention puts forward a method with verification for intelligently crawling network information in a distributed way. The method comprises the following steps that: when a judgement result shows that the target page data of a website can be obtained after login verification is carried out, obtaining corresponding login information from a database, carrying out automatic login through a browser, and submitting verification information; starting a timed task, using cookie to access the webpage of the timed task, and carrying out keep-alive processing; starting a network package capture detector, accessing a corresponding target page according to business requirements, carrying out HTTP (Hyper Text Transport Protocol) message analysis, carrying out customization on a crawler script, and determining a task crawling data size; and emitting a broadcast by a main node, notifying a corresponding task node, distributing the crawler script, starting the task node, applying for a task from a main node task queue, carrying out data crawling according to the applied task, and storing the crawled target data into the queue so as to store the crawled target data into the database in batches. By use of the method, a protected page can be automatically logged in and accessed, and a quick and expandable distributed webpage crawler integrated framework capable of mining the script is automatically generated.

Building binary packages for software products, particularly large-scale software products, is a highly computation intensive process. Thus, it is desirable to distribute the workload over a large number of computing nodes so as to have the build process complete in an optimal period of time. One environment providing compute resources that can be utilized for a highly available and dynamically scalable distributed build process is an elastic compute cloud. In such an environment, virtual machines can be instantiated and destroyed as the resource requirements of the build process dictate. This has the advantage that dedicated hardware is unneeded, and excess capacity on the hardware employed can be employed for other computation tasks when the build process is idle. Presented herein are systems, methods and computer storage media for distributing a highly available and scalable build service, suitable for use in an elastic compute environment or other distributed environment.

Some embodiments of the present invention provide a method of recording transactions using a T1 distributed ledger in a distributed database over a first distributed network of computers, and a plurality of T2 distributed ledgers each in a distributed database over a corresponding distributed network of computers, wherein each T2 distributed ledger has associated with it a corresponding plurality of wallets that are not also associated with any other T2 distributed ledger, comprising: (a) recording transactions identifying an originating wallet in the T2 distributed ledger associated with the originating wallet; (b) for any transactions that identify a recipient wallet that is not associated with the same T2 distributed ledger as the originating wallet, after recording the transaction in the associated T2 distributed ledger then recording the transaction in the T1 distributed ledger, and then recording the transaction in the T2 distributed ledger associated with the recipient wallet.

A fault tolerant system for a highly scalable distributed processing system in which fault tolerant groups (hereafter referred to as “FT groups”) are formed based on the functionalities of applications. A given FT group includes instances of the same applications and also different applications that perform the same function. The instances within the FT group are ranked as a primary and mirrors, which descend in rank. When the primary instance in the FT group crashes, that is, fails or becomes otherwise unavailable, the system utilizes the next ranking available (running) instance in the FT group as the primary instance. The change over to the next ranking mirror application is performed quickly and without loss of functionality through an exchange of “FT messages” under the control of a central monitoring and change-over control sub-system.

A scalable power distribution system for a data center and methods for scaling a power distribution system are described. The scalable power distribution system includes a transformer that is connected to a load at its output. The input of the transformer is connected to two isolation switches. A source is connected to one switch at all times, and the source can be switched without affecting power to the load by synchronizing the two sources at the transformer before switching sources. The load is not de-energized at any time during the transfer process.

Fractal memory systems and methods include a fractal tree that includes one or more fractal trunks. One or more object circuits are associated with the fractal tree. The object circuit(s) is configured from a plurality of nanotechnology-based components to provide a scalable distributed computing architecture for fractal computing. Additionally, a plurality of router circuits is associated with the fractal tree, wherein one or more fractal addresses output from a recognition circuit can be provided at a fractal trunk by the router circuits.