714 results about "Database clustering" patented technology

A method and system for monitoring and maintaining the consistency of replicated databases in a shared-nothing database cluster architecture is presented. The method involves the continuous monitoring of the database transaction logs that are maintained by the autonomous database managers that manage the individual database replicas in the cluster. In the event that data discrepancies are detected via the comparison of the transaction logs of the individual database replicas, remedial action is carried out according to configured rules in the main cluster controller. These remedial actions may include, but are not limited to, making a database node inactive within the cluster, or automatically repairing any data discrepancies that are detected among the database replicas in the cluster.

A system and methodology providing workload management in a database cluster. In one embodiment, for example, a method for allocating workload amongst a plurality of database servers sharing access to data comprises steps of: periodically collecting information about workload at each database server; distributing the workload information to each of the plurality of database servers; in response to a client connected to a first database server requesting that work be performed, examining the workload information to determine whether the requested work should be performed at a second database server having a lower workload than the first database server; if it is determined that the work should be performed at the second database server, automatically transferring the client connection to the second database server and performing the requested work at the second database server; and otherwise, performing the requested work at the first database server.

The invention relates to a method and a system for storing mass data of the Internet of Things (IoT). The system comprises a plurality of data receiving nodes, a master node server and a database cluster. The method comprises the following steps of: (1) carrying out preprocessing on IoT data, and putting the preprocessed data in the database cluster consisting of a master node, slave nodes and the data receiving nodes; (2) creating sample records, which take sample elements as storage units, on the master node according to the static and dynamic information of the data in the database cluster; (3) after the sample records are encapsulated, sending the encapsulated sample records to all the slave nodes by the master node so as to be subjected to fragmentation processing and / or separated storage; and (4) after the slave nodes complete storage, uploading results to the master node, and updating the data in the database cluster by the master node, thereby completing storage. According to the method and the system, the cluster is extended by fully utilizing the existing storage technologies so as to store the mass data, the IoT data are divided into lightweight data and multimedia data, and particularly, a fragmentation strategy is adopted aiming at a large-scale amount of data, so that the time expenditure caused by the extension of a storage space is avoided.

The invention discloses a high-availability database cluster system based on message-oriented middleware, comprising a database service layer composed of a plurality of database servers and a middle layer arranged between an application layer and the database service layer; wherein, the middle layer comprises a plurality of application proxies, a plurality of database middleware and a message bus; the application proxy is used for connection redirection when fault occurs on service nodes so as to keep service uninterrupted and improve reliability; the database middleware is used for interception, analysis, processing and retransmission of the database request message; and the message bus runs through the database middleware and the database server, which is responsible for global sorting of reading and writing operation sent by the data middleware so as to ensure data consistency and sending of the sorting result to the database server. A feasible approach is provided for the invention in order to obtain a high-performance database with high availability. The invention has the advantages of high availability, good scalability and easy construction and management.

The invention relates to the technical field of databases and discloses a system and method for realizing a distributed database. The system comprises a plurality of nodes forming a database cluster and an agent server, wherein each node forming the database cluster comprises two database instances, namely a master database and a backup database; the backup database on each node backs up data stored in the master database on another node in a non-repeated mode in accordance with a preset correspondence; the agent server comprises an operating processing unit which is used for receiving a read operating request from a user; a read operating node is selected from the plurality of nodes in accordance with the read operating request; and data requested by the user are read in the backup database of the read operating node, and the data are sent to the user. By using the system and method, the reliability of the data can be ensured at the same time of meeting the requirement of storing the mass data.

A method and system for monitoring the consistency of replicated databases in a shared-nothing database cluster architecture is presented. The method involves the continuous monitoring of the database transaction logs that are maintained by the autonomous database managers that manage the individual database replicas in the cluster. In the event that data discrepancies are detected via the comparison of the transaction logs of the individual database replicas, remedial action is carried out according to configured rules in the main cluster controller. Additionally, if the database management system running within each node of the cluster possesses a database history file that records key events pertaining to a database replica, such as the occurrence of non-logged bulk loads of table data, or the modification of tables, a method can be instituted for the monitoring of the history files for discrepancies between the database replicas.

Aspects of embodiments of the present disclosure include a highly available database cluster employing replication between two or more data files. The cluster also can maintain a connection with potentially geographically remote client application programs, including non-fault tolerant application programs, even in the event of one of the database management systems (DBMS) of the cluster becoming unavailable.

The invention provides a method for testing performance of a database. The method comprises the steps that a pressure model generating module generates pressure test data according to pre-generated SQL statements; more than one thread is adopted in a pressure execution module to send the generated pressure test data to a database cluster; a monitor module collects the performance information of the database; an analysis module judges whether the collected performance information of the database is located in a preset reasonable range or not, and a first test analysis report is generated according to a judgment result. The invention further provides a device for testing the performance of the database. According to the technical scheme, the performance of the database can be tested conveniently and flexibly.

A system, method, and computer program product for in-database clustering provides the capability to perform cluster analysis and provides improved performance in model building and data mining, good integration with the various databases throughout the enterprise, and flexible specification and adjustment of the models being built, but which provides data mining functionality that is accessible to users having limited data mining expertise and which provides reductions in development times and costs for data mining projects. A database management system for in-database clustering, comprises a first data table and a second data table, each data table including a plurality of rows of data, means for building a clustering model using the first data table, and means for applying the clustering model using the second data table to generate apply output data.

Aspects of embodiments of the present disclosure include a highly available database cluster that can maintain a connection with potentially geographically remote client application programs, including non-fault tolerant application programs, even in the event of one of the database management systems (DBMS) of the cluster becoming unavailable. For example, the database cluster can advantageously move a client connection between a failing, unbalanced, or overloaded DBMS, to another DBMS within the cluster. The database cluster can include connection managers that monitor a connection between a client application program and a primary DBMS. When one connection manager determines that the primary DBMS is unavailable, the connection manager of a secondary DBMS can assume the connection to the client application as if it were the primary DBMS. The connection manager can finish all open transactions, thereby avoiding the need to roll back the same. Moreover, the connection managers can monitor the connection at the DBMS communication level, such as, for example, the SQL*Net level.

The invention discloses a method for achieving system dynamic expansion in a shared-nothing database cluster, which includes the following steps: adding and detecting newly added data nodes and verifying connectivity of the newly added data nodes; initializing the newly added data nodes and synchronizing metadata information into the newly added data nodes; redistributing related tuples of a data table and distributed on the newly added data nodes in data nodes and the newly added data nodes, and leading operation on the data table in the redistributing process to be synchronous in the data nodes and the newly added data nodes; and modifying cluster configuration files in a cluster manager. The method solves the problem of difficulty in dynamic expansion of the shared-nothing database cluster, and greatly reduces influence on and loss of user service logic during expansion of the cluster. By means of the method, on-line expansion can be achieved, so that high expandability of a system can be ensured, and high availability of the system can further be ensured.

The invention provides a method for establishing a database cluster by utilizing virtualization, which utilizes the technical advantages of virtualization, ensures that all processing units in the database cluster obtain optimal resources, simultaneously improves the resource utilization rate of a physical hardware, and realizes the rapid deployment, expansion of the database cluster, the dynamic migration, the resource isolation of a multi-cluster system and the dynamic management of system resources, wherein the all processing units in the database cluster obtain optimal resources, i.e. a CPU, a memory and IO resources are customized and allocated in advance for a virtual machine according to the requirements of the processing unit in the database cluster for the resources in an underlying server system of the virtual machine; the improvement of the utilization rate of system resources means that a plurality of virtual machines are deployed and operated on the underlying server system of the virtual machine so as to improve the resource utilization rate of the underlying server of the virtual machine; the rapid deployment and expansion of the database cluster mean that the rapid expansion of the database cluster is realized through the mirroring replication function of a virtualized software; and the dynamic migration means that the dynamic migration of the virtual machine is realized by utilizing the virtualized software, and the service of the database cluster is not interrupted.

The embodiment of the invention provides a connection processing method and device in a multi-access scene. The connection processing method in the multi-access scene comprises the steps that a mobility management function receives a first transport message sent by an access network device, wherein the first transport message comprises a registration request message, and the registration request message comprises first multi-access indication information and identification information; the mobility management function determines that user equipment is registered with a first communication network and initiates registration with a second communication network according to the first multi-access indication information and the identification information; and the mobility management function performs a registration process of the user equipment in the second communication network. According to the embodiment of the invention, the processing performance of a database cluster can be effectively improved. According to the embodiment of the invention, the multi-access registration of user equipment in the first communication network and the second communication network can be realized.

The invention relates to a batch processing request-based Microsoft SQL server database cluster. The cluster consists of two parts, wherein a gateway and backups thereof are arranged at the front end of the cluster, and two or more of database server nodes are arranged at the rear end of the cluster; each node is provided with a structured query language (SQL) Server example and a cluster proxy and is not provided with a shared disk structure; and each node has an independent and consistent data set, and the cluster is only provided with a host. The gateway is used for managing the integral cluster; and for each client link, the gateway opens a database link corresponding to each node simultaneously to receive, analyze and optimize all client requests, wherein the client requests are divided into two classes, namely the read-only query requests and the data updating requests; for the read-only query requests, the gateway sends the requests to any one node to execute the requests according to a set load balancing algorithm so as to realize the real database access load balancing and improve the performance of a system; and the updating requests are sent to the host of the cluster to be executed, and are subjected to synchronous data by the host to other nodes to keep the data set of each node real-time and consistent, eliminate a single-point fault source and realize system fault tolerance. The integral cluster can improve the performance, availability and reliability of the system obviously and solve various problematic issues of the performance, single-point faults, zero data loss and the like in the field of databases, and is a comprehensive database cluster scheme.

The invention discloses a distributed database parallel processing system. The technical scheme is: a distributed parallel database controllable redundancy structure is adopted, and different types of database server nodes are used (full database servers, non-full database servers and void database servers). The database cluster mainly comprises non-full database servers which store partial data of the database cluster to share the work load; and multiple non-full servers constitute multiple complete data sets through the void database servers which ensure the completion of the data sets in function. The full database server can independently provide the completion of the data sets. The void database servers select server nodes in the database cluster to form a star network covering all data and used for retrieving all data in the database cluster and dynamically linking the data areas on multiple database server nodes.

The invention provides a cloud service platform, an information processing method and a data processing system, and is used for solving technical problems that an intelligent terminal is not flexible in management mode and is poorer in cooperativity. The platform comprises a database cluster which is used for storing data information, transmitted by intelligent household control equipment, of N intelligent household devices; a cloud account management center which is used for achieving account verification of M users based on M pieces of user log-in information in user data, and transmitting at least one household management table and M user identifications to the intelligent household control equipment corresponding to the M users after successful verification, wherein M is a positive integer less than or equal to N; and a cloud equipment management center which is used for receiving authority verification information transmitted by the intelligent household control equipment, and carrying out the call of P equipment service interfaces of P intelligent household devices configured with the first user identification after successful verification, and building a binding relation between the P intelligent household devices and the first user identification.

The invention discloses a data processing method for a database system, which comprises the following steps: mapping all the data records in a data sheet to corresponding data virtual partitions according to the mapping relationship between the data records and the data virtual partitions; mapping the data virtual partitions to corresponding database nodes on the basis of the mapping relationship between the data virtual partitions and the database nodes; and storing all the data records in the data sheet in the corresponding data virtual partitions of the corresponding database nodes. Correspondingly, the invention also discloses a database system. After the data processing method is adopted, the data repartitioning and the data distribution can be quickly carried out, so that the database clustering performance is enhanced.

A unified wallet manager (UWM) virtualized as a single virtual service in which all transactions relative to the UWM are treated as immutable facts permanently stored in append-only queues or ledgers from the time of their creation. A rules engine reads conversion requests in request calls to the service, and determines which rule or rules to apply to convert funds from one ledger to another, in the same or different vertically scaled gaming systems. The UWM is a peer of other vertical gaming systems, and the gaming systems access the UWM via an API server and data egresses from the UWM through an ETL process from a database cluster. The immutable queues allow for data reconstruction using any desired data model. The ledger stores funds of many different types, including real money, points, play money, and others. Third parties can integrate with the UWM through an integration hub connected to the UWM.

A system and methodology providing workload management in a database cluster. In one embodiment, for example, a method for allocating workload amongst a plurality of database servers sharing access to data comprises steps of: periodically collecting information about workload at each database server; distributing the workload information to each of the plurality of database servers; in response to a client connected to a first database server requesting that work be performed, examining the workload information to determine whether the requested work should be performed at a second database server having a lower workload than the first database server; if it is determined that the work should be performed at the second database server, automatically transferring the client connection to the second database server and performing the requested work at the second database server; and otherwise, performing the requested work at the first database server.

The invention relates to the field of development of computer application software, in particular to an integrated high-performance application software architecture and a construction method thereof. The integrated high-performance application software architecture comprises a WEB layer cluster, a backend application cluster, a database cluster and a message-oriented middleware cluster, wherein the WEB layer cluster supports a J2EE cluster technology and is used for providing the capacity of a business presentation layer of a J2EE frame; the backend application cluster supports the J2EE cluster technology and is used for providing the processing capacity of a business logic layer of the J2EE frame; the database cluster supports the J2EE cluster technology and is used for providing the capacity of a data access layer of the J2EE frame; and the message-oriented middleware cluster supports the J2EE cluster technology and is used for providing the message communication capacity between distributed J2EE components. Based on the integrated high-performance application software architecture and the construction method thereof, a software architect and a developer can determine a software scheme and a deployment scheme within short time and provides high-performance application service; and a J2EE application system designed according to the software architecture can meet the requirements on high availability, extensibility and fault tolerance.

The invention discloses a parallel query processing method for a share-nothing database cluster in a cloud computing environment. The method comprises the following steps of: firstly, segmenting a query plan to obtain sections which are executed by all data nodes; secondly, performing section processing on all data nodes to obtain Hash joins of all data nodes; and thirdly, performing Hash aggregation on control nodes by flowing of aggregated data between all data nodes to obtain a query result set. By the flowing operation of node data, the data can flow between all nodes in the query execution process, the parallel execution query process is finished, and an execution speed is greatly increased.

The invention discloses a realization method and system for a high-availability and high-performance database cluster. The method comprises the following steps: installing all dependent packages of distributed replicated block equipment software, a high-availability cluster assembly and the multi-master software of a database on a master machine and standby machines in the cluster; establishing the environment of the distributed replicated block equipment software on the master machine and the standby machines in the cluster; establishing the environment of the high-availability cluster assembly on the master machine and the standby machines in the cluster; establishing the multi-master environment of the database on the master machine, the standby machine and slave machines in the cluster; carrying out resource definition on the master machine and the standby machines in the cluster to enable the master machine and the standby machines in the cluster to be mutually switched and enable the salve machines to access the database service of the master machine or the standby machine. According to the realization method and system, free and open source software is used for improving a fault-tolerant function, a seamless handling capability can be provided when a certain node fails, a data loss rate is almost zero, the expandable multi-master node permits multiple computers to simultaneously process a complex data problem, and the database achieves high performance and high availability.

Indoubt transaction entries are recorded for each member of a database cluster, thereby avoiding the CPU cost and elapsed-time impact of persisting this information to a disk (either via a log write or a relational table I / O). This implementation allows for full read / write access and data coherency for concurrent access by all the members in the database cluster. At any given point in time, a full list of indoubt transactions is maintained for the entire database cluster in a relational table (e.g., an SQL table).

A system including a shared disk database cluster with multiple database nodes, the nodes configured to perform multiple processes, each database node configured to: insert data to a table, assign a unique location for the insert, the location representing a primary key and update the table without requiring contention between different processes.

The invention discloses a method and device for data migration in a database cluster. The method comprises the following steps of acquiring a snapshot of a source data node; recording incremental datain data fragments to be migrated according to stock data in the data fragments to be migrated backed up in the snapshot; migrating the backup stock data into a target data node; performing migrationon the recorded incremental data; in the migration process, when the incremental data which is not migrated meets the preset write lock conditions, notifying the source data node to execute write lockoperation on the data fragments to be migrated; migrating the incremental data which is not migrated to the target data node; after the migration of the incremental data is completed, notifying a coordination node to switch a route corresponding to the data fragments to be migrated from the source data node to the target data node. By using the method and device for data migration in the databasecluster provided by the invention, the database service interruption can be avoided in the data migration process.

The embodiment of the invention discloses a fault processing method and a fault processing device of a database cluster, and a terminal. The fault processing method of the database cluster comprises the steps of checking the connection state of a current main node in an MGR cluster based on a health examination function, wherein the main node and a domain name system are correspondingly arranged,and the main node provides a domain name system service for the domain name system; when checking that a fault occurs in the connection between the current domain name system and the current main node, acquiring a target main node corresponding to the current main node; and switching the current main node into the target main node based on a domain name switching function, and building a corresponding relation between the current domain name system and the target main node. According to the technical scheme provided by the embodiment of the invention, the technical problems that the existing database cluster consumes many manpower and material resources for repairing the fault and the fault repairing time is uncertain can be solved, and the connection layer fault of the database cluster can be quickly processed.

System, method, computer program product embodiments and combinations and sub-combinations thereof for snapshot isolation support for distributed query processing in a shared disk database cluster are provided. The embodiments include the forming of object identification data in a leader node of query execution in the shared disk database cluster. At least one fragment of the query execution is distributed to at least one worker node in the shared disk database cluster, and the object identification data is utilized for multiversion concurrency control during query execution by the leader node and at least one worker node.

The invention discloses a database synchronization deployment and monitoring method and a database synchronization deployment and monitoring method, which are used for solving the technical problem that a data synchronization function is complicated to install and configure when a database cluster system is deployed so as not to facilitate centralized management, monitoring and maintenance. The method and the device are characterized in that: a data synchronization module and a data monitoring module are deployed in each synchronous database; configuration parameters and metadata related to database synchronization are created in a metadata management module; and uniform control, display and maintenance functions are provided through an operation and maintenance module. Through the method and the device, the deployment, execution, display and monitoring of the database synchronization can be performed on a database cluster in a centralized way so as to reduce the maintenance cost, improve engineering normalization and realize the centralized management, monitoring and maintenance of the data synchronization.

A database management system provides the capability to perform cluster analysis and provides improved performance in model building and data mining, good integration with the various databases throughout the enterprise, and flexible specification and adjustment of the models being built, but which provides data mining functionality that is accessible to users having limited data mining expertise and which provides reductions in development times and costs for data mining projects. The database management system for in-database clustering, comprises a first data table and a second data table, each data table including a plurality of rows of data, means for building a clustering model using the first data table, means for building a probabilistic model using the clustering model, and means for applying the probabilistic model using the second data table to generate apply output data.