30 results about "Cluster expansion" patented technology

The invention discloses a multi-tenant-oriented network architecture. The cloud network architecture comprises computing nodes, a virtual router cluster and a cloud gateway. Virtual machines which are included in the computing nodes perform message exchange with a public server in a private network through the virtual router cluster. Furthermore message exchange between the virtual machines and a public network is realized through the virtual router cluster and the cloud gateway, wherein the virtual router cluster comprises at least two virtual routers, and each virtual router transmits a same IP address to a private network switch. The cloud gateway comprises at least two gateway nodes. Each gateway node transmits an equivalent default router to the private network switch. Furthermore each gateway node transmits a same floating IP address to a public network router or a public network switch, thereby realizing cluster expansion of the cloud network architecture, preventing serviceability reduction of the whole network caused by fault of a single node and improving defensive capability of the network to attacks.

The invention relates to a method for extraction and deviation warning of a lane line. The method is characterized in that the method comprises the following steps that: an image preprocessing step is executed; more specifically, a camera is calibrated to obtain an inverse projection transmission picture, a single-line DLD feature image and a double-line DLDLD feature image are extracted, operators are extracted according to the two features and binarization processing is carried out on the operators, and clustering expansion processing is carried out on white pixels in the binarization images from bottom to up; continuous linear piecewise function fitting is carried out on the feature points in a predefined grid and coordinates of starting points and end points as well as corresponding gradients of all the piecewise functions are recorded; dashed and solid line determination is carried out on the feature points; and a multi-segment tracking step, a multi-segment extension step, an inspection step and a lane line determination step are carried out to determine a lane, thereby making a deviation warning decision. Advantages of the method are as follows: the lane line detection algorithm is suitable for various complicated urban roads; and because less computation is required and thus operation can be carried out under the circumstance of low-end hardware, the method is simple, secure and reliable.

The invention discloses a virtual cluster automatic expansion method under a cloud computing environment. An automatic expansion cluster comprises a control center unit, a monitoring center unit, a cluster node unit and an external storage unit. The method comprises the steps as follows: a user initializes cluster configuration, and builds and starts a cluster; the cluster dynamically adds nodes (a core node, a computing node and an external storage); the cluster dynamically remove the nodes (the core node, the computing node and the external storage); the monitoring center collects cluster node system performance index data, simply analyzes and quantitatively display the data; and the user schedules the cluster manually. According to the method provided by the invention, a cluster elasticcomputing resource service can be flexibly, simply, economically and automatically adjusted, and a cloud server cluster with a certain expansion capability based on a cluster load is built. In addition, the cluster expansion operating method provided by the invention can be configured to be automatically executed without human interference, so that the cluster is more efficient and intelligent inoperation processing.

The invention relates to a distributed acceleration method and system for a deep learning training task. The method comprises the following steps: (1) building a distributed GPU training cluster; (2)adopting a swap-in swap-out strategy, and adjusting a minibatch size on a single GPU working node in the distributed GPU training cluster is adjusted; (3) adjusting the learning rate according to theminibatch size determined in the step (2); And (4) carrying out deep learning training by adopting the hyper-parameters minibatch size determined in the steps (2) and (3) and the learning rate. On thepremise that the training accuracy is not affected, the communication time is greatly compressed simply and efficiently by reducing the number of times of parameter updating communication between clusters, and compared with a single GPU mode, the cluster expansion efficiency can be fully improved in a multi-GPU mode, and acceleration of the training process of the ultra-deep neural network modelis achieved.

The invention discloses a method, a device and equipment for cluster node expansion. The method comprises the steps of determining a main node from M nodes contained in a server cluster, wherein M is an integer which is larger than or equal to 2, and the voting number obtained by the main node is larger than a preset threshold vale and is less than or equal to M; carrying out node expansion on the server cluster, wherein the server cluster after expansion contains N nodes, a main node in the server cluster after expansion is still the main node in the server cluster before expansion, N is an integer which is larger than or equal to 2, and M is larger than N / 2.

The invention relates to the technical field of cloud computing, in particular to a virtual cluster expanding method based on cloning. The method includes the steps that firstly, all physical machines share one network sharing catalog, and when clusters are established, original virtual machine mirror image files are copied to the sharing catalog; then, external snapshot files are established for the original virtual machine mirror image files and stored in local catalogs of the physical machines, and virtual machines are established in an external snapshot mode; when the scale of the virtual clusters needs to be expanded, the local catalogs, selected to be established, of the physical machines are searched for the external snapshot files, if the external snapshot files exist, local cloning is conducted, and if no external snapshot files exist, cloning is conducted from the long distance to the local; finally, a front-end server writes the IP addresses of the newly-established virtual machines into a cluster list, and cluster expansion is finished. The virtual clusters are expanded based on the cloning technology for external snapshots, and a cluster expansion scheme which is quick, universal and high in flexibility is provided; the method can be used for expanding the virtual clusters.

The invention relates to an Elasticsearch cluster expansion method supporting resource leveling. The method includes steps of S1, mounting Elasticsearch nodes according to server hardwire resource; S2, setting basic parameters of a dynamic cluster and recording some state values of the dynamic cluster, and performing data persistence on the parameters and the dynamic values in format of database or XML into a magnetic disk; S3, creating a thread, detecting file number and space occupancy regularly, and creating zones and adjusting storage strategy dynamically according to system parameters ifa threshold value is reached. According to the invention, data volume of corresponding proportions can be stored according to performance load leveling of a server in an Elasticsearch cluster and automatic creating of bases and zones are supported according a target data volume and the magnetic disk space threshold value, and the cluster is expanded dynamically. Therefore, problems of excessive data volume of one zone and local hot spots during new data insertion are avoided. At the same time, automatic recognition and load leveling on bases and zones of the Elasticsearch cluster can be realized after a new server is added into the cluster.

The invention provides a data storage method and apparatus. The method comprises the steps of obtaining a to-be-stored first data file and a first LUN identifier corresponding to the first data file;according to first cluster view information, determining multiple first OSDs corresponding to the first LUN identifier, wherein the first cluster view information comprises a corresponding relationship between the first LUN identifier and the first OSDs; splitting the first data file into multiple data blocks, determining the first OSDs corresponding to the data blocks, and sending the data blocksto the corresponding first OSDs, thereby enabling the first OSDs to store the data blocks; and storing metadata corresponding to the first data file in a monitoring server. Through the technical scheme, the metadata quantity is greatly reduced; the metadata access frequency and quantity are reduced; the cluster access performance is improved; and storage resources occupied by the metadata are saved. Meanwhile, an expansion scheme based on zero data migration of a cluster view version is provided, so that the influence of the cluster expansion process on the system performance is reduced.

The invention provides a method and a device used for realizing cluster dynamic expansion in a distributed framework. The method comprises the steps of determining that a cluster dynamic expansion demand exists, wherein the cluster comprises multiple slave nodes, and the multiple slave nodes are divided into a calculation resource group and a storage resource group based on the provided resource services; and adjusting the number of the slave nodes in the calculation resource group and / or the storage resource group based on the cluster dynamic expansion demand. The technical scheme provided by the invention can better match a cluster size and processing capability with a demand for a storage resource and a calculation resource in an actual application scene, accordingly efficiently avoids the phenomenon of cluster resource shortage and cluster resource waste, and further improves the performance of the cluster while improving the flexibility of the cluster dynamic expansion.

The invention provides an expansion method for supporting non-halt of a multi-hash map database cluster system. The expansion method comprises the following steps: S1, binding all original tables in a cluster onto an existing hash map which is named old hash map; S2, during cluster expansion, executing a command for generating a new hash map, generating the new hash map through a cluster, and setting the hash map as a current hash map; S3, automatically binding tables which are newly created after cluster expansion onto the current hash map; S4, participating into operation with new tables after performing dynamic data redistribution according to the current hash map, wherein in any operation on the original tables and the new tables, the current hash map is taken as a hash map of current operation, and the original hash characteristics of old tables based on an old hash map are lost; S5, migrating a part of data onto a new node, and binding the tables onto the current hash map after the completion of migration. Through the design, performance attenuation is avoided, and natural data transition is realized.

A cloud communication based collection front-end system relates to a front end system. Currently, since the quantity scale of connection terminals of a power consuming collection system is large, fullrecord loading cannot be accepted for management of a single-node program memory. The technical scheme includes a communication gateway cluster, a communication front end machine cluster connected with the communication gateway cluster, a message queue cluster connected with the communication front end machine cluster and performing queue processing on data and a zookeeper distributed service cluster connected with the communication front end machine cluster. The distributed service cluster forms a zookeeper distributed service system. According to the technical scheme, a zookeeper distributed application program is adopted to achieve share of node manage and data share between front end machines. By adopting the technical scheme, collection front end cluster expansion becomes simple andefficient. The distributed expansion capability of the collection front end system is enhanced through cloud communication technology and load balance capability of the front end machine system is enhanced.

The invention discloses a BDCH-DBSCAN-based taxi passenger-carrying hotspot identification method. The method comprises the steps of firstly providing a large amount of taxi GPS data tracks, and deleting interference data from the data tracks; extracting get-on data points and get-off data points in the GPS data tracks; performing multi-thread block clustering on the extracted data points, separating out core points by adopting a DBSCAN algorithm, obtaining a neighbor node set of the core points, and performing cluster expansion operation on the core points, wherein cluster expansion refers tooperations of performing class cluster division on neighbor points of the core points and adding the neighbor core points with a number greater than a minimum cluster point number and domains of theneighbor core points into clusters; and according to a curved surface distance between two points, finding out neighbor nodes in a scanning radius, finding out a maximum density point in each clusterto serve as a cluster center, and cyclically clustering cluster center sets again until the set quantity and the precision meet the requirements. According to the method, large-scale data can be adapted; class cluster centers are convenient to identify; the multi-thread clustering speed is high; and the accuracy is high.

The invention discloses a method for rapidly expanding a computer cluster based on the P2P network technology. The method relates to a control system and a P2P distribution network. The control system comprises a front-end computer directly interacted with a user and control system client terminals contained in all target computers to be deployed. The P2P distribution network is based on the P2P network technology and is composed of the P2P client terminals of the target computers to be deployed and a Tracker server. On the basis of the BT transmission protocol, information is exchanged among nodes in the computer cluster based on the protocol so that rapid distribution of data can be achieved. According to the method, cluster expansion in a large-scale cluster operation and maintenance scene can be achieved, complexity of manual operation and faulty operation which might be brought by manual operation can be avoided, the speed of cluster expansion can be greatly improved, and the purpose of rapid deployment of a new computer in the cluster can be achieved.

An embodiment of the invention discloses a cluster expansion method and an apparatus thereof. The method comprises the following steps of acquiring a target number of main nodes after expansion; according to the target number and a preset proportion, determining a maximum number of the main nodes contained by a same physical machine after expansion; determining the current physical machine containing the number of the main nodes to be a target physical machine, wherein the number of main nodes is less than the maximum number; based on a first number of the main nodes contained by a first physical machine and the maximum number, determining a second number of the main nodes which need to be distributed currently; distributing the second number of main nodes in the target physical machine; determining whether to complete cluster expansion; and if the cluster expansion is not completed, returning to an execution step and determining the current physical machine to be the target physical machine, wherein the number of the main nodes contained by the current physical machine is less than the maximum number. By using the scheme in the invention, after transverse expansion of a cluster isperformed, the whole cluster can still work normally when any one physical machine in the cluster generates a fault so that all the main nodes contained by the physical machine go down.

The embodiments of the invention provide a method, apparatus and system based on an SSL session. The method comprises the following steps: receiving a client greeting message sent by a client; according to the client greeting message, determining session identification content exists and obtaining a determination result; and according to the determination result, scheduling SSL servers in an SSL cluster of the SSL session of the client, and sending the client greeting message to the corresponding SSL server. By using the technical scheme provided by the invention, the method, apparatus and system have the following advantages: the hit rate of the SSL Session is improved, and cluster expansion is also realized.

The invention provides a business processing method. The method comprises the following steps of: setting at least two virtual slot clusters in a practical slot cluster, wherein each of the virtual slot cluster comprises at least one slot under at least one node in the practical slot cluster; receiving a business logic task and determining a virtual slot cluster which executes the business logic task according to a data size of the business logic task; and executing the business logic task by using the virtual slot cluster. The invention furthermore provides a business processing device. According to the business processing method and the business processing device provided by the invention, the virtual slot cluster which executes the business logic task is determined according to the datasize of the business logic task, and expansion can be carried out on the slots of the virtual slot clusters, so that slot cluster expansion ability of the business processing device is enhanced, calculation requirements of stream data businesses with different priorities are satisfied, and stream data business isolation of different users can be realized.

The embodiment of the invention provides a cluster expansion method, a cluster communication system and a communication system and method so that complexity of a DUT is reduced and topology of an original three-layer network is maintained. The method comprises that: at least two devices under test DUT arranged between a first switching device and a second switching device transmit a link aggregation control protocol LACP message in an unvarnished way so that the first switching device and the second switching device are enabled to negotiate aggregation characteristics of a link aggregation group LAG; and after negotiation of the aggregation characteristics of the link aggregation group LAG is succeeded, flow is distributed to the at least two devices under test DUT to perform transmission by the first switching device and the second switching device. Realization of a complex routing protocol on the DUT is avoided by the method, requirements for the DUT are reduced and network properties and the network topology of the DUT are not rigidly required so that the original three-layer network topology can be maintained to be unchanged, and thus complexity and high cost caused by changing of the network topology structure can be avoided.

The invention discloses a multi-purpose aircraft suitable for a multi-carrier environment and a combination body of the multi-purpose aircraft. The multi-purpose aircraft suitable for the multi-carrier environment achieves the multi-purpose multi-carrier function of the multi-purpose aircraft, when an aircraft body is in other states (land cruise or water cruise) other than flight, the power consumption amount is greatly reduced compared with the situation that the aircraft is in the flight state, the average power consumption amount of the multi-purpose aircraft suitable for the multi-carrierenvironment is reduced to a certain degree, and all-terrain all-day application base is provided for achieving cluster expansion of the multi-purpose aircraft of the multi-carrier environment. In addition, the multi-purpose aircraft has the multi-user and multi-role interactive scene, especially networked interactive application, and a lower cost and less power-consuming software and hardware platform is provided.

The invention provides an expansion method for supporting non-halt of a multi-hash map database cluster system. The expansion method comprises the following steps: S1, binding all original tables in a cluster onto an existing hash map which is named old hash map; S2, during cluster expansion, executing a command for generating a new hash map, generating the new hash map through a cluster, and setting the hash map as a current hash map; S3, automatically binding tables which are newly created after cluster expansion onto the current hash map; S4, participating into operation with new tables after performing dynamic data redistribution according to the current hash map, wherein in any operation on the original tables and the new tables, the current hash map is taken as a hash map of current operation, and the original hash characteristics of old tables based on an old hash map are lost; S5, migrating a part of data onto a new node, and binding the tables onto the current hash map after the completion of migration. Through the design, performance attenuation is avoided, and natural data transition is realized.

A high-expanded data center all-optically interconnected network system and a communication method are provided. A network system optical switch and a server of the invention adopt hierarchical network topological structure based on cluster expansion. The routing method comprises the following steps of: 1 generating a data packet; 2 calculating the communication wavelength of the data packet; 3 modulating the operating wavelength of a laser; 4 sending the data packets; 5 receiving the data packet by the optical switch; 6 determining whether the current optical switch satisfies a routing cut-off condition; 7 outputting the data packet from a routing port determined according to the routing method based on topology; 8 transmitting the data packet to a destination server; and 9 receiving the data packet by the destination server. The high-expanded data center all-optically interconnected network system has the advantages of simple structure, low communication delay and large throughput.

The embodiment of the invention relates to a method and a device for supporting cluster expansion. Particularly, the invention discloses a method for recording configuration context of initial node of a cluster, wherein the method comprises the following steps: acquiring at least one file to be used for configuring the initial node; and recording context in the process of using at least one file to configure the initial node, in which the recorded context is information related to the configuration of the initial node and is used for supporting to add a new node to the cluster. Correspondingly, the invention further discloses a method for supporting adding the new node to the cluster, wherein the method comprises the following steps: accessing the context of the existing node of the cluster, in which the context is information related to the configuration of the existing node in the process of adding to the cluster; and acquiring at least one file according to the context, in which the at least one file is used for configuring the new node. A corresponding device is further disclosed. According to the embodiment of the invention, the efficiency of cluster expansion can be efficiently improved.

The invention provides a method and a device used for realizing cluster dynamic expansion in a distributed framework. The method comprises the steps of determining that a cluster dynamic expansion demand exists, wherein the cluster comprises multiple slave nodes, and the multiple slave nodes are divided into a calculation resource group and a storage resource group based on the provided resource services; and adjusting the number of the slave nodes in the calculation resource group and / or the storage resource group based on the cluster dynamic expansion demand. The technical scheme provided by the invention can better match a cluster size and processing capability with a demand for a storage resource and a calculation resource in an actual application scene, accordingly efficiently avoids the phenomenon of cluster resource shortage and cluster resource waste, and further improves the performance of the cluster while improving the flexibility of the cluster dynamic expansion.

The invention relates to a method for extraction and deviation warning of a lane line. The method is characterized in that the method comprises the following steps that: an image preprocessing step is executed; more specifically, a camera is calibrated to obtain an inverse projection transmission picture, a single-line DLD feature image and a double-line DLDLD feature image are extracted, operators are extracted according to the two features and binarization processing is carried out on the operators, and clustering expansion processing is carried out on white pixels in the binarization images from bottom to up; continuous linear piecewise function fitting is carried out on the feature points in a predefined grid and coordinates of starting points and end points as well as corresponding gradients of all the piecewise functions are recorded; dashed and solid line determination is carried out on the feature points; and a multi-segment tracking step, a multi-segment extension step, an inspection step and a lane line determination step are carried out to determine a lane, thereby making a deviation warning decision. Advantages of the method are as follows: the lane line detection algorithm is suitable for various complicated urban roads; and because less computation is required and thus operation can be carried out under the circumstance of low-end hardware, the method is simple, secure and reliable.

The invention discloses a capacity expansion method and device for a server cluster system and the server cluster system. The method includes: the load balancing server receives the first access request from the client; the load balancing server calculates the first hash value; the load balancing server determines the original cache server corresponding to the first hash value; the load balancing server calculates the second hash value The load balancing server determines the cache server corresponding to the second hash value; the load balancing server receives the content corresponding to the first access request in the original cache server corresponding to the first hash value via the newly added cache server corresponding to the second hash value; The load balancing server sends the received content to the client. Through the present invention, it is realized that the newly added cache server obtains the service content from the original cache server instead of directly from the source site, thereby achieving the effect of improving the hit rate of the cache server and reducing the pressure of the source site.

The method for automatic elastic expansion of Web applications based on the session-based cloud computing environment of the present invention includes: a) deployment of the Web application system; b) judging the number of used resources; c) increasing the number of resource quotas; d) obtaining the number of instantaneous session connections ; e) comparison of the number of instantaneous session connections; f) calculation of the average number of session connections; g) comparison of the average number of session connections; h) judgment of remaining resources; i) increase of Web application servers; j) judgment of the number of application servers; k ) to delete the web application server. The web application automatic elastic expansion method of the present invention dynamically expands and reduces highly concurrent web application systems and web application system clusters with more or less sessions within a certain time interval through the instantaneous number of session connections and the average number of session connections operation, realizes the dynamic adjustment of the web application system based on the session, and improves the adaptability of the web application system.

The embodiment of the invention discloses a cluster expansion method and device. The method comprises the steps of obtaining the target node group number of nodes in a cluster after transverse expansion is carried out; determining the maximum group number of the nodes contained in the same physical machine after the transverse expansion is carried out, according to the target node group number anda preset proportion; determining the physical machine of which group number of the currently contained nodes is smaller than the maximum group number as a target physical machine; determining the first node group number of currently to-be-allocated nodes based on the first group number of the nodes contained in a first physical machine and the maximum group number; allocating the nodes containedin the node groups of the first node group number within the target physical machine until the transverse expansion of the cluster is finished, otherwise, returning to perform the step of determiningthe physical machine of which group number of the currently contained nodes is smaller than the maximum group number as the target physical machine. Through application of the scheme, it is ensured that after the transverse expansion of the cluster is carried out, when all nodes contained in any physical machine crash due to a fault occurring in the physical machine of the cluster, the whole cluster still can work normally.

The present application discloses a method and system for supporting IoT middleware cluster expansion. The method includes: receiving a control command for an IoT gateway, and using a load balancing forwarder to send the control command to any IoT middleware Server; if the long connection between the Internet of Things middleware and the Internet of Things gateway is not stored in the pre-built long connection cache area, and the relevant information of the Internet of Things gateway is stored in the pre-built long connection mapping table, then , establishing a connection with the IoT gateway according to the IP information carried in the relevant information, and sending the control instruction to the IoT gateway. This method not only realizes the expansion of the IoT middleware cluster, but also enables the load balancing forwarder to truly realize the load balancing function.

A collection front-end system based on cloud communication relates to a front-end system; at present, due to the large number of collection terminals in the electricity collection system, the management of the program memory of a single node cannot accept a fully loaded file. The technical solution includes a communication gateway cluster, a communication front-end machine cluster connected with the communication gateway cluster, a message queue cluster connected with the communication front-end machine cluster for queuing data, and a communication gateway cluster and a communication front-end machine cluster. The zookeeper distributed service cluster; the distributed service cluster forms the zookeeper distributed service system. The technical solution adopts the zookeeper distributed application program coordination service system to solve the node management and data sharing between the front-end machines. The technical solution makes the acquisition front-end cluster expansion simpler and more efficient; the distributed expansion capability of the acquisition front-end system is enhanced through the cloud communication technology; the load balancing capability of the front-end computer system is enhanced.