477results about How to "Improve access performance" patented technology

A virtual storage migration method is provided, including: starting a data migration process, and copying, from a source storage device to a destination storage device, a data block in a virtual disk to be migrated; when a VM front-end I / O read request is received, directly reading, corresponding data from the source storage device; when a VM front-end I / O write request is received, determining whether a migration data block that corresponds to the write request is being migrated, if yes, executing a write operation that corresponds to the write request after the migration of the migration data block is completed, if no, executing a write operation that corresponds to the write request; and after all the data blocks in the virtual disk to be migrated are copied to the destination storage device, stopping the data migration, and switching the virtual disk from the source storage device to the destination storage device.

In order to manage the various types of attribute information within the storage-device system, the storage-device system includes the following databases within a file-access controlling memory: a database for managing index information for managing contents of the files, and an index retrieval program, a database for managing the attribute information on the files, and a database for managing storage positions of blocks configuring a file. When the storage-device system receives an access request to a file, the utilization of these databases allows the storage-device system to make the access to the access-target file.

An embodiment of the invention provides an operation processing method of a data storage system and the data storage system. The operation processing method includes that a storage magnetic disk of the data storage system comprises a hash table bucket and index blocks and receives data operation processing request message which carries data identification, the corresponding index block is obtained from a harsh table according to the data identification, mapping relation of the data identification and the index block is stored in the hash table, and each index block stores an index record which includes the mapping relation of the data identification and a data block storing data identified by the data identification. Identification of the data block storing the data identified by the data identification is obtained from the index record of each index block, and corresponding data operation processing is conducted on the data block that the identification of the data block corresponds to. By means of the method, the harsh table bucket and the index blocks can be stored in the storage magnetic disk to enable the operation method of the system to be further simplified. Visit performance of the magnetic disk can be further improved to some extent.

In a process for managing a plurality of data items contained in a plurality of pages which are sequentially arranged in accordance with predetermined relationships, information on an amount of available space in each of the plurality of pages is stored. When a first data item is inserted into or deleted from a first page among the plurality of pages, an amount of available space in each of second and third pages is acquired based on the above information, where the second page precedes the first page in the sequential arrangement of the plurality of pages, and the third page follows the first page in the sequential arrangement. Before insertion of the first data item into the first page or after deletion of the first data item from the first page, at least one second data item contained in the first page is moved to the second page or the third page according to the amount of available space in each of the second and third pages.

According to the present invention, it is possible to enhance a performance in accessing a storage system, without performing data migration process between the storages constituting the storage system. A virtualization controller 2 connecting a host computer 1 and a storage 3 constituting the storage system controls a plurality of access paths (path such as port 6—backplane 9—port 6, port 6—backplane 9—storage controller 7—port 6) provided within the virtualization controller. It further performs a control so that an optimum access path is selected for switching, out of the plurality of access paths, based on setting information from a management server 4 by a system administrator and various monitoring results detected by the virtualization controller itself.

The invention provides a migration strategy adjustment method as well as a capacity change suggestion method and a migration strategy adjustment device. The migration strategy adjustment method comprises the following steps: counting the capacity information of a first storage resource pool on a data storage server cluster within a preset time period, wherein the first storage resource pool is used for storing a data fragment with an access hotness value exceeding a preset access hotness threshold value; judging whether the storage capacity of the first storage resource pool is changed according to the capacity information; and under a condition that the storage capacity is changed, adjusting a migration strategy for the data segment of the data storage server cluster. According to the migration strategy adjustment method, the problem of waste of high-performance storage media or reduction of the access performance of service due to manual static setting of the migration strategy is solved; and the utilization rate of the high-performance storage media can be increased, and the access performance of the service is improved.

The disclosed embodiments disclose techniques for transferring and caching a cloud file in a cloud controller. Two or more cloud controllers collectively manage distributed filesystem data that is stored in one or more cloud storage systems; the cloud controllers cache and ensure data consistency for the stored data. During operation, a cloud controller receives a client request for a data block of a target file that is stored in the distributed filesystem but not currently cached in the cloud controller. The cloud controller initiates a request to a cloud storage system for a cloud file containing the requested data block. While receiving the cloud file from the cloud storage system, the cloud controller uses a set of block metadata in the portion of the cloud file that has already been received to determine the portions of the cloud file that should be downloaded to and cached in the cloud controller.

The invention discloses a data page caching method for a file system of a solid-state hard disc, which comprises the following implementation steps of: (1) establishing a buffer link list used for caching data pages in a high-speed cache; (2) caching the data pages read in the solid-state hard disc in the buffer link list for access, classifying the data pages in the buffer link list into cold clean pages, hot clean pages, cold dirty pages and hot dirty pages in real time according to the access states and write access states of the data pages; (3) firstly searching a data page as a page to be replaced in the buffer link list according to the priority of the cold clean pages, the hot clean pages, the cold dirty pages and the hot dirty pages, and replacing the page to be replaced with a new data page read from the solid-state hard disc when a free space does not exist in the buffer link list. In the invention, the characteristics of the solid-state hard disc can be sufficiently utilized, the performance bottlenecks of the external storage can be effectively relieved, and the storage processing performance of the system can be improved; moreover, the data page caching method has the advantages of good I / O (Input / Output) performance, low replacement cost for cached pages, low expense and high hit rate.

The non-volatile storage SSD has non-volatile NVM, RAM capable of being accessed at a higher speed than this NVM, and a control unit for controlling accesses to the NVM and to the RAM. The control unit stores in the NVM an address translation table (LPT) that translates a logical address given to access this NVM to a physical address after dividing it into multiple tables, and stores in the RAM the multiple address translation tables-sub on RAM (LPT-SRs) that have been divided into multiple tables.

The invention provides a method for realizing partner selection and cooperative transmission combining with position information. The method is to obtain the position information of each node by directly using a cooperative positioning technology of a cooperative communication system and provide a partner selection strategy according to the large-scale fading condition of information transmission: an information source firstly calculates a distance between the information source and each candidate trunk node; the information source adds the distance between the information source and each trunk node and the distance between each trunk node and a base station by combining the obtained position information of each candidate trunk node and the distance information between the candidate trunk node and the base station; the information source selects a trunk node with the minimum total distance value of a trunk information channel as a cooperative partner of the information source to help the information source transmit information, after the total distance value of the trunk information channel of each trunk node is known, thereby realizing gain of space diversity reception, reducing path loss, and achieving the aims of reducing the bit error probability during transmitting, improving the signal quality and expanding the network coverage.

A method and apparatus for improved communication in a communications system is disclosed. The improvement involves storing connection data at a client end of a client-server connection within a communications system. Connection data is transmitted from a server communications device to a data access device. This connection data history can later be retrieved and analyzed by a server communications device to assist in the optimal configuration of communication sessions between the data access device and the server communications device within the communications system.

Processing time for job execution is shortened by using computation capability to the maximum extent possible.When a user makes a job request, the job request is sent from an LDS program of a first computer to a second computer; the second computer executes data preparation processing and empty area reservation processing with regard to a storage unit (disk A) and stores the results to an the FIFO of the first computer; when the output from the FIFO is transferred via a job release program to the LDS program, the transferred content is then transferred to a third computer; and the third computer selects a computer that should execute the job, from among a group of computers and commands the selected computer to execute the job.

The invention discloses an adjacent area list information and access list information updating method and a terminal and a base station thereof, wherein the adjacent area list information updating method comprises the following steps that: the terminal receiving base station sends the updating information of the adjacent area list information comprising sub-base station information, wherein the updating information carries information of revising the current adjacent area list information to the terminal; and the terminal updates the adjacent area list information stored locally according to the updating information. Through the technical scheme, the invention can effectively reduce the communication overhead between the base station and the terminal, and simultaneously, improve the switching and the accessing performance of the wireless communication system.

The invention discloses a system and a method for metadata management. The system comprises a message engine, a node monitor, a metadata management module, a metadata backup module, a directory heat monitor, a directory replication module and a directory migration module. Metadata of the system are distributed in nodes of a metadata cluster instead of a single capacity limited in memory capacity, so that the memory capacity can be expanded horizontally; a dynamic distribution policy is adopted in the distribution of the metadata, so that high availability and high memory capacity of a distributed file system required in enterprise application environment and high expansibility of the memory capacity and access performance are improved.

The embodiment of the invention provides a cache replacing method, a cache controller and a processor. The method comprises the following steps that: the cache controller determines an associated cache pool of a cache line to be replaced, wherein each associated cache row in the associated cache pool and the cache row to be replaced belong to the same memory row; a cache row to be written back is further determined from the associated cache pool according to the access information of the associated cache row; and data in the cache row to be replaced and the cache row to be written back are simultaneously written into a memory. The cache row to be replaced and the cache row to be written back belong to the same memory row, so that the hit rate of the cache region can be improved; and the memory access performance is improved. The cache controller further determines the cache row to be written back from the associated cache pool according to the access information of the associated cache row, and only the cache row to be written back in the associated cache pool is written into the memory, so that the number of the memory writing times can be reduced; and the service life of the memory is prolonged.

Authentication access method and authentication access system for wireless multi-hop network. Terminal equipment and coordinator have the capability of port control, the coordinator broadcasts a beacon frame, and the terminal equipment selects an authentication and key management suite and transmits a connecting request command to the coordinator. The coordinator performs authentication with the terminal equipment according to the authentication and key management suite which is selected by the terminal equipment, after authenticated, transmits a connecting response command to the terminal equipment. The terminal equipment and the coordinator control the port according to the authentication result, therefore the authenticated access for the wireless multi-hop network is realized. The invention solves the security problem of the wireless multi-hop network authentication method.

The disclosed embodiments provide a system that adjusts the characteristics of a distributed filesystem using a locality policy. Two or more cloud controllers collectively manage distributed filesystem data that is stored in one or more cloud storage systems; the cloud controllers cache and ensure data consistency for the stored data. During operation, a cloud controller receives a locality policy that specifies one or more management policies for the cloud controller. The portion of the distributed filesystem's data that is managed, created, and / or cached at the cloud controller is then managed based on this locality policy. Locality policies facilitate customizing and optimizing data management for the distributed filesystem to fit the needs of an organization (e.g., specific sets of users, applications, and / or datasets).

The invention relates to a system and method for real-time graph data processing based on a BSP (Board Support Package) model. The system comprises a data storage unit, a graph data inquiring and counting unit and a graph data analyzing and processing unit, wherein the data storage unit is used for preprocessing graph data, storing the graph data according to a memory storage-distributed memory storage-distributed file system three-layer storage structure and generating an operation based on the graph data, the graph data inquiring and counting unit is used for inquiring and counting the graph data, decomposing the operation generated by the data storage unit into a plurality of tasks, distributing the tasks to corresponding calculating nodes in an equalized manner, carrying out statistics on all task calculation results, combining all the task calculation results and returning the combined task calculation results serving as a final result to users, and the graph data analyzing and processing unit is used for enabling all the calculating nodes to execute the decomposed tasks through iterative calculation, realizing the synchronization of iterative calculation of each time through message passing and outputting the task calculation results. The method is used for realizing the real-time graph data processing based on the system. The system and the method have the advantages that the access efficiency is high, the cluster load balancing is kept, the execution efficiency of the BSP model is accelerated, and the like.

The invention provides a control method of a database connection pool. The control method includes: normalizing thread priority; judging whether the current connection pool is empty or not, if not, taking out first data connection, setting the current state to be busy, and returning to the data connection; if yes, judging whether number of unreturned data connection in a current external program reaches maximum number of connection in the connection pool or not, if not, increasing the data connection prior to adding the same to the current database connection pool, and returning to the first data connection of the database connection pool; if the number of the unreturned data connection used in the current external program reaches the maximum number of the connection, setting the priority of the current thread, acquiring first time as current time, circularly judging whether the current connection pool is empty or not, and allowing the database connection pool to enter a waiting state. Data access performance can be effectively improved under the condition of high concurrency and multi-data source environment.

The invention relates to a system and method for achieving metadata analysis based on distributed cache. The system comprises a metadata analysis client-side, a metadata analysis server-side, a distributed cache framework server and a distributed cache server. The method comprises the steps that the distributed cache framework server loads data in a metadatabase into the distributed cache server and creates a connection pool; the metadata analysis client-side sends a corresponding metadata analysis message to the metadata analysis server-side; the metadata analysis server-side inquires the distributed cache server according to a metadata analysis task which is analyzed and sends a corresponding analysis result message to the metadata analysis client-side; the metadata analysis client-side analyzes the analysis result message and displays a metadata analysis result. By means of the system and method for achieving metadata analysis based on distributed cache, data access performance is improved, the response speed of metadata analysis is increased, user experience is improved, and the system and method have a wider application range.

The invention discloses a wide area file system and an implementation method, and relates to the technical field of file systems. The implementation method for the file system is applicable in a wide area. According to the system, an event-driven module receives an operation request, whether a file exists in a local cache is inquired through a cache management module according to the node number of the requested file, if yes, the file is accessed from the cache, if not, the path name, in a server end database, of the file is inquired according to the node number and through a node management module, then the file and the meta-information of the file are obtained according to the information of the operation request and through an event processing module and are sent to the cache management module, and finally, the cache management module stores the file and the meta-information of the file into the local cache. The wide area file system and the implementation method do not rely on a bottom file system, it is only needed that the bottom file system can be shared, the space management function of the cache is provided, and the resource utilization rate of the system is increased.

The invention belongs to the technical field of cloud storage and in particular relates to a data access method for cloud storage. The method comprises the steps of data storage and data retrieving, wherein the data storage step comprise the substeps of: converting a file to be stored into a group of data blocks to form a file physical part, saving the physical part and reducing the physical part into file information to form a file logic part; transmitting the physical part to a plurality of cloud storage data centers for storage; and saving the storage positions of each data block of the physical part in the cloud storage data centers to the logic part; and the data retrieving step comprises the substeps of: acquiring the file logic part according to a file access request; retrieving the file physical part from the cloud storage data center according to the logic part; and reducing the physical part into the file according to the logic part. The invention further provides data access device and system of the cloud storage. The invention improves the access property of the cloud storage data, saves storage space, improves the transmission bandwidth of the cloud storage data, and enhances data safety.

The invention discloses an Internet of things heterogeneous data storage method and a storage system. The internet of things heterogeneous data storage method comprises the steps that various types of data are stored in a column-based mode through an HBase distributed storage system, an MySQL metadatabase carries out registration management on the stored data, and finally the data access layer is configured in a centralized manner, so that applications based on the database can use the unified data interface. According to the Internet of things heterogeneous data storage method and the storage system, the unified storage mode is adopted through the unified data interface, the storage of different types of data and data from different sources is effectively supported; the column-oriented storage mechanism is extended by utilizing the HBase technology, so that the storage volume can be extended horizontally; the memory mapping file mechanism is adopted to effectively improve the storage and management efficiency of large files; and the data redundancy storage technology is adopted to greatly improve the system reliability and the accessibility. The Internet of things heterogeneous data storage method and the storage system can well solve the storage problem of various types of data, has efficient storage and utilization capability on large files, and is also low in cost and high in robustness.

The invention relates to the storage technology in the field of computers and provides a data scheduling method based on a gradation storage medium. The data scheduling method based on the gradation storage medium comprises the following steps: storing and automatically grading; accessing in a directed mode; monitoring data accessing operations; valuating data; and migrating the data. The data scheduling method based on the gradation storage medium can reasonably schedule the data by using the gradation storage medium, and is high in accessing performance and low in cost.

A storage including an access processor configured to access data according to an access request specifying a file or a directory as an object of processing according to a content of a file handle cache held in a source of the request, further includes an access capability assigning unit configured to assign, when a file or a directory is made, an access capability serving as an identifier for uniquely identifying the file or the directory, and store the assigned access capability paired with a file handle for the file or the directory as metadata for the file or the directory and an access capability decision unit configured to decide, for the access request received by the access processor, whether the file handle specified as the object of processing of the access request is valid or invalid, based on a combination of the file handle and the access capability, wherein the access processor returns the access capability along with the file handle paired with the access capability according to a file handle acquisition request.

The invention discloses a hierarchical storage system in a distributed environment, which comprises at least one policy server, at least two network storage units with different performances, and at least two client agents, wherein the client agents provide interfaces for accessing the hierarchical storage system for a user; and the policy server is a bridge between the client agents and the network storage units, manages the network storage units and the client agents, and selects one client agent to perform data migration operation so as to distributes the data on the network storage units with different performances according to heat difference. The hierarchical storage system can solve a plurality of problems in the conventional network storage. Through hierarchical management, the best balance between the performance and the cost can be achieved; in addition, an optimized policy rule is set, so that important data and frequently-used data can be accessed in the shortest time, and rarely-used data is backed up in a storage with lower cost. Therefore, the access performance of the client agents and the overall performance of the storage resources are improved.

The invention discloses a system and method for extending a nonvolatile memory based on consistent buses. The system structurally comprises a plurality of nodes mutually connected through cache consistency high-speed mutually-connected buses, wherein each node is configured with a hybrid memory consisting of a processor, a DRAM memory and a NVM memory, a NVM memory controller is configured between the processor and the NVM memory, a DRAM memory controller is configured between the processor and the DRAM memory, the processor is mutually connected with the NVM memory and the DRAM memory through the cache consistency high-speed mutually-connected buses, and the DRAM memory and the NVM memory are addressed in a unified mode to achieve overall cache consistency of a heterogeneous hybrid memory system. The method is achieved based on the system. Compared with the prior art, existing technical bottlenecks of the DRAM memory are solved by adopting the system and method for extending the nonvolatile memory based on the consistent buses, the NVM memory access performance is improved, data processing capability of the whole system is improved, and the system and method is high in practicability, wide in application range and easy to popularize.

The invention provides a block-level-data-based directional allocation method for hierarchical storage. The method includes: establishing a data directional allocation architecture comprising a data block popularity judgment module, a data block directional allocation and migration module, and a hierarchical storage and organization module. The data block popularity judgment module is used for monitoring part of fixed-size block data in a volume and statistically analyzing data popularity so as to complete hierarchical management of the block data. The data block directional allocation and migration module is used for directionally allocating the data according to data popularity state and equipment features. The hierarchical storage and organization module is used for integrating the storage resources to form a storage resource pool capable of hierarchical storage. Compared to the prior art, the block-level-data-based directional allocation method for hierarchical storage allows hierarchical storage management to be more efficient and is highly practical and easy to popularize.