157results about How to "Improve data access efficiency" patented technology

Methods and apparatus are provided improving data access efficiency in a storage area network. Mechanisms are provided to allow a virtual disk address to be efficiently mapped to a particular physical partition in a virtual disk while recognizing the mirroring, striping, and concatenation characteristics associated with the virtual disk. A variety of indices are used to allow direct access of a physical partition upon identification of a virtual disk address.

The disclosure relates to a data access method and apparatus and system, and belongs to the field of communication. The data access method comprises: receiving a data access request sent by a user device; according to the data access request, sending a cache access request to a cache server; receiving data information sent by the cache server, wherein the data information comprises first target data; detecting whether a storage time of the first target data is between a first time threshold and a second time threshold or not; if the first target data is between the first time threshold and the second time threshold, according to the data access request, acquiring second target data in a database; and sending the second target data to the cache server, wherein the cache server is for adopting the first target data stored in the second target data update cache server. According to the data access method provided by the invention, problems of relatively low efficiency and relatively long delay of the data access are solved; effects of improving the data access efficiency and reducing the access delay are realized; and the data access method is used for for the access of page data.

The present disclosure provides a cross-blockchain data access method, apparatus and system, and a computer readable medium. The method comprises: sending an authorizing blockchain apparatus a block data request carrying a requesting blockchain apparatus identifier and authorization information, so that the authorizing blockchain apparatus verifies whether the authorization information corresponding to locally-stored requesting blockchain apparatus identifier is matched with the authorization information in the block data request; receiving block data sent by the authorizing blockchain apparatus and corresponding to the block data request, the block data being sent after the authorizing blockchain apparatus verifies that the authorization information corresponding to locally-stored requesting blockchain apparatus identifier is matched with the authorization information in the block data request. According to the present disclosure, through an authorization mechanism, namely, the authorizing blockchain apparatus's authorization for the requesting blockchain apparatus, the requesting blockchain apparatus may be enabled to access the block data of the authorizing blockchain apparatus according to the authorization information, thereby finally achieving cross-blockchain data access. The cross-blockchain data access according to the present disclosure does not require manual participation and exhibits a higher access efficiency.

The multiplexer (100) includes a first input unit (101) that obtains video data, a second input unit (104) that obtains audio data, a first analysis unit (103) that analyzes video data and obtains video sample header information, a second analysis unit (106) that analyzes audio data and obtains audio sample header information, a packetization part determination unit (107) that determines the packetization part of the audio data in a way that the packetization part is made to be the same or approximately the same as the playback start time of the video sample that is placed in the leading part of the packetization part of the video data after determining the packetization part of the video data based on the video sample header information, a packet header part generation unit (112) that generates the packet header part on the basis of the determined packetization part, a packet data generation unit (113) that generates the packet data unit on the basis of the determined packetization part and a packet connection unit (114) that generates a packet by connecting the generated packet header part to the packet data part.

The embodiment of the invention provides a data prefetching method of a DHT (Distributed Hash Table) memory system, a node and a system. The method comprises the following steps: a first memory node receives a reading request sent by a client side, a prefetching data block and a second memory node where the prefetching data block is positioned are defined according to the read data block and a set threshold of the predetching data block, and a prefetching request is sent to the second memory node, wherein the first memory node and the second memory node are identical or different nodes, the prefetching request comprises identification information of the prefetching data block, and the identification information is exclusively used for identifying the prefetching data block; and the secondmemory node reads the prefeching data block from a disk according to the prefetching request, and stores the prefetching data block to a local cache, so that the client side can read the prefetching data block from the local cache of the second memory node. By adopting the embodiment of the invention, the prefetching data block can be directly read from the cache, so that the data visit efficiency of each memory node in the system can be improved.

The invention provides a method for accessing a physical machine to a cloud platform. The method comprises S1, accessing the physical machine to the cloud platform through a bare switch and a layer-2 switch; S2, building a VXLAN and / or RGE virtual network in the cloud platform, allocating VLAN ID for the virtual network and then storing the VLAN ID in a database; S3, finding physical network card information in the database of the cloud platform and building a virtual network card corresponding to the physical network card information; S4, dynamically configuring the VLAN ID to a port corresponding to a physical machine network card in the bare switch by the cloud platform; and S5, converting the VLAN ID into a network ID adaptive to the virtual network in the layer-2 switch, and realizing conversion of the VLAN ID and the virtual network in the cloud platform at the layer-2 switch. Therefore, the smoothness of accessing the physical machine to the cloud platform is realized, the access efficiency and security of data between the physical machine and the virtual machine are improved, and the public network IP resources are saved.

The invention discloses a creating and visiting method for a GKF three-dimensional space database, and belongs to the field of three-dimensional digital cities and three-dimensional geographic information systems. For meeting requirements of storage and rapid visiting of data of a three-dimensional model, a three-dimensional topography and an inclined camera shooting model, the creating and visiting method for the GKF three-dimensional space database on the basis of NoSQL thinking and a memory mapping technology is provided, and the storage safety and the rapid visiting efficiency of the data of the three-dimensional model, the three-dimensional topography and the inclined camera shooting model are improved. Characteristics of mass, binary fluidization, capability of not requiring transaction awareness in visiting and the like of the three-dimensional model, the three-dimensional topography and the inclined camera shooting model are considered, compared with a three-dimensional space database stored based on a relational database, the creating and visiting method for the GKF three-dimensional space database conforms to features of the data of the three-dimensional model, the three-dimensional topography and the inclined camera shooting model, and is more compact in utilization of storage space, better in safety and higher in data access efficiency.

The embodiment of the invention provides a distributed database system, which comprises storage nodes, an access control device and an unloading device, wherein the access control device is used for receiving access requests, extracting record identifiers from the access requests, searching for the storage nodes corresponding to the record identifiers from a storage comparison table, updating the accessing times of data records with the record identifiers, acquiring the corresponding data records from the storage nodes according to the record identifiers, and returning the acquired data records; and the unloading device is used for determining the accessing times according to the accessing times of each data record corresponding to the storage nodes in the storage comparison table, and when determining the storage nodes are overloaded according to the accessing times of the storage nodes by using a preset pressure algorithm, selecting the data records from the plurality of data records of the storage nodes according to a preset unloading strategy, unloading the selected data records into the other storage nodes which are not overloaded, and updating the storage comparison table. The invention also provides a data accessing method. The embodiment of the invention can satisfy the needs of real-time data accessing operation.

The invention provides an indexing and retrieval system based on HBase-ORM (Object Relational Mapping). Insertion, reading and modification of data are finished by automatically establishing a mapping relation between an underlying database table and an upper database object; a database layer is separated from a data access layer, so that upper developers can pay more attention to upper service logical processing, and the development efficiency is improved; meanwhile, the error rate is reduced; an index of each line of data in HBase is established according to different types by using Elastic search, and fuzzy query of texts, interval query of values, range query of longitude and latitude and similarity query of images are realized, so that real-time query demands of Web users on different data types are met.

An embodiment of the invention provides a distributed cache data access method and device. According to the method, a first server receives a first access request sent by a user, and the first access request carries a target data block index to be accessed; the first server determines a first hash value of the target data block index and determines a second server of storing the target data block index according to correspondence between the set hash value and the servers; the first server transmits a second access request carrying the target data block index to the second server, so that the second server queries a third server which caches corresponding data blocks of the target data block index, according to the correspondence between the set data block index and the servers; the first server receives access response transmitted by the second server, and the access response carries query results of the third server querying the cached target data blocks. Through the application of the distributed cache data access method and device, data access efficiency of clustered file systems is improved and the performances of the clustered file systems are improved.

The invention provides a method and device for processing red packet data. The method comprises the steps of creating red packet data according to a red packet sending request, wherein the red packet data comprises the red packet number cached in a distributed cache; querying the red packet number of the red packet data according to one or more red packet grabbing requests; if the red packet number is not larger than zero, returning red packet grabbing failure information; if the red packet number is larger than zero, subtracting 1 from the red packet number, and inserting associated information on successfully grabbed red packets into a database. According to the method and device for processing red the packet data, red packet data processing efficiency can be improved, and a request response speed is improved.

A region-based management method of a non-volatile memory is provided. In the region-based management method, the storage space of all chips in the non-volatile memory is divided into physical regions, physical block sets, and physical page sets, and a logical space is divided into virtual regions, virtual blocks, and virtual pages. In the non-volatile memory, each physical block set is the smallest unit of space allocation and garbage collection, and each physical page set is the smallest unit of data access. The region-based management method includes a three-level address translation architecture for converting logical block addresses into physical block addresses.

According to the present invention, methods and apparatus are provided for increasing the efficiency of data access in a multiple processor, multiple cluster system. Mechanisms for improving the accuracy of information available to a cache coherence controller are provided in order to allow the cache coherence controller to reduce the number of transactions in a multiple cluster system. Cache state information is provided to a home cluster cache coherence controller to allow silent evictions of shared memory lines and change to dirty associated intervening requests to be efficiently handled.

The invention provides a method and a device for data collection, which relate to the field of mass data processing and solve the problem of data lag caused by database storage. The method comprises the steps of: collecting data from nodes in cluster; and establishing aggregation in cache, using the collected data as the object of the aggregation and storing the data in the cache. The technical proposal provided by the invention is suitable for high performance cluster.

According to the present invention, methods and apparatus are provided for increasing the efficiency of data access in a multiple processor, multiple cluster system. Mechanisms for improving the accuracy of information available to a cache coherence controller are provided in order to allow the cache coherence controller to reduce the number of transactions in a multiple cluster system. Non-change probes and augmented non-change probe responses are provided to acquire state information in remote clusters without affecting the state of the probed memory line. Augmented probe responses associated with shared and invalidating probes are provided to update state information in a coherence directory during read and read / write probe requests.

The invention discloses a method, device and system for data caching, applicable to a game application. The method for the data caching comprises the steps that network application data is read from a game application database; the read network application data is divided, and the network application data is divided into hot data and non-hot data; and the hot data is stored in a local cache server, and the non-hot data is stored in a far-end cache server, wherein the local cache server and the far-end cache server are used to provide network access services. According to the invention, the technical problem that data access efficiency and data cache cost cannot be guaranteed at the same time can be solved.

The invention discloses an optimized SSD data updating method. For a character type of data stored on an SSD, and with combined use of the two data structures of a line segment tree and a B tree, space occupied by an index structure is reduced with query efficiency being ensured; when character data is updated, different values of a same key in two data blocks are updated by using of a characteristic of a set union-intersection calculation, and other data is written back as original; and random updating of the character data on the SSD is converted to a sequential writing of data by using an LSM method based on a line segment B tree. The method disclosed by the invention effectively avoids a writing amplification problem of the SSD, increases a data writing speed of the SSD, and improves the operation efficiency of a database.

Disclosed are a data storing method and device and a data obtaining method and device. The data storing method includes: receiving data information to be stored which contains identifier information of data; determining a target server corresponding to the data information in a data platform according to the identifier information of the data and a storage algorithm pre-stored on the data platform; and storing the data information in the target server. According to the data storing method, the data is stored in the target server corresponding to the data instead of each server of the data platform simultaneously, which can avoid the waste of server resources. For a plurality of different pieces of data information, the target servers for storage are possibly different. In this way, overpressure of a single server can be avoided to a certain degree and the data access efficiency can be improved.

According to the present invention, methods and apparatus are provided for increasing the efficiency of data access in a multiple processor, multiple cluster system. Mechanisms for allowing a variety of transactions to complete locally are implemented by providing remote data caches associated with the various clusters in the system. The remote data caches receive data and state information for memory lines held in remote clusters. State information is provided to the remote data cache using various mechanisms including a coherence directory and augmented source done messages.

The invention relates to raster data access, in particular to access of a small piece of spatial raster data and discloses a raster data access method based on a distributed multi-stage cache system. According to the raster data access method, a server data storage system, a server cache system and a client are involved, and the client comprises a client cache and a user interface. The raster data access method comprises the following steps that: the user interface receives a raster data request sent by a user, and whether required data exist in the client cache is judged; the server client cache system judges whether data required by the raster data request exist in the server cache system; and the server data storage system returns the data required by the raster data request; and the client cache is updated, and the returned data are stored in the client cache system. The method has the advantages that the spatial raster data storage and cache performance are improved; the reliability and availability are high; and data are optimized and accessed, so that the data request can be responded efficiently.

The invention discloses a data access method, an access verification device and a data storage system. The data access method is applied to the access verification device, the access verification device has a preset license chain, permissions are respectively set for data and a user on the license chain, and the permissions are characterized by the type and number of tokens. The method comprises the following steps: querying the access permission of the user on the preset license chain in response to a data access request sent by the user through a client, wherein the access permission is characterized by the type and number of tokens; generating data access information based on the type and number of tokens in the access permission; and sending the data access information to the client, so that the client accesses the data in the data storage system based on the data access information.

The present invention discloses a flash memory system comprising: a cache memory, a cache memory interface, a host interface, a flash memory interface, and a microprocessor The cache memory interface contains an arbitrator for performing data bus bandwidth time sharing process to access the cache memory The host interface is used for receiving data from a host system, and storing the data into the cache memory to form ready data The flash memory interface reads the ready data from the cache memory and stores it into at least one flash memory The microprocessor is used for controlling the host interface and the flash memory interface to access the cache memory Hence, the present invention can achieve the purpose of enhancing the access efficiency and increasing the life of the flash memory

The invention discloses a method for describing seismic data, relating to the technical field of processing and explaining seism exploring data in petroleum seismic exploration. The method comprises the following steps: separating a seismic channel head and a seismic line head from an seismic data body; dividing a data file into three parts, namely a seismic data line head and channel head, a seismic data body and a data index file; and defining seismic channel head firstly and then using the seismic channel head, wherein the meaning and corresponding position of a seismic channel head character are appointed randomly by a user. The method has high data accessing efficiency and fully satisfies the requirements for accessing the seismic data randomly; after the data file is divided into three parts, the data file basically has no redundancy information, so that system resources are saved and the work efficiency for processing and explaining is improved.

The invention relates to a gateway connection method and device, a storage medium, electronic equipment and gateway equipment. The method is applied to gateway scheduling equipment, and comprises thefollowing steps: receiving gateway condition information sent by each gateway connected with the gateway scheduling equipment; receiving gateway detection information, wherein the gateway detection information comprises detection information obtained by detecting each gateway in the gateway list by the terminal; and if determining that a second gateway better than the first gateway currently to beconnected with the terminal exists in the gateways reachable to the terminal according to the gateway detection information and the gateway condition information, sending redirection information to the second gateway from the first gateway. According to the scheme, the terminal can be switched to the second gateway better than the first gateway, so that the service quality of the terminal accessing the network is ensured, the data access efficiency of the terminal is improved, and the reliability and stability of data transmission are improved.