45results about How to "Improve the efficiency of reading data" patented technology

The invention discloses an encryption copy organization method under a distributed storage environment. In the method, the management unit data block of system data is divided into a plurality of data segments with the same size; the system carries out management by taking the block as the unit; and a client side encrypts the data by taking the data segment as the unit so as to provide finer granularity control to the data block. Because the data block is encrypted by segments, the ciphertext data segments have no dependence and can be encrypted and decrypted in parallel so as to avoid the phenomenon that read-write of small data amount brings great cost for carrying out encryption and decryption on the whole data block; for read of a large data amount, read requests are grouped, and different grouping requests are sent in parallel to each storage node maintaining a requested file data block copy; and each grouping is read in parallel to improve the efficiency of reading data. The invention realizes that the encryption technology and the copy technology are applied in the distributed storage environment. The provided encryption copy organization method greatly improves the efficiency of reading and writing data.

The embodiment of the invention discloses a data caching method. The data caching method includes the steps that to-be-cached data and caching instructions are received, wherein the caching instructions are instructions sent by users to a system according to characteristics of the to-be-cached data, the instructions comprise first instructions or second instructions, the first instructions are used for that the to-be-cached data is indicated to be stored into a memory cache, and the second instructions are used for that the to-be-cached data is indicated to be stored into a magnetic disk cache; according to the caching instructions, corresponding executive strategies are matched from an executive strategy set, the executive strategy set comprises a memory-cache storage strategy and a magnetic-disk-cache storage strategy, and the caching instructions correspond to the executive strategies in a one-by-one mode; if the executive strategy is the magnetic-disk-cache storage strategy, the capacity of each single data in the to-be-cached data is judged; if the single data is larger than a first threshold value, the single data is cached with files. According to the data caching method, the advantages of all caching modes can be achieved according to different characteristics of caching data.

The embodiment of the invention provides a method and device for reading data. The method includes the steps that a controller of storage equipment receives a data reading request sent by a host, the data reading request includes a logic address of data to be read, the controller of the storage equipment sends the logic address to a controller of a solid state disk, the controller of the solid state disk inquires in a mapping table stored in a nonvolatile storage medium of the solid state disk according to the logic address to obtain a physical address of the data to be read, the controller of the solid state disk obtains the data to be read according to the physical address of the data to be read and sends the data to the controller of the storage equipment, and the controller of the storage equipment sends the data to be read to the host. According to the method and device for reading the data, the number of the mapping table is one, the physical address can be directly looked for according to the logic address, compared with the prior art with two mapping, the method and device greatly reduce cost of the storage equipment and the host and improves efficiency of obtaining the data.

The invention provides an embedded file system-based reading method for streaming data. The method comprises the following steps: receiving a request for reading the streaming data, creating a reading task for the request when the requested streaming data exist in a disk, distributing storage space for the new reading task and initializing relevant parameters; decomposing the reading task into a plurality of subtasks, wherein each subtask is responsible for reading a piece of physically continuous data, and caching the data; fetching the data from subtask cache, performing encapsulation according to the format of the streaming data, submitting to a calling party of the reading task after a piece of data is encapsulated each time, and releasing the subtask after data submission is competed and triggering the next subtask; when all the subtasks are successfully finished, reporting that the tasks are normally finished to the task calling party, and waiting the task calling party to end the current reading task. According to the embedded file system-based reading method provided by the invention, high-throughput and high-concurrence reading of the streaming data is facilitated, and the problem that the concurrence performance of a server is low when a large number of users visit hot data is effectively solved.

The embodiment of the invention provides a data reading method and device, electronic equipment and a readable storage medium. The method comprises the following steps: setting a machine room identifier for each data storage node DN in the HDFS, and setting a copy distribution attribute for to-be-backed-up data; determining a target machine room corresponding to the machine room identifier, and selecting a data storage node DN with the copy number from the target machine room; storing the data to be backed up in the selected DN; when a data reading request which is sent by a client and aims attarget data is received through an NN, sending DN identifiers of all DNs storing the target data to the client through the NN; determining whether the machine room identifier of each DN storing the target data is the same as the machine room identifier of the client through the client; and reading the target data from the target DN under the condition that the client determines that all the DNs comprise the target DN of which the machine room identifier is the same as the machine room identifier of the client.

The invention provides a data caching method and device, which are used for solving the problem of low data caching efficiency in the prior art. The method comprises the steps of obtaining a first reading cost used for indicating a time length required for reading one piece of data from a disk, and a second reading cost used for indicating a time length required for reading one piece of data froma preset memory; obtaining a first space occupation amount and an access frequency of each disk file in a plurality of disk files stored on a disk; wherein the first space occupation amount is used for representing the size of the storage space occupied by the hotspot data in the disk file; determining the access cost of each disk file according to the first reading cost, the second reading cost,the first space occupation amount of each disk file and the access frequency; and determining a to-be-cached disk file in the plurality of disk files according to the first space occupation amount andthe access cost of each disk file, and caching the hotspot data in the to-be-cached disk file to a preset memory.

The invention provides a data processing method, a memory control circuit unit and a memory storage device. The data processing method comprises the step of: reading a first data string from a first physical erasing unit according to a first reading command, wherein the first data string comprises first user data, first error detecting codes and first error checking codes. The data processing method also comprises the steps of: decoding the first user data by the first error detecting codes and the first error checking codes; and judging whether the first user data is correctly decoded or not. The data processing method also comprises the step of: if the first user data is successfully decoded, transmitting corrected user data obtained by correctly decoding the first user data to a host system for responding to the first reading instruction.

The invention discloses a data ahead-reading method, device, equipment and computer readable storage medium. The method comprises in advance storing data of a preset byte size of every file in a hardsick into preset storage equipment, wherein the data reading speed of the preset storage equipment is higher than that of the hard disk; receiving a data reading request sent by a client; determiningwhether data to be read exist in a cache space, if so, returning corresponding data to be read in the cache space to the client according to the data reading request, else, returning corresponding data to be read in the preset storage equipment to the client according to the data reading request. According to the data ahead-reading method, device, equipment and computer readable storage medium, data in the preset storage equipment is read, and the speed of reading the data of the preset storage equipment is higher than that of reading the data of the hard disk, so that the data ahead-reading method, device, equipment and computer readable storage medium can increase the speed of primary data reading and further improve the data reading efficiency.

The invention discloses a data transmission method and a data transmission device for a micro control unit (MCU) and a data transmission system for solving the problem of lower efficiency of reading data from an external memory element by the MCU in the prior art. The method comprises the following steps of: reading the data from a memory device through a serial port and storing the data in a cache, wherein the read data is converted from serialization to parallelism when the data is stored, and the serial clock frequency is higher than the parallel clock frequency; and determining a corresponding address in the cache of a specified address in the memory device of the MCU according to a corresponding relationship between a memory address of the cache and the memory address of the memory device, and then sending the data in the corresponding address to the MCU through a parallel port. The technical scheme of the invention can be used for improving the efficiency of accessing external memory devices by the MCU.

The invention provides a thermal flying-height control slider for a hard disk drive. In the thermal flying-height control slider, according to a principle that the read-write magnetic head area of the slider can be subjected to thermal expansion so as to further reduce flying height by electrifying a write coil in a magnetic head write process, a microheater is additionally arranged at a selected middle position of a read-write magnetic head on the hard disk slider, and a unique and efficient W-shaped microheater structure is designed. By means of the structure, the magnetic reading head can obviously move downwards in a read operation process, the flying height of the hard disk magnetic head in the read operation process is decreased, and the precision and the efficiency of data read are increased.

The invention provides a multi-material sorting system and method for a long logistics conveying line. The multi-material sorting system comprises materials, a long conveying line, a rejection line, amarking device, a sorting device, a plurality of sorting lines, a warehouse management system and a PLC, wherein a rejection joint, a plurality of sorting joints and an outlet joint are arranged on the long conveying line in the conveying direction respectively; the marking device marks each material; the sorting device guides the materials on the long conveying line to the rejection line or thesorting lines; the warehouse management system allocates a target address to the sorting lines; the warehouse management system allocates the target address to the rejection line for the materials which fail to be marked; and the PLC judges whether the materials reach the target address or not and controls the sorting device to conduct sorting. The rejection line is additionally arranged at the head end of the long conveying line, and a material recovery line is additionally arranged at the tail end of the long conveying line, so that unmarked materials can be efficiently and accurately conveyed to the rejection line; and in addition, the materials which do not enter the sorting lines in the sorting process are directly conveyed to the material recovery line, so that the utilization rate of each sorting line and the material warehousing accuracy are improved.

The invention relates to a data processing method and device, an AI chip, electronic equipment and a storage medium, and belongs to the technical field of neural networks. The data processing method comprises the following steps: acquiring basic information of a neural network deployed in an AI chip and basic information of the AI chip; selecting an optimal compression algorithm from a plurality of preset compression algorithms according to the basic information of the neural network and the basic information of the AI chip; the related data of the neural network are compressed through an optimal compression algorithm, compressed data and corresponding data indexes are obtained, and the data indexes are used for reducing the compressed data into original data before compression or used for determining the positions of non-zero elements in the compressed data in the original data before compression. By combining the specific conditions of the neural network and the AI chip, the compression scheme suitable for the current scene is flexibly selected, acceleration of the sparse neural network is completed in a relatively optimal mode, and the energy consumption ratio and the performance are improved.

The high-level protocol control process for peripheral equipment interface includes the following steps: receiving the high-level protocol frame data comprising frame head and payload; processing the frame head to slave equipment port address, payload length and current sub-frame head attribute parameter value based on the frame head data, so as to output slave equipment port address as the read address or write address, obtain total frame length data, read frame length data and write frame length data; and final processing payload to read / write payload and complete the data communication between the master equipment and the slave equipment in full duplex or half duplex mode. The present invention can meet the requirement of full duplex / half duplex communication, physical addressing, etc. of data transmission in different kinds of equipment, and has continuous read function, high data reading efficiency, simple process, and other features.

The invention discloses a DCT (Discrete Cosine Transform) method and a circuit system. The method comprises the following steps of: storing residual blocks into different first storage units according to columns; after each row of residual blocks is read in parallel from each first storage unit for row transformation, writing each data in the data after row transformation into different second storage units according to a preset diagonal read-write rule; and after a column of data subjected to row transformation is read out from each second storage unit in parallel according to a diagonal read-write rule for column transformation, storing each coefficient in the obtained column of transformation coefficients in different third storage units, so that a column of transformation coefficients is read out from each third storage unit in parallel for quantization operation each time. Through the optimization design of the row-column conversion circuit and the intermediate transpose storage, especially the improvement of the read-write rule of the intermediate storage structure, the reading period of the row-column conversion circuit to the intermediate storage structure is reduced, the large throughput rate can be achieved on the small circuit area, and the circuit performance is improved.

The disclosure relates to a method and device for data reconstruction, and belongs to the technical field of data storage. The method includes: determining at least one data block to be reconstructed; determining the priority of the at least one data block according to the current attribute of the at least one data block; according to the priority of the at least one data block, and the the stripe to which each data block in the at least one data block belongs, and determine at least one stripe to be reconstructed and the priority of each stripe in the at least one stripe; according to the determined stripe to be reconstructed The priority of at least one stripe is to perform data reconstruction on the data block to be reconstructed included in the at least one stripe. With the present disclosure, the efficiency of reading data can be improved.

The invention discloses an encryption copy organization method under a distributed storage environment. In the method, the management unit data block of system data is divided into a plurality of data segments with the same size; the system carries out management by taking the block as the unit; and a client side encrypts the data by taking the data segment as the unit so as to provide finer granularity control to the data block. Because the data block is encrypted by segments, the ciphertext data segments have no dependence and can be encrypted and decrypted in parallel so as to avoid the phenomenon that read-write of small data amount brings great cost for carrying out encryption and decryption on the whole data block; for read of a large data amount, read requests are grouped, and different grouping requests are sent in parallel to each storage node maintaining a requested file data block copy; and each grouping is read in parallel to improve the efficiency of reading data. The invention realizes that the encryption technology and the copy technology are applied in the distributed storage environment. The provided encryption copy organization method greatly improves the efficiency of reading and writing data.

The invention provides a thermal flying-height control slider for a hard disk drive. In the thermal flying-height control slider, according to a principle that the read-write magnetic head area of the slider can be subjected to thermal expansion so as to further reduce flying height by electrifying a write coil in a magnetic head write process, a microheater is additionally arranged at a selected middle position of a read-write magnetic head on the hard disk slider, and a unique and efficient W-shaped microheater structure is designed. By means of the structure, the magnetic reading head can obviously move downwards in a read operation process, the flying height of the hard disk magnetic head in the read operation process is decreased, and the precision and the efficiency of data read are increased.

The embodiment of the invention provides a data reading method and device, electronic equipment and a readable storage medium. The method comprises the following steps: setting a machine room identifier for each data storage node DN in the HDFS, and setting a copy distribution attribute for to-be-backed-up data; determining a target machine room corresponding to the machine room identifier, and selecting a data storage node DN with the copy number from the target machine room; storing the data to be backed up in the selected DN; when a data reading request which is sent by a client and aims attarget data is received through an NN, sending DN identifiers of all DNs storing the target data to the client through the NN; determining whether the machine room identifier of each DN storing the target data is the same as the machine room identifier of the client through the client; and reading the target data from the target DN under the condition that the client determines that all the DNs comprise the target DN of which the machine room identifier is the same as the machine room identifier of the client.

The invention relates to a detection-based auxiliary discharging device for an injection molding grinding tool. The device comprises two parts, namely an injection molding grinding tool basic body and a blanking assembly, effective discharging of a workpiece is realized through mutual movement of a telescopic water column and the surface of the workpiece, and the volume change of the water column relative to the interior of a liquid solution is converted into weight data of the workpiece, so whether a product is qualified or not is directly judged according to comparison of related data; preliminary detection is conducted on the workpiece, the complexity of subsequent procedures is reduced, rapid displacement is achieved through the limiting block with a foam piece sleeved with a rubber ring, the data reading efficiency is effectively improved, the whole device is driven to a transmission line through a rotating body, and discharging and conveying of the workpiece are achieved.

The invention discloses a method and a device for reading data, which belong to the technical field of computers. The method comprises the following steps: determining a head-pointer position and a tail-pointer position of a channel; comparing the height of the head-pointer position and the height of the tail-pointer position; and sequentially reading a data packet according to a comparison result. The device comprises a determining module, a comparing module and a reading module. According to the invention, through sequentially reading the data packet, the times for reading the data can be reduced; and in addition, since the times for reading the data is reduced, the efficiency for reading the data can be improved, and thus the probability that data overflow from the channel is reduced.

The invention discloses an oblique scan display method in a direct writing photoetching system. N2 rows of data are combined and stored in a memory in sequence according to an obliquity factor N and on the basis of left-justified N rows and N lines of pixel data, and an FPGA (field programmable gate array) selects the data in the corresponding rows in sequence according to the platform motion to a DMD (digital micro-mirror display) to display. According to the invention, the data are stored in a DDR2 (double data rate 2), the DMD is controlled by the FPGA, and the oblique scan display is a method for updating an image according to the obliquity factor and a platform scanning manner, so that the operating mode of the FPGA can be conveniently designed and optimized, and the data reading efficiency of the DDR2 can be improved.

The invention relates to a method and a device for data reconstruction, belonging to the technical field of data storage. The method includes determining at least one data block to be reconstructed; determining a priority of the at least one data block according to a current attribute of the at least one data block; determining at least one band to be reconstructed and a priority of each band in the at least one band according to a priority of the at least one data block and a band to which each data block in the at least one data block belongs; data reconstruction being performed on the datablocks to be reconstructed contained in the at least one strip according to the determined priority of the at least one strip to be reconstructed. With the present disclosure, the efficiency of reading data can be improved.

A data reading method and device. The data reading method comprises: during a process of scanning an index clustering table, scanning leaf nodes and recording page numbers of the leaf nodes (S10); and merging I / O requests of the leaf nodes with consecutive page numbers into one I / O request (S11). Because data of multiple leaf nodes in physically consecutive storage locations is read by means of one I / O request, the data volume read by each I / O request is increased, thereby fully utilizing the overall disk throughput. In addition, to read data of the same storage volume, the number of I / O requests that need to be initiated can be reduced, thereby avoiding the limitation of the disk IOPS parameter, and effectively improving the data reading efficiency.

The embodiment of the invention provides a data reading method and device and electronic equipment. The method comprises the following steps: receiving a data request sent by a file system; determining a target data identifier corresponding to the target path based on a pre-established corresponding relationship between a path and a data identifier; and based on the target data identifier, reading target data from the object storage system, and feeding back the target data to the file system, so that the file system feeds back the target data to the task end after receiving the target data. Through the scheme, the data reading efficiency can be improved.

The present application discloses a data readdir method, system, device and computer medium, which are applied to a server in a distributed file system to receive a data readdir request sent by a client in the distributed file system; determine each corresponding data readdir request Target metadata server; split the data readdir request into data readdir sub-requests corresponding to each target metadata server; concurrently send data readdir sub-requests to the corresponding target metadata server; receive the target data transmitted by each target metadata server and transmitted to the client. The data readdir method, system, device and computer-readable storage medium provided by the present application improve the efficiency of data read by a client by concurrently sending data readdir sub-requests to a corresponding target metadata server.

The invention discloses a display system and a data transmission method thereof, and belongs to the technical field of display. The display system comprises N display units and N video distributors, wherein a main data stream flows through each video distributor; and each video distributor is connected with a display unit through a sub-data stream channel so as to send the corresponding sub-data streams to the corresponding display screens, and N is a positive integer greater than 1. According to the technical scheme, the technical problems that according to an existing display system screen splicing scheme, the data transmission process is simplified, meanwhile, the refresh rate of the screen cannot be considered, and the display effect of the whole display system can be affected by faults of any display screen can be effectively solved.