Patents
Literature
Hiro is an intelligent assistant for R&D personnel, combined with Patent DNA, to facilitate innovative research.
Hiro

37results about How to "Reduce reading and writing pressure" patented technology

Method and system for reading and writing user data under virtual environment and physical machine

The embodiment of the invention provides a method and system for reading and writing user data under virtual environment and a physical machine. The method includes the steps that whether every virtual machine has a user data reading and writing request or not is detected; the user data reading and writing requests of all the virtual machines are collected; the reading requests are added into a reading request queue, and the writing requests are added into a writing request queue; when the correspondence degree between first request addresses in the reading request queue and / or the writing request queue and second request addresses in the reading request queue and / or the writing request queue meets a preset condition, the request queue corresponding to the first request address is adjusted according to a request queue adjustment method corresponding to the preset condition; a request in the front of the request queue with the high priority is called and sent to a server where the user data are stored. By means of the method, reading and writing pressure of communication interfaces of the physical machine and the reading and writing pressure of the server where the user data are stored are substantially reduced, and user data reading and writing efficiency is improved.
Owner:HUAWEI TECH CO LTD +1

Online processing method and system oriented to streamed data

ActiveCN103853766AImprove real-time processing speedReading and writing stress reliefSpecial data processing applicationsData processing systemStreaming data
The invention discloses an online processing method and system oriented to streamed data. The method comprises the following steps: 1, establishing an online memory cache layer, extracting the property of the streamed data according to a key value structure, and storing in the online memory cache layer; 2, establishing a hybrid index structure for the streamed data in the memory cache layer; 3, adding an access flag bit to each streamed datum for which the index structure is established, and recording the access state of the streamed data by each analysis program, wherein the flag bits are used for flagging the register condition of the streamed data by different analysis programs; 4, cleaning data: if a certain streamed datum is accessed by all specified analysis programs in the memory cache layer, cleaning the streamed datum. By adopting the method and the system, the data reading and writing stress in a streamed processing procedure is reduced greatly, the stress of a database in a large-scale streamed data processing system can be effectively relieved, and the real-time processing speed of the streamed data can be increased.
Owner:INST OF COMPUTING TECH CHINESE ACAD OF SCI

Index generation method and device for repeated data deletion

The invention discloses an index generation method and device for repeated data deletion. The method comprises the steps that a data flow composed of a plurality of data pieces is received, each data piece corresponds to a fingerprint and a serial number, and the sequence of the serial numbers are the same as the sequence of the data pieces in the data flow; when the serial numbers of more than two data pieces are adjacent, and data piece IDs of data pieces, corresponding to the fingerprints of the more than two data pieces with the adjacent serial numbers, in a single case library are also adjacent, a piece of merged index information is generated according to the more than two data pieces with the adjacent serial numbers. According to the embodiment, the piece of merged index information is generated according to the more than two data pieces with the adjacent serial numbers, so that the number of pieces of index information is reduced, the storage space is saved, and the read-write pressure generated when the data flow is recovered is lowered.
Owner:HUAWEI TECH CO LTD

System and method for rapidly searching unstructured data

The invention discloses a system and a method for rapidly searching unstructured data. The system comprises a query processing module, a query condition analyzing module, a large data storage module, a Bloom filter filtering module, an index establishment module and a Bloom filter building module, wherein the query processing module is used for receiving the search request of an application client, acquiring the query conditions from the search request, calling the query condition analyzing module to analyze and transform the query conditions, using a Bloom filter to replace the word segmentation condition in the original query conditions and generating a new query condition based on Bloom filter filtering record identification; the Bloom filter and other query conditions are tested by a condition query data record sheet; the data record which is in accordance with all the query conditions is taken as the search result; the search result is returned to the application client. The system and the method can more quickly judge whether a data record is in accordance with the word segmentation condition or not, and consumes less resource.
Owner:南京烽火星空通信发展有限公司

Hotspot file self-adaption copy method and system

An embodiment of the invention provides a hotspot file self-adaption copy method and system. The hotspot file self-adaption copy method comprises the following steps of receiving a file download request; obtaining index information of a to-be-downloaded file according to the document download request; determining a storage magnetic disk of a download file according to the index information; calculating file popular degrees of the to-be-downloaded file; judging whether the download file requires hotspot copy or not according to the file popular degrees of the download file; obtaining at least one buffering magnetic disk with the lowest load if the download file requires copy; copying a plurality of to-be-downloaded files into the buffering magnetic disk. The hotspot file self-adaption copy method can guarantee the file access rate of a server, reduces read-write pressure and read-write time delay of the magnetic disk.
Owner:SHENZHEN TENCENT COMP SYST CO LTD

Method and device for providing video file

The invention discloses a method and a device for providing a video file. The method comprises the following steps of obtaining a search initial position of the video file according to a received playing request from a client; and determining corresponding data frames according to the search initial position and returning the content of the video file corresponding to the determined data frames to the client to play, wherein the video file comprises more than two data frames. According to the method, the providing speed of the video file can be improved, and the pressure on a disk is reduced.
Owner:SHANGHAI DNION INFORMATION & TECH

High-concurrency agricultural product online trading system and construction method and operation method thereof

The invention relates to a high-concurrency agricultural product online trading system and a construction method and an operation method thereof. The system comprises a presentation layer, a service layer and a persistence layer which are connected in turn. The presentation layer communicates with the service layer through a service middleware Dubbo. The service layer is connected with the persistence layer through a cache database Redis. The presentation layer and the cache database Redis use ActiveMQ as a message queue. According to the high-concurrency system based on Redis and ActiveMQ, the Redis is used as cache to reduce the pressure of database reading and writing, and the ActiveMQ is used as the message queue to eliminate the high concurrency access peak and accelerate the responsespeed of the website so as to greatly increase the concurrent access to the website and meet the needs of subsequent business operation.
Owner:SHANDONG UNIV

Data writing method and device

The invention relates to a data writing method and device. The method comprises the steps that the number of first sub-data block sets in a data block is determined, wherein data stored in each sub-data block in the first sub-data block sets are all dirty data; when the number of the first sub-data block sets exceeds a threshold value, second sub-data block sets are determined, wherein the second sub-data sets are the set of continuous sub-data blocks where the data stored in the first sub-data block and the data stored in the last sub-data block are all dirty data; when the number of the second sub-data block sets does not exceed the threshold value, all the second sub-data block sets in the data block respectively generate a first data writing request, and the first data writing requests are sent to a storer; when the number of the second sub-data block sets exceeds the threshold value, all the second sub-data block sets in the data block generate a second data writing request, and the second data writing request is sent to the storer. According to the data writing method and device, in the writing-in process, the data does not need to be read from a disk to a cache, and reading-writing pressure on RAID is relieved.
Owner:HUAWEI TECH CO LTD

Data collection method, device, equipment and readable storage medium

The invention discloses a data collection method, a device, equipment and a readable storage medium, and relates to the technical field of big data and the technical field of cloud computing. According to the specific implementation scheme, the method comprises the steps of obtaining an operation request of a user, and extracting user operation information from the operation request; generating aninsertion statement for writing the user operation information into a service database; submitting the insertion statement and the business data change statement to the business database, so that thebusiness database writes the user operation information by executing the insertion statement and changes the business data by executing the business data change statement; and according to the binarylog of the service database, collecting the service data before and after the change and the user operation information. According to the embodiment of the invention, user operation information and service data before and after change are completely collected; meanwhile, data collection and service decoupling are achieved.
Owner:BEIJING BAIDU NETCOM SCI & TECH CO LTD

Similar image retrieval method

The invention discloses a similar image retrieval method, which comprises the following steps of: obtaining an image to be retrieved, and calculating a binary hash characteristic value; carrying out segmentation processing on the binary hash characteristic value; carrying out retrieval in the constructed image feature value database, finding out all images containing at least one section of Hash feature value, and sorting the images into a final candidate image list; calculating a characteristic value distance between the to-be-retrieved image and each image in the candidate image list, and determining an image with the minimum characteristic value distance from the to-be-detected image in the candidate image list; judging whether the characteristic value distance between the image and theto-be-retrieved image is smaller than a preset threshold value or not; wherein the image is a similar image of the to-be-retrieved image if the image is smaller than the preset threshold value. According to the method, image retrieval is carried out in a manner of segmenting the binary hash characteristic values of the to-be-retrieved images, so that the similar image retrieval speed is greatly increased.
Owner:上海七印信息科技有限公司

A virtual file system based on DAS architecture storage servers and a file management method thereof

The invention provides a virtual file system based on DAS architecture storage servers and a file management method thereof. The virtual file system comprises a task management sub-system and a cache sub-system. The task management sub-system is used for receiving file operation tasks from request terminals and sending the tasks to the cache sub-system. If the task type of the file operation tasks is file reading tasks, the cache sub-system acquires to-be-read file data corresponding to the file operation tasks from a cache space, and sends the to-be-read file data to the task management sub-system; or if the task type of the file operation tasks is file writing tasks, the cache sub-system writes to-be-written file data corresponding to the file operation tasks into the cache space. The task management sub-system receives the to-be-read file data and sends the to-be-read file data to the request terminals. The virtual file system is provided with the cache sub-system which can process file operation tasks, so that repeated reading of disks or disk arrays can be prevented and the IO performance of the disks or disk arrays can be guaranteed.
Owner:TCL CORPORATION

Method for accelerating cloud storage internal data transmission

The invention relates to the field of computer storage systems, and discloses a method for accelerating cloud storage internal data transmission. The method comprises the following steps: transmitting the data from a server to a storage through a network, wherein the data is written in a caching module to be stored temporarily in advance before being transmitted from the server, starting transmission through a transmission control module, and when the data reach the storage side, firstly storing the data in a cache, and then slowly writing the data in the storage. By virtue of the technology, the transmission rate will be greatly increased as compared to that of the traditional structure, which meets requirements of users who are harsh on operating lag; the read-write stress of the storage which directly faces the server is reduced; the method is beneficial to protect the storage, and prolongs the service life of the storage.
Owner:LANGCHAO ELECTRONIC INFORMATION IND CO LTD

Method and device for querying data in blockchain system

An embodiment of the invention provides a method and device for querying data in a blockchain system, wherein the blockchain system comprises N mutually independent blockchains. The method comprises the steps that a query request for first data is received, wherein the query request comprises a first data identifier of the first data; that the first data is stored in a first block chain in the N block chains is determined based on the query request; based on the first data identifier, the first data is read in the first block chain.
Owner:ALIPAY (HANGZHOU) INFORMATION TECH CO LTD

Micro-service governance system and method

The invention provides a micro-service management system and method. The system comprises a load balancing module, a service current limiting module, a link tracking module and a fusing degradation module. According to the micro-service governance method, the pressure of the micro-service node is balanced through a negative feedback control load balancing strategy, and a link tracking identifier is generated through a snowflake algorithm and is implicitly transmitted to the whole link, so that a calling link of the micro-service is completely known; and service current limiting and fusing in a distributed cluster environment are completed by using a current limiting scheme capable of automatically degenerating into single-machine current limiting and a distributed fusing method capable of automatically detecting and reconnecting, so that the availability of a micro-service system is improved.
Owner:中关村智慧城市产业技术创新战略联盟

Data checking method and device, electronic equipment and storage medium

The invention provides a data checking method and device, electronic equipment and a storage medium. The method comprises the following steps of using a preset monitor for recording data change conditions of a checking table and a reference table corresponding to each checking rule; in the process of executing data check of the first check rule for the non-first time, obtaining data change conditions of a check table and a reference table corresponding to the first check rule, and a last check result of the first check rule; and obtaining the current check result of the first check rule according to the data change conditions of the check table and the reference table corresponding to the first check rule and the last check result of the first check rule. The current check result of the first check rule is obtained by utilizing the data change conditions of the check table and the reference table corresponding to the first check rule and the last check result of the first check rule, and all data in the check table and the reference table does not need to be obtained from the data source every time check is carried out, so that read-write pressure of a data source server can be reduced. Data check efficiency is enhanced.
Owner:NEW H3C BIG DATA TECH CO LTD

Bill data storage method and device, bill generation method and device, server and storage medium

The embodiment of the invention discloses a bill data storage method and device, a bill generation method and device, a server and a storage medium. The bill data storage method comprises the steps ofobtaining original bill data; performing serialization processing on a plurality of data tables of the original bill data according to a first preset rule; performing serialization processing on theplurality of fields in each data table according to a second preset rule to form serialized bill data; and storing the serialized bill data. According to the embodiment of the invention, the serialization processing of the bill data is realized, and the serialization processing mode enables the stored bill data to only consist of fields instead of a key value pair storage mode in the prior art, sothat the stored data volume is greatly reduced, the simplicity of the bill data is improved, and the disk read-write pressure during data storage is reduced.
Owner:彩讯科技股份有限公司

A kind of osd slow disk processing method, system, device and computer storage medium

The invention discloses an OSD (object storage device) slow disk processing method, system and device and a computer storage medium and applies to distributed storage systems. The method comprises: acquiring attribute of a slow disk, and receiving a user's selection command; determining a processing mode of the slow disk according to the selection command; if the determined processing mode is a manual processing mode, generating a reminder message according to the attribute of the slow disk so that operation and maintenance staff may manually process the slow disk according to the reminder message; if the determined processing mode is an automatic processing mode, judging whether to adjust weight of an OSD corresponding to the slow disk to zero according to the selection command; if not, directly and automatically decreasing the weight of the OSD corresponding to the slow disk; if yes, judging whether it is possible to adjust the weight of the OSD corresponding to the slow disk to zero; if yes, adjusting the weight of the OSD corresponding to the slow disk to zero, and migrating original data in the slow disk having the weight zeroed to other OSDs in a cluster. The OSD slow disk processing method, system and device and the computer storage medium have the advantage that overall performance of a distributed storage system is improved.
Owner:INSPUR SUZHOU INTELLIGENT TECH CO LTD

Design and implementation method of intelligent body temperature monitoring and early warning big data platform

PendingCN112201341AConvenient and fast real stateQuick and easy to know the real statusData processing applicationsDatabase management systemsData displayAnalysis data
The invention discloses a design and implementation method of an intelligent body temperature monitoring and early warning big data platform, and relates to the technical field of body temperature monitoring. The system comprises data acquisition equipment, a data analysis module and a data display and summarization module, wherein the data acquisition equipment is used for acquiring student identity information data and body temperature data in real time and transmitting the student identity information data and the body temperature data to the data analysis module, and the data analysis module is used for comprehensively analyzing the student identity information data and the body temperature data; and the data display and summarization module is used for displaying and summarizing the student identity information data and the body temperature data analyzed by the data analysis module. The temperature, iris and other data are collected through the infrared detection technology and the iris collection technology, the data is sent to the cloud platform, the data is stored and analyzed in real time by means of the cloud server and the body temperature big data analysis platform, thedata visualization is achieved, the data query is facilitated, and the real-time early warning is achieved.
Owner:TAIYUAN NORMAL UNIV

Method and device for writing data

A data writing method and device, comprising: determining the number of first sub data chunk sets in the data chunks, all data stored in each sub data chunk in the first sub data chunk sets being corrupted data; when the number of first sub data chunk sets exceeds a threshold, determining second sub data chunk sets, a second sub data chunk set being a set of continuous sub data chunks with all data stored in the first and last sub data chunks being corrupted data; when the number of second sub data chunk sets does not exceed the threshold, generating a first data writing request respectively for each second sub data chunk set in the data chunks, and sending the first data writing request to storage; and when the number of second sub data chunk sets exceeds a threshold, generating a second data writing request for data chunks and sending the second data writing request to storage. The data writing method and device do not allow data to be read from a disk to a cache when writing the data, thus reducing the read and write pressure on the RAID.
Owner:HUAWEI TECH CO LTD

Method and system for adaptive copying of hotspot files

The embodiment of the present invention proposes a hot file self-adaptive copy method and system. The method includes: receiving a file download request; obtaining index information of the file to be downloaded according to the file download request; determining the storage disk of the downloaded file according to the index information; The file heat of the downloaded file; according to the file heat of the file to be downloaded, it is judged whether the file to be downloaded needs a hot copy; if copying is required, at least one buffer disk with the lowest load is obtained; multiple copies of the file to be downloaded are copied to the obtained buffer disk. The invention can ensure the file access rate of the server, reduce the reading and writing pressure, and reduce the delay of disk reading and writing.
Owner:SHENZHEN TENCENT COMP SYST CO LTD

Computer storage optimization method for monitoring data

The invention relates to the technical field of data processing, in particular to a computer storage optimization method for monitoring data. The method comprises the following steps: acquiring the uploading resource priority of a current user, dividing each area of a campus into a preset number of groups, and setting a link busy influence factor of each group at the same time; obtaining a dependency index of the current user; obtaining a network strain coefficient and a flow control index according to the link busy influence factor and the dependency index corresponding to the area where the current user is located; and if the flow control index is a preset value, obtaining an optimized uploading speed based on the maximum uploading speed of the network hard disk uploaded to the network center by the current user, the uploading resource priority, the network strain coefficient and the lower limit of the uploading speed. According to the method, the final uploading speed of the current user is optimized and controlled, the uploading speed most suitable for the user is obtained, the read-write pressure of a network hard disk of a network storage center is relieved, and meanwhile it is ensured that each user has good experience when uploading the file.
Owner:济南高投物业管理服务有限公司

A streaming data-oriented online processing method and system

ActiveCN103853766BImprove real-time processing speedReading and writing stress reliefSpecial data processing applicationsStreaming dataData processing system
The invention discloses an online processing method and system oriented to streamed data. The method comprises the following steps: 1, establishing an online memory cache layer, extracting the property of the streamed data according to a key value structure, and storing in the online memory cache layer; 2, establishing a hybrid index structure for the streamed data in the memory cache layer; 3, adding an access flag bit to each streamed datum for which the index structure is established, and recording the access state of the streamed data by each analysis program, wherein the flag bits are used for flagging the register condition of the streamed data by different analysis programs; 4, cleaning data: if a certain streamed datum is accessed by all specified analysis programs in the memory cache layer, cleaning the streamed datum. By adopting the method and the system, the data reading and writing stress in a streamed processing procedure is reduced greatly, the stress of a database in a large-scale streamed data processing system can be effectively relieved, and the real-time processing speed of the streamed data can be increased.
Owner:INST OF COMPUTING TECH CHINESE ACAD OF SCI

Implementation method for reporting raft heartbeat of each node in different network domains

The invention discloses an implementation method for reporting raft heartbeat of each node in different network domains, and relates to the field of distributed database network communication. Respective heartbeat update information is recorded at a cluster heartbeat collection position according to time through a raft group leader of each node in different network areas, the heartbeat update information is read at the cluster heartbeat collection position in a classified manner through the raft group leader in each node and area broadcasting is carried out in each network area, and the group members in the respective network areas receive the heartbeat update information in the network areas and identify whether the heartbeat of the nodes communicating with each other is normal or not.
Owner:上海沄熹科技有限公司

Data deleting method, device, equipment and storage medium

The embodiment of the invention discloses a data deleting method, a device, equipment and a storage medium. The invention is applied to the field of virtual machines of cloud computing, and is specifically applied to delayed deletion processing of virtual machine snapshots generated by the virtual machines. The method comprises the following steps: when a trigger event for executing a virtual machine snapshot deletion operation is detected, obtaining at least one virtual machine snapshot of which the data state is a deleted state; obtaining a target virtual machine snapshot matched with the target computing node from the at least one virtual machine snapshot according to the parameter information of each virtual machine snapshot; and deleting the target virtual machine snapshot. By adopting the embodiment of the invention, the virtual machine snapshot is deleted in a delayed manner, and the read-write pressure of the storage cluster in the cloud computing system is effectively reduced,so that the stability of user services can be improved.
Owner:TENCENT TECH (SHENZHEN) CO LTD

Method and device for deploying and calling contract in block chain

The embodiment of the invention provides a method and device for deploying a contract in a block chain system. The block chain system comprises N mutually independent block chains, the method is executed by a block chain platform, the block chain platform is connected with the N block chains, and the method comprises the following steps: receiving a first request for deploying a first contract; determining that a first contract corresponds to a first block chain in the N block chains based on a predetermined rule; and sending the first transaction to the first block chain to deploy the first contract to the first block chain.
Owner:ALIPAY (HANGZHOU) INFORMATION TECH CO LTD

System for pushing to-do message based on workflow transaction

The invention discloses a system for pushing a to-do message based on a workflow transaction. The system comprises a workflow module, a message queue and a pushing module, the workflow module comprises an application server and a temporary collection queue, the application server is used for creating affairs based on workflows, and the affairs are used for executing approval tasks of a plurality of process processing nodes; wherein the temporary collection queue is used for collecting all examination and approval tasks in a current transaction in the application server according to an examination and approval process sequence, and transferring all examination and approval tasks to the message queue according to the examination and approval process sequence after all examination and approval tasks of the current transaction are submitted; and the pushing module serves as a consumer of the message queue and is used for pushing the approval task in the message queue to the message receiving system. The accuracy of data pushing and the consistency of the two parties are ensured, and the sequential arrangement and ordered execution process of each approval task are realized.
Owner:AEROSPACE INFORMATION
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products