Patents
Literature
Hiro is an intelligent assistant for R&D personnel, combined with Patent DNA, to facilitate innovative research.
Hiro

33results about How to "Avoid redundant storage" patented technology

Distributed cache method and system

The embodiment of the invention provides a distributed cache method and system. The method comprises the following step: determining a first cache node according to a primary key value of metadata, and determining a second cache node according to a secondary key value of the metadatathe; and storing metadata issued by center storage node in the first cache node and storing index position of the metadata in the second cache node, wherein the index position of the metadata is used for indicating addresses of the first cache node. According to the invention, the access of the metadata can be achieved by the index position of the metadata, so that the same metadate stored in a plurality of cache nodes is avoided, thereby avoiding redundant storage of the metadata, saving storage space and ensuring the data access consistency.
Owner:浙江杭海新城控股集团有限公司

Advertisement putting method and system

ActiveCN107330717AAchieve real-time deliveryIncrease exposureMarketingCrowdsAd serving
The embodiment of the invention provides an advertisement putting method and system. The target population is preloaded in the form of categories, and advertisements are put in real time according to an index from users to categories and an index from the categories to target units. The advertisement putting method comprises the steps of creating an advertisement unit, specifying a commodity code associated with the advertisement unit, and mapping the commodity code into a category; generating a target population corresponding to the category, and pre-loading the target population of each category to the index from users to categories; generating an index from categories to advertisement units according to the commodity code associated with the advertisement unit and the category mapped by the commodity code; acquiring and analyzing user information, finding a category corresponding the user according to information acquired by analysis and the index from users to categories, then finding an advertisement unit corresponding to the category according to the index from categories to advertisement units, and playing the advertisement unit.
Owner:BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1

Big data disperse uplink method and system

PendingCN112767110AAvoid redundant storageImprove chain efficiencyFinanceTransmissionData fileChain network
The invention provides a big data disperse uplink method and system, and the method relates to the field of big data, can be applied to the technical field of block chains and the financial field, and specifically comprises the steps: obtaining an uplink request of a user and a to-be-uploaded data file, and calculating the data file through a Hash algorithm according to the uplink request to obtain a first Hash value; comparing the first hash value with a hash value carried in the uplink request; when the first hash value is consistent with the hash value carried in the uplink request, segmenting the data file into a plurality of continuous data blocks according to a preset rule, and calculating a second hash value of each data block through a hash algorithm; and forming the data blocks into a chain structure through the second hash values of the data blocks, and uploading the data blocks in the chain structure to different nodes in the block chain network for consensus storage.
Owner:INDUSTRIAL AND COMMERCIAL BANK OF CHINA

Data verification method and related device and equipment

The embodiment of the invention discloses a data verification method, a related device and equipment. The data verification method comprises the steps that user equipment can upload a data fingerprintof reference data generated through a data digest algorithm to a block chain network, and the block chain network returns an uploading certificate after storing the data fingerprint to a block; further, the detection equipment can obtain the to-be-detected data and the uploading voucher corresponding to the identifier of the to-be-detected data; and the data fingerprint is acquired from the blockchain network according to the uploading certificate, a data abstract of the to-be-detected data is generated through the data abstract algorithm, and it is determined that the to-be-detected data passes verification when the data abstract is the same as the data fingerprint. By utilizing the decentration characteristic and the public transparency characteristic of the block chain, the stored datais transparent and fair, and by storing the data fingerprint of the reference data instead of the reference data, redundant storage of the data is avoided, and the processing efficiency of a block chain network is improved.
Owner:TENCENT TECH (SHENZHEN) CO LTD

Time series data storage method, device and equipment based on Hbase

The invention discloses an Hbase-based time series data storage method, device and equipment. The method comprises the steps of obtaining a piece of time series data generated by a data source; sorting the plurality of data labels and the at least one monitoring index to obtain a label sorting result and an index sorting result, and associating the label sorting result and the index sorting result with the data names to obtain a sorting relationship; dividing timestamps according to a preset time interval, and recording the timestamps corresponding to the data generation time; forming a row key by the data name, the identification tag and the timestamp corresponding to the data generation time, forming a column of a tag column cluster by the data tags except the identification tag in the plurality of data tags according to a tag sorting result, and forming a column of an attribute column cluster by the at least one monitoring index according to an index sorting result, obtaining a multi-valued model storage structure; and storing the multi-valued model storage structure and the sorting relationship into an HBase database. By applying the method, the data label and the row key can be decoupled, and redundant storage is avoided.
Owner:HANGZHOU HIKVISION DIGITAL TECH

Dynamic mapping method for meteorological numerical forecasting product based on NoSql database

The invention provides a dynamic mapping method for meteorological numerical forecasting product based on an NoSql database. The method comprises the following steps of loading and analyzing meteorological metadata information; acquiring plane data and attribute data information thereof related to quick drawing; splicing the meteorological attribute data of the NoSql database to generate a Key / Value key value pair; according to query parameters dynamically transmitted in real time, dynamically reading requested data in real time in a Key / Value key value pair form, and finally, processing readblock data in parallel in a graphic algorithm device to generate a PNG format picture, so that real-time, efficient and rapid drawing of meteorological data is realized, and redundant storage of datais avoided; a non-relational NoSql database is adopted for data storage, so that the problems of I / O bottleneck and high concurrency caused by a relational database are avoided, and the data processing and analysis efficiency is improved.
Owner:苏州视锐信息科技有限公司

Image compression method, image compression device, electronic device and storage medium

The present invention provides an image compression method, an image compression device, an electronic device and a storage medium, and relates to the field of data processing technology. The method comprises: acquiring matrices corresponding to a plurality of channels of an image, and performing bitwise layering on each of the matrices; performing correlation calculation on matrices correspondingto each layer of each channels after bit layering, and obtaining a difference matrix corresponding to the correlation; performing stroke length coding compression to the difference matrix, and generating and storing a plurality of data tables corresponding to the channels of the image. The method can improve image compression rate and image transmission efficiency.
Owner:BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1

Knowledge graph storage method based on hash addressing

The invention provides a knowledge graph storage method based on hash addressing. The knowledge graph storage method comprises the steps: obtaining a knowledge graph; and storing the knowledge graph,wherein the data structure of the entity in the knowledge graph comprises data and a link array, and the link array comprises one or more links, and each link comprises a link name and Hash of an entity to which the entity is linked, and the data is information of the entity. According to the invention, a knowledge graph storage mode based on hash addressing is realized, and the updating and querying speed is improved, and the redundant storage of resources is avoided, and the storage consumption is greatly reduced.
Owner:BEIJING UNIV OF POSTS & TELECOMM

Space vector data indexing and querying method based on HBase distributed storage

The invention is suitable for the technical field of geographic information, and provides a space vector data indexing and querying method based on HBase distributed storage. The method comprises the following steps: establishing a space database meta-table, each record in the space database meta-table corresponding to a space vector data set table; and querying the space vector data set table by each server node according to query conditions, and returning a query result to a client. According to the invention, a RowKey index is composed of partitions, spaces, attributes, object IDs and the like, the organization mode of vector space data can be effectively improved, and therefore redundant storage of the data is avoided; meanwhile, a partitioning strategy is self-defined, so that the data can be automatically and uniformly distributed to each server node, and the resource utilization rate of each node of the cluster is relatively balanced; in addition, a space coding method based on the XZ-Ordering thought is adopted, and the problem that line and surface elements cross geographic grids can be effectively solved.
Owner:吉奥时空信息技术股份有限公司

Product configuration method and equipment and computer readable storage medium

The invention discloses a product configuration method. The method comprises the following steps of: when a product configuration request is received, entering a feeding node on the basis of the product configuration request; calling a workflow engine interface in the feeding node so as to read a workflow in a preset resource pool and then determine a to-be-called node through the workflow, and providing an interface corresponding to the to-be-called node; and if the to-be-called node is not a closure node, obtaining a product configuration parameter from the resource pool, transferring the product configuration parameter to the interface of the to-be-called node until the to-be-called node is a signed node, and carrying out product configuration in the signed node. The invention furthermore discloses product configuration equipment and a computer readable storage medium. According to the product configuration method and equipment and the computer readable storage medium, the product configuration intelligence is improved and the product configuration maintenance cost is reduced.
Owner:PINGAN PUHUI ENTERPRISE MANAGEMENT CO LTD

Data backup device and method

The invention discloses a data backup device and method. The data backup device comprises a detection module for detecting an operational order corresponding to data in a full data set of a mobile terminal; an acquisition module for acquiring a pre-backup data set and the full data set in the mobile terminal; a changing module for changing a measure value in the full data set and an index of the pre-backup data set based on the operational order, wherein the measure value indicates the change status of the data in the full data set, and the index is used for identifying the data in the full data set; a backup module used for backing up the data corresponding to the index in the pre-backup set when the measure value is greater than a preset threshold. The invention further discloses the data backup method. The fine granularity increment backup method based on the measure value is achieved. The backup data size and backup frequency are controlled according to the measure value, the data redundancy storage is avoided by adopting the increment backup method, the data backup cost is lowered, and the data backup efficiency is increased.
Owner:NUBIA TECHNOLOGY CO LTD

Method, device and system for calling operating system library

The invention relates to the technical field of operating systems. Provided are a method, device and system for calling an operating system library. The method comprises: (101) receiving, by an execution domain, a memory access address of an application executable file transmitted by an administration domain, wherein the execution domain comprises one or more processors for running the application executable file, and the memory access address of the application executable file is an address of the application executable file stored in an memory of the execution domain; (102) running, by the execution domain, and according to the memory access address of the application executable file, the application executable file; (103) acquiring, by the execution domain, a memory access address of a dynamic operating system library when running the application executable file to call the dynamic operating system library; and (104) calling, by the execution domain, and according to the memory access address of the dynamic operating system library, the dynamic operating system library. The invention can prevent redundant storage.
Owner:HUAWEI TECH CO LTD

Data merging method based on improvement of business monitoring efficiency of electric running

The invention discloses a data merging method based on improvement of business monitoring efficiency of electric running, and belongs to the field of electric running. The data merging method comprises the following steps: a, importing data in a business application system of a first-level deployment part into a first-level deployment system database, carrying out storage, inspection and partitioning operation on the imported data by using a running and monitoring worktable system, and storing final data into a headquarter running and monitoring database; b, importing data in a business application system of a second-level deployment part into a second-level deployment system database, carrying out storage, inspection and partitioning operation on the imported data by using the running and monitoring worktable system, and storing final data in a provincial company running and monitoring database; and c, communicating the headquarter running and monitoring database with the provincial company running and monitoring database through a network, and calling data from each other. The data merging time is saved, and the efficiency of data merging operation is remarkably improved.
Owner:STATE GRID CORP OF CHINA +1

Unstructured data real-time crawling system based on Python and using method of unstructured data real-time crawling system

The invention discloses an unstructured data real-time crawling system based on Python. The unstructured data real-time crawling system comprises a crawler cluster, a temporary storage database, a data migration module and a target database, wherein the data migration module is used for carrying out partitioning arrangement on the data stored in the temporary storage database and migrating the arranged data to a target database for storage. According to the method and the system, the data migration module is used for arranging the non-structural data in the temporary storage database and migrating the arranged data to the target database to be stored. In this way, redundant storage of the same data by the temporary storage database and the target database is avoided. Meanwhile, through thestorage transition of the temporary storage database, the data arrangement pressure of the data migration module is reduced, and the logic integrity of the data in the target database is ensured, sothe efficiency of retrieving the information through the target database is further ensured.
Owner:广西美立方工程咨询有限公司

Distributed caching method and device of service data, electronic equipment and storage medium

The invention discloses a distributed caching method and device for business data, electronic equipment and a readable storage medium, and is applied to the technical field of financial science and tech. The distributed caching method for the business data comprises the steps that to-be-cached business data is acquired; according to the data object identifier of the to-be-cached service data, determining a target cache master node and a target cache slave node corresponding to the to-be-cached service data; judging whether the to-be-cached service data exists in the target cache master node and the target cache slave node or not; and if yes, determining whether to cache the to-be-cached service data to the target cache master node and the target cache slave node or not by detecting whether the to-be-cached service data is service multiplexing data or not. The technical problem that in the prior art, the cache utilization rate of distributed cache service data is low is solved.
Owner:深圳市茗格科技有限公司

Image processing method and device

The invention relates to the technical field of image processing and especially relates to an image processing method and device. The method and device are used for solving problems of low processing efficiency and data redundancy storage in image processing of polygon objects in the prior art. The image processing method provided by the embodiment of the invention includes determining coordinate information of all node objects except a preset node object in the polygon object with the preset node object according to the coordinate information before the preset node object change and the stored polygon information of the polygon objects and the node information of the node objects after that the coordinate information of the preset node object changes is determined; aiming at any polygon object with the preset node object, performing rendering on the polygon object again according to the coordinate information after the preset node object change and the coordinate information of all node objects except the preset node object in the polygon object.
Owner:AUTONAVI

Mass picture processing method and device, electronic equipment and storage medium

The invention provides a mass picture processing method, a mass picture processing device, electronic equipment and a computer readable storage medium, and relates to the technical field of data processing, and the method comprises the steps: obtaining matrixes corresponding to a plurality of channels of each picture in mass pictures, and carrying out the bitwise layering of each matrix; storing the picture bit layer data corresponding to each channel after bitwise layering according to an inverted index structure, and generating a picture layer index record file; and decoding all the layer indexes of the picture according to the layer index record file, and synthesizing the picture according to a decoding result. The method can reduce the picture storage amount and improve the picture transmission efficiency.
Owner:BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1

Method and system for preloading multi-dimensional data of space target

PendingCN113986926APreload implementationSlow response timeMulti-dimensional databasesSpecial data processing applicationsData setAlgorithm
The invention discloses a preloading method and system for multi-dimensional data of a space target, and relates to the field of data processing. The method comprises the steps that a space target data set of a target to be subjected to data analysis is input, N dimensions of the space target data set are selected and counted, a first statistical interval parameter of each dimension is set, and the space target data set is preloaded according to the N dimensions and the first statistical interval parameters. With the above scheme, multi-dimensional data analysis and dimension switching data analysis can be supported on the basis of one-time data loading.
Owner:BEIJING INST OF RADIO MEASUREMENT

Streaming reasoning method combining a variable memory and a multivariable connector

The invention provides a streaming reasoning method combining a variable memory and a multivariable connector. The streaming reasoning method comprises the following steps: processing RDF streaming data based on an OWL Horst rule set; According to the streaming reasoning method, under the background of a knowledge graph, firstly putting forward a variable memory, and avoiding redundant storage anddata transmission expenditure in the form of taking rules as units while the query speed in specific RDF streaming data is increased and looked up. Providing a storage method of the multivariable connector for pre-judging whether the rule is activated or not; And finally, in combination with the storage design scheme, designing a streaming reasoning algorithm EMSR, and effectively realizing efficient reasoning for the streaming RDF data. By additionally arranging the variable memory and the multivariable connector, the triad of the same type can be used for a plurality of rules, redundant storage in the form of taking the rules as units is avoided, and data network transmission is reduced.
Owner:FUZHOU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products