51results about How to "Guaranteed query efficiency" patented technology

The invention provides a stream type repetitive data detection method. According to the method, a TBFA (Timing Bloom Filter Array) is constructed for flexibly and efficiently detecting repetitive data in a sliding window model, wherein the TBFA consists of a plurality of TBFs (Timing Bloom Filters) with the same structure, each TBF comprises a bloom filter and a separated timer array used for storing timestamps, the whole TBFA works in a looped first-in first-out mode and gets rid of old elements removed from a data stream monitoring window while recording new elements. The stream type repetitive data detection method is implemented under the sliding widow model, element monitoring is correct to one element, therefore the statistic result based on the stream type repetitive data detectionmethod has good stability; in addition, a part of the timer arrays in the TBFA can be unloaded into a disc, therefore the overhead of an internal memory can be reduced. Theoretical analysis and experimental data show that more than 95% of query efficiency can be maintained when DCBA (Detached Counting Bloom filters Array loads less than 10% of data contents to the internal memory, therefore the method provided by the invention is superior to the traditional technical scheme in space efficiency and expandability.

The invention discloses a large data inquiring method based on distribution relation-object mapping processing. The method includes the following steps that firstly, m data processing nodes are selected, a Hibernate Session object is constructed for each data processing node, a distributed Hibernate framework is obtained and a Session resource queue is generated; secondly, a configuration file is set, a storage strategy and a routing strategy corresponding to a list of each type are set, an S list with a data volume is backed up at each data processing node, and an L list with a large data volume is stored to the m data processing nodes in a blocking mode; thirdly, an input inquiring request is analyzed and a corresponding processor is selected according to the type of the inquiring request; fourthly, the selected processor selects the corresponding node from the resource queue to process the inquiring request according to the inquiring request, the corresponding routing strategy, and a processing result is protocoled. The large data inquiring method based on distribution relation-object mapping processing can obviously improve the rate of inquiring large data lists.

The invention relates to a distributed storage method for checkpoint vehicle pass data. The method includes the steps that servers of computational nodes and data nodes are configured and a concurrent computation cluster environment is erected; a list structure is established according to vehicle features needing to be collected, at least two features are selected from the list structure to serve as main keys, and a piece of checkpoint data information is composed of the main keys; a distributed variable index is established for the main keys and commonly-used inquiry fields and a distributed retrieval index is established for license plate numbers; vehicle pass information data sources to be stored of all checkpoints are input; a user inquires the data through the fields containing the indexes and the corresponding data are returned by a system within 100 ms. The invention further discloses the distributed storage system for the checkpoint vehicle pass data. According to the method and device, the requirement for massive vehicle pass information data storage of a checkpoint system used for daily services is met, the index data structure of the data structure of vehicle pass information is designed to achieve the rapid inquiry function, the inquiry rate is greatly increased, and user experience is enhanced.

The invention discloses a big data query method and system. The method includes: configuring business query rules and the corresponding relationship between the business query rules and query conditions; The query condition in the request extracts the corresponding business query rules, and constructs a query scheme according to the extracted business query rules; queries data according to the query scheme, and returns the query result to the client. The present invention can extract corresponding query rules according to the query conditions by configuring the query rules and the corresponding relationship with the query conditions, and construct an optimized query scheme. The query scheme obtained in this way is suitable for different query conditions and ensures the efficiency of the query.

The invention provides an establishment method and system for a city management ontology knowledge base. The method comprises the steps of obtaining data sets of city management department systems and law and regulation documents related to departments; performing knowledge extraction on the data sets of the department systems and the law and regulation documents related to the departments according to a preset policy to obtain corresponding first knowledge entity set and second knowledge entity set; adding keyword tags and unique identifiers for all knowledge entities in the first knowledge entity set and the second knowledge entity set, establishing entity link relationships between the knowledge entities in the first knowledge entity set and the knowledge entities in the second knowledge entity set according to the keyword tags, and obtaining instances in the ontology knowledge base; and obtaining internet data matched with the instances, and establishing links between the instances and the corresponding internet data. According to the method and the system, the problem on information intercommunication among the departments is solved, and automated knowledge extraction and ontology knowledge base establishment are realized.

The invention discloses a blockchain copyright protection system and method based on double chains. The blockchain copyright protection system comprises a user operation module, a work DNA extractionmodule, a work auditing module, an intelligent contract module, a blockchain storage module and a user feedback module. The system combines the blockchain technology with the improved Simhash algorithm to realize a duplicate checking detection function before the work applies for the copyright, provides a manual detection verification service for a user, ensures the originality of the chained work, and solves the problem of low auditing efficiency of a copyright registration institution at the same time. A double-chain storage mode is adopted for work copyright information storage. Different nodes are added into channels of corresponding chains, transparency of work transaction information is guaranteed, privacy of work content information is also guaranteed, the problem that work contentis tampered and work copyright DNA cannot be successfully verified due to database storage is avoided, and double-chain storage guarantees data reading and writing efficiency of a block chain system.

The invention discloses a report display engine based on metadata. By defining the metadata, data reading logic, constraint and interface layout during the operation are analyzed. The metadata include a report header and a report field definition. The report engine determines data sources, report titles, the file outputting type and other main information by reading the report header, then integrates the report field definition to search and filter the data during operation and returns to a result set, and finally, based on the report header and the report field definition, determines the report display mode and outputs the same to the clients. The report display engine has the advantages that the standard metadata model is defined, flexible configuration is characterized, and the further metadata expanding is supported; at the premise that the maintainability is guaranteed, the report yield is increased, fast development is supported, and adaptability to the report system requiring frequent changes is achieved.

The invention relates to the field of point cloud indexing, in particular to a method for indexing scattered point cloud space of a historic building. The method is characterized by including steps of acquiring a data construction point set; gridding the point set, setting grid index digit groups, and calculating value of each unit of the grid index digit groups according to point coordinates in grids; merging the grids into an area or dividing an area by an octree, setting area digit groups, storing ID (identification) of each area and IDs of the areas of all adjacent six sides into the corresponding digit group, constructing a K-D tree in each area, traversing grid index digit groups, and calculating IDs the areas corresponding to the grid in the area digit groups; looking for the grids and the areas where inquired points locate according to coordinates of the inquired points, indexing in the areas and the adjacent areas by means of the K-D tree and obtaining the point nearest to the inquired point. The method solves the problems of single resolution ratio and data redundancy, and guarantees inquiry efficiency of the K-D tree.

The invention discloses a power grid mass time series data access method applicable to a section access mode, so as to ensure that both time series inquiry and the inquiry efficiency under a time section inquiry scene are taken into consideration under the condition that the write-in performance is not influenced. The method comprises the following steps: establishing three tables, which are respectively a Uid table, a Time-series data table and a Time-point time section data table; respectively storing power grid Time-series data into the Time-series data table and the Time-point time section data table, so that the positions of power grid data of the same time slice in a physical disk are adjacent, and the positions of the power grid data of different power grid devices in the same time point in the disk are also adjacent, so that the inquiry efficiencies based on the time series and time section can be ensured.

Embodiments of the invention provide a data query method, device and system, a data server and a request side. In a technical scheme provided by the embodiments, the data query method comprises the following steps of: receiving a data query request by the data server; generating path identification information; sending the path identification information and a query instruction to the data query system, wherein the path identification information is used for creating a file path in a file system and the file path is used for writing result data obtained on the basis of the query instruction; and sending the path identification information to a first request side so that the first request side calls a client of the file system to download the result data through the file path. According to the data query method provided by the embodiments of the invention, the data query efficiency is improved.

Embodiments of the present application provide a data storage method, apparatus and system. The data storage method comprises: obtaining a to-be-processed data table from a storage node that supports a row storage mode, wherein the to-be-processed data table contains at least one data record stored in the row storage mode; selecting a to-be-dumped data record from the at least one data record; and in a column storage mode, dumping the to-be-dumped data record to the at least one storage node that supports the column storage mode. According to the technical scheme provided by the embodiments of the present application, combination of the row storage mode and the column storage mode can be realized, so that on one hand, the advantages that the row storage supports the high concurrent query are made full use to ensure the query efficiency of the non-dumped data, and on the other hand, complicated query on the dumped data is facilitated based on the column storage to ensure the query efficiency of the dumped data.

The invention discloses a privacy cluster query method and device, and an electronic device. The method comprises the steps of receiving and analyzing a user query task; storing the execution main body information of the query task into a first database, and storing the execution information of the query task into a message queue for consumption; generating task meta-information according to the execution main body information and the post-consumption execution information; screening a target execution engine to access a privacy cluster according to the task meta-information and querying a target data table; and storing the query result into a second database. According to the invention, the execution information is stored in the message queue for real-time consumption, the real-time performance of query is ensured, and the task meta-information is generated according to the execution main body information and the execution information after consumption; and a target execution engine is executed according to the task meta-information, respective processing of query tasks with different consumed resources is achieved, and the query resources are routed to different execution engines, thereby ensuring the query efficiency.

The invention provides a data inquiry method and a terminal device, which are suitable for the technical field of data processing. The method comprises the following steps: selecting the data to be inquired corresponding to the inquiry instruction input by a user from a database; inserting the data to be queried into a table template preset in a data buffer area to obtain a table to be queried; paging the cache table to be queried and sending the resulting multi-page cache table to the user. The embodiment of the invention does not make mistakes due to the real-time updating of the database for the query table of the query data required by the user, and ensures the query efficiency and the correct rate when the user carries out the data query of a large amount of data.

The embodiment of the invention provides a data processing method and device and a device for data processing. The method comprises the following steps: dividing each m data pairs into a data pair group, respectively calculating an indication polynomial Fi (x) and a data polynomial Gi (x) for each data pair group, finally generating a ciphertext detection result according to Fi (x) and Gi (x) of each data pair group, and returning the detection result to a client. Because the number of the data pairs contained in the data pair group does not exceed m and n / m data pair groups are included in total, the number of data exchanged between the server and the client can be 2 * n / m ciphertext, so that the amount of data exchanged in the process of calculating Fi (x) and Gi (x) for each data pair group can be ensured not to linearly increase along with the data pair amount n held by the server; therefore, the data volume required to be transmitted can be reduced to a certain extent, and the overall query efficiency is ensured.

The invention discloses a large data query method and system. The large data query system comprises a query configuration unit, a query scheme construction unit, a query unit, a query storage unit, a data source adaptation unit and a pre-query set unit. The large data query method includes the follow steps that 1, service query rules and a corresponding relation between the service query rules and query conditions are configured; 2, a query history is stored; 3, adaptation is performed on different data source types; 4, a pre-query threshold value and a query tag are set. The large data query method and system have the advantages that compared with the prior art, through configuration of the service query rules and the corresponding relation between the service query rules and the query conditions, a corresponding query rule can be extracted according to the query conditions, an optimized query scheme is constructed to adapt to different query conditions, and the query efficiency is guaranteed.

The invention provides a data query method and device, equipment and a storage medium, and the method comprises the steps of responding to a received data query request, and obtaining the type of the data query request; determining a target database corresponding to the type of the data query request from a first database and a second database; orienting the data query request to the target database for query, wherein the size of the performance parameter value of the first database is different from that of the performance parameter value of the second database. By adopting the data query method provided by the invention, the data query requests can be classified, so that the data query efficiency and stability are ensured on the whole.

The invention provides a catalogue index optimizing method based on a slider. The catalogue index optimizing method based on the slider comprises the following steps that (1) a dynamic retrieval slider is set in catalogue indexes, and parameters capable of configuring the size of the retrieval slider are additionally set in the retrieval slider; (2) retrieval conditions are input in a retrieval system, and a configuration file sets parameters for catalogue index attributes according to the retrieval conditions; (3) when the catalogue indexes are started, according to the attributes of the started catalogue indexes, the parameters in the configuration file are read; (4) according to the setting of the parameters in the retrieval slider, the number of the catalogue indexes is calculated again; (5) according to the slider parameters and the number of the catalogue indexes, circulation is conducted, and the index value of the current attribute and current type matching rule of the catalogue indexes is calculated; (6) statistics of a retrieval result is conducted. By the adoption of the technical scheme, the size of the slider can be set according to service needs, dislocation calculation, conducted when indexes of the any type are adopted, of each character is avoided, an index establishment process can be rapidly completed, and the query efficiency can be guaranteed.

The embodiment of the invention discloses a data sharing method and related equipment, which can be specifically applied to an intelligent vehicle and an unmanned vehicle to realize remote safety diagnosis of the vehicle, and comprises the following steps: a server receives a file set sent by first equipment, wherein the file set comprises N ciphertext files, N index ciphertexts and N first key ciphertexts; the server receives a query trap door sent by a second device, finds a matched target index ciphertext from the N index ciphertexts according to the query trap door, and determines a corresponding target ciphertext file and a target first key ciphertext; and the server re-encrypts the target first key ciphertext by using the proxy re-encryption key to obtain a target first key re-encryption ciphertext, and sends the target ciphertext file and the target first key re-encryption ciphertext to the second equipment. The invention can be applied to multiple technical fields of intelligent driving, smart home, cloud storage file sharing and the like, and is used for realizing data security access in the corresponding fields.

The invention discloses a knowledge graph construction method and system, and a query method and system, and the construction method comprises a derived label input step, and the specific steps are asfollows: constructing an inheritance tree based on the relation information, each node of the inheritance tree being an entity class, and the relation between the nodes being the inheritance relationbetween the corresponding entity classes; when the entity is input, extracting all entity classes corresponding to the entity based on the inheritance tree, generating a derived label and inputting the derived label; the query method comprises the specific steps of obtaining query request data, performing query in the constructed knowledge graph based on the query request data, generating a queryresult and outputting the query result. According to the method, the inheritance relationship related to the related entity is indicated through the derived label, query of any level on the inheritance tree is broken through, and the method is suitable for multi-layer inheritance scenes and particularly suitable for the news industry which is large in data size, wide in inheritance tree and deepin inheritance tree.

The invention discloses a multivariate time sequence similarity search method based on variable correlation. The method comprises the following steps of firstly, normalizing a pre-acquired multivariate time sequence; secondly, calculating a Pearson correlation coefficient among query sequence variables; on the basis of Pearson correlation, clustering by using OPTICS, and clustering variables with similar trends into one class; then, extracting a central sequence of each class after clustering, and representing the class by using the central sequence; and finally carrying out PAA feature extraction on all the center sequences, and obtaining a feature representation sequence of the multivariate time sequence; and calculating the DTW distance between the multivariate time sequences after feature representation, and finding out similar sequences. According to the method, the feature sequences which are concise and reserve original data features are obtained through variable clustering, and the distance between the feature sequences is calculated by using the multi-dimensional DTW, so that the retrieval efficiency and the query accuracy are improved.

The invention relates to a geographic information system and discloses locating data storage and retrieval methods and apparatuses for the geographic information system. A geographic region is dividedinto multiple grids; corresponding relationships among identifiers corresponding to mobile terminals, grid identifiers and time periods are stored in indexes; and all locating data of the same mobileterminal in the same grid in the same time period only correspond to an index record, so that all the grids corresponding to the locating data of the specified mobile terminal can be easily found during retrieval, the required locating data is efficiently obtained according to the corresponding grids, and the workload of useless data processing is reduced. Hashing is performed through the identifiers corresponding to the mobile terminals, and one data storage table is selected from multiple data storage tables to perform storage, so that the storage and retrieval of the locating data can be performed in the relatively small data storage table, and the storage and retrieval efficiency is improved.

The invention discloses a label processing method and device and a computer system, and the method comprises the steps of receiving a label generation request which comprises a to-be-labeled user anda corresponding label; generating a label storage task corresponding to the to-be-labeled user, wherein the label storage task comprises an established association relationship between the to-be-labeled user and the corresponding label; determining a partition corresponding to the to-be-labeled user according to the user code corresponding to the to-be-labeled user and a preset algorithm; and distributing the label storage task to the corresponding partition, so that the corresponding partition stores the association relationship, the association relationship between the user and the label isstored in the corresponding partition according to the user code, the stored label corresponding to the corresponding user can be quickly found according to the user code, and the query efficiency ofthe label is ensured.

The invention discloses a data storage and query method and device, a storage medium and electronic equipment, and the method comprises the steps: obtaining to-be-stored data, and storing the to-be-stored data in a cache region of the to-be-stored data; determining an insertion position of the to-be-stored data in the cache region according to the timestamp of the to-be-stored data and a bisection method; writing the to-be-stored data inserted in the cache region into a memory file, and determining the positions of an index block and a data block in the memory file; determining the position of to-be-stored data in a to-be-stored buffer area in the memory file according to the dichotomy and the read data in the data blocks, and updating the number of the data blocks according to the position; whether residual data exist in the to-be-stored buffer area or not is judged, and a stored memory file is determined according to a judgment result; and performing data query according to the stored memory file. The accuracy and continuity of the data are ensured based on a time sequence reading mode, the index position and the data are stored separately, the reading and storage efficiency is ensured, and the query and storage efficiency is ensured.

The invention relates to the technical field of data processing, in particular to an electric charge query method and electronic equipment. The method comprises the steps of obtaining a natural language question corresponding to a user intention; utilizing the user intention recognition model to understand the natural language of the natural language questions so as to determine the user intention; when it is determined that the user intends to inquire the electric charge, pushing a message for inquiring the user code to the user; obtaining reply information fed back by the user; and based onthe reply information fed back by the user, utilizing a dialogue management model to determine that the next message pushed to the user is in dialogue with the user so as to push the electric charge query result to the user; utilizing the user intention recognition model to understand the natural language questions to determine a user intention; and determining to push the next message to the userby utilizing the dialogue management model, so as to push an electric charge query result to the user. The method not only can meet the requirement of users for electricity charge query anytime and anywhere, but also can replace manual customer service to process electricity charge query business, and electricity charge query efficiency is improved.

The invention discloses a data management system and a data management method based on cold, temperature and hot data, the data management system comprises a computer, at least one first server and atleast one second server; the first server comprises a first database for storing hot data and a second database for storing temperature data; the second server comprises a third database for storingcold data; and the computer receives and displays the monitoring data of the tested equipment in real time, and stores the monitoring data into the first database, the second database and the third database respectively according to the data type of the monitoring data. According to the embodiment provided by the invention, a multi-level and three-dimensional data management mode is set, so that the data management efficiency, the storage efficiency and the query efficiency can be improved, and the software service capability and the data service capability are improved to the maximum extent.

The invention provides a query processing method and system for text big data, and relates to the field of computer application. The text big data query processing method comprises the steps of obtaining text big data semantics; configuring a query rule and a corresponding relationship between the query rule and a query condition; fusing SQL syntax to generate a text big data semantic instructionanalysis and query model; and recording a queried intermediate process variable and the temporary state and feeding back a result. The semantic model can be standardized, the problems of redundancy,invalidation and the like in the query process are eliminated, the accuracy of the query process is improved, and the most effective query mode is quickly found to obtain the result. In addition, theinvention further provides a query processing system for the text big data. The query processing system comprises a specification module, a query module, an instruction module and a control module.

The invention relates to an account login method, a response method, display equipment and an account server. The account login method comprises the following steps: sending an account login request message containing an application program identifier; receiving a first response message responding to the account login request message, wherein the first response message comprises a shared account number or prompt information used for prompting a user that the shared account number is exhausted, and the shared account number or the prompt information is determined according to a query result obtained by querying an account number associated information group matched with the application program identifier from an account number sharing pool; when the first response message contains the shared account, logging in the application program identified by the application program identifier according to the shared account; and when the first response message contains the prompt message, stopping logging in the application program identified by the application program identifier, thereby effectively ensuring the query efficiency of the account number associated information group, providing the shared account number automatic distribution service, and providing convenience for different users to use the same shared account number.

The invention discloses a back-end data processing method and device in a front-end and back-end decoupling scene. The method comprises the following steps: when a data query instruction sent by a front-end interface is received, scanning a rear-end cache library according to query parameters carried in the data query instruction, obtaining data corresponding to the query parameters from the rear-end cache library or a source database according to a scanning result, and performing rear-end interface response according to the data corresponding to the query parameters; and when the source database sends a data change instruction, scanning a back-end cache library according to change parameters carried in the data change instruction, and deleting data corresponding to the change parameters from the back-end cache library according to a scanning result. According to the method, waste of back-end performance resources can be avoided, and the accuracy of the query result is effectively improved while the query efficiency is ensured.

The invention discloses an es cluster double-computer-room high-availability deployment method, belongs to the field of computer business application research and development, and solves the problem that cluster deployment in the prior art cannot ensure cluster data security, application availability and uninterrupted application service. Es clusters are installed and deployed in a main machine room A and a standby machine room B, after installation and deployment are completed, parameters are set that copies of the same fragment are distributed in the main machine room A and the standby machine room B respectively, and the fragment and the copies of the fragment are located in different areas; the Nginx cluster is installed and deployed in a primary machine room A and a standby machine room B, and routing configuration is carried out; and high-availability logic calling is realized based on the configured primary machine room A and standby machine room B. The invention is used for realizing the es cluster double-computer-room deployment.