130 results about "Online analytical processing" patented technology

Improved method of and apparatus for joining and aggregating data elements integrated within a relational database management system (RDBMS) using a non-relational multi-dimensional data structure (MDD). The improved RDBMS system of the present invention can be used to realize achieving a significant increase in system performance (e.g. [deceased] decreased access / search time), user flexibility and ease of use. The improved RDBMS system of the present invention can be used to realize an improved Data Warehouse for supporting on-line analytical processing (OLAP) operations or to realize an improved informational database system or the like.

Methods and systems coordinate an Internet-based financial transaction between an Internet merchant and a customer. A first information packet is received with a payment network from the Internet merchant. The first information packet has a credential assigned to the customer and transaction information specifying at least a cost of the Internet-based financial transaction. With the payment network, account information is determined that identifies a financial account maintained by the customer at a financial institution and authorization information that allows debit access to the identified financial account. A second information packet that includes the transaction information, the account information, and the authorization information is generated with the payment network. The second information packet is transmitted with the payment network to the financial institution with a request to perform a debit transaction from the identified financial account for the specified cost of the Internet-based financial transaction.

The invention discloses a method and system for distributed computing and querying massive data in online analysis and processing. The method uses a cluster system to perform distributed pre-calculation and querying on data cubes. Based on the MapReduce framework, the present invention divides large-capacity data sets into blocks and distributes them to each node through MapReduce, then the Map task on the node calculates a corresponding local closed cube for each data block, and finally starts the Map task on different nodes Parallel query is performed on each local closed cube, and the Reduce task merges the metric values ​​obtained from the query. The present invention can simply and effectively perform pre-calculation and query on-line analysis and processing of large-capacity data, greatly compress the storage space of the data cube, and can quickly respond to user queries.

An "active cache", for use by On-Line Anaytic Processing (OLAP) systems, that can not only answer queries that match data stored in the cache, but can also answer queries that require aggregation or other computation of the data stored in the cache.

An On-Line Analytic Processing (OLAP) system identifies a plurality of simultaneously computable moving aggregate functions in a query. The identified moving aggregate functions are then partitioned into sets that can be computed simultaneously based on equivalent sort expressions. Finally, the OLAP system generates an access plan that executes the partitioned sets simultaneously.

The invention discloses an intelligent shopping guide system and method of an electronic commerce website. The intelligent shopping guide system comprises an external data interface module, an online transaction processing module, an online analysis processing module and a complex event processing module, wherein the external data interface module is used for acquiring and preprocessing various kinds of required data in an external server / terminal in real time; the online transaction processing module is used for storing updated data acquired by the external data interface module in real time; the online analysis processing module is used for analyzing data in the online transaction processing module and updating a shopping guide policy; and the complex event processing module is used for implementing the updating of the shopping guide policy in real time and responding a shopping guide request in real time. The intelligent shopping guide system and method can be used for collecting and analyzing current data and other relevant data in real time and predicting current demands of a user by applying a data mining technology as well as recommending a proper product to the user on the basis of the prediction in a proper manner.

An advanced intelligence engine (AIE) for use in identifying what may be complex events or developments on one or more data platforms or networks from various types of structured or normalized data generated by one or more disparate data sources. The AIE may conduct one or more types of quantitative, correlative, behavioral and corroborative analyses to detect events from what may otherwise be considered unimportant or non-relevant information spanning one or more time periods. Events generated by the AIE may be passed to an event manager to determine whether further action is required such as reporting, remediation, and the like.

The invention discloses a decision tree based game cheat detection method invented for solving the problem of the prior art that the passive defensive mode cannot detect external hanging. The method of the invention comprises the following procedures: the non-redundant characteristic attribute data set is extracted from the information database of a player at predetermined time; data in the characteristic attribute data set are divided into characteristic attribute exercise data and characteristic attribute test data; a decision tree is generated with the characteristic attribute exercise data and clipping on the decision tree through the characteristic attribute test data is performed to generate an objective decision tree model; the objective decision tree is assessed to obtain an appropriate objective decision tree model; analytical treatment is performed on the objective decision tree to produce categorized player databases and then on-line analysis of the categorized player databases is conducted to detect cheating players with external hanging. The invention can conduct data mining analysis with the data mining method in an active defensive mode to detect cheating players, thereby improving the external hanging preventing ability in online network games.

The invention discloses a big data tax-related information analysis system. The system comprises the following modules: a data acquisition module which performs incremental acquisition on data in the internet by adopting a crawler acquisition mode, a data cleaning module which performs data cleaning in ways of unrelated field cleaning, price and discount price filtering, time stamping and currency automatic conversion, a data analysis module which performs multi-dimensional analysis on tax-related information data through online analysis processing and data mining technologies, a data storage module which dispersedly stores the data in a plurality of independent devices by adopting a distributed storage policy and an extendable system structure, and a data output module used for outputting the data required by a user according to a specific rule. According to the big data tax-related information analysis system, a large amount of tax-related information data is provided for taxation collection and management in real time, and a tax-related information law is found and future tax avoidance and tax evasion trends are predicted by utilizing trend indexes.

A system and method for managing summary tables. A summary table manager is disclosed for managing summary tables in an OLAP (OnLine Analytical Processing) database system, comprising: a query analysis system that generates a set of proposed summary tables based on query statistics gathered for a set of inputted queries; and a system for calculating a performance measure for each of the proposed summary tables based on the query statistics.

The invention provides a flow data processing method capable of realizing multi-dimensional free analysis. OLAP (online analytical processing) technology is adopted to correspondingly classify original flow data and establish relevant association. Simultaneously, relevant association is also established between each classification of flow data and all dimensions, and all classified data share dimension data, so the multi-dimensional free analysis on the flow data can be realized by using multi-dimension to analyze the data layer by layer. A user can take any part of the flow data out in a report form, perform gradual free analysis by using a plurality of the dimensions and select the flow data continuously until a final desired data report is obtained.

The invention discloses a log check point recovery method applied to memory data base OLTP (online transaction processing), which uses the log check point technique based on double-log double-check-point backup. Two backup files can be used in turn, and a data base can recover to a latest uniform state no matter in a transaction process, a check point executive process or breakdown in a recovery process. Meanwhile, an MMAP (memory-mapped analog page) sharing mechanism is used for quickly setting up the mapping from a check point standby file to a memory, and rapid recovery of massive data bases is realized.

The invention discloses a third-party rhochrematic data disposal method, which is characterized by the following: adapting on-line analysis processing (OLAP) technique in the third-party rhochrematic management system; making decision of specific problem for third-party rhochrematic company person; analyzing, inquiring and reporting at multiple-dimension pattern; observing the data regulation from more direct angle.

The invention provides a data preprocessing method for heterogeneous data sources. The method comprises the following steps: reading heterogeneous data from a plurality of heterogeneous data sources; preprocessing the heterogeneous data based on a preprocessing rule library to obtain normalized data; storing the normalized data in a database to be applied to data integration, data mining and / or online analysis processing of enterprises. By adopting the data preprocessing method, politics and law service data can be shared; the method has high generality, and is easy to extend; three times of progressive preprocessing are performed on the data, and a processing process can be traced, so that a processing rule is easy to modify, the data processing efficiency and processing accuracy are increased, and the data can be stored in a unified way based on an error log modification and extraction rule to provide services to the outside.

The invention discloses a data processing method. The method comprises the steps of writing a date switching record in a first log table under the condition that a batch processing triggering request is received, wherein a log type identifier of the first log table is the same as that in a control table; reading a record on that day in the first log table and a file required for batch processing; performing batch processing on day initial data generated on the previous day and comprising a data table set generated by batch processing on the previous day according to the record and the file; and when an online transaction request is received, performing online business processing according to the online transaction request and the first data table set, and writing a transaction record in the first log table, wherein a log type identifier of the first data table set is the same as that in the control table. According to the method, different data are accessed in the batch processing and the online transaction processing, access data conflicts do not exist, and certain businesses of the batch processing do not need to be executed again in the online transaction processing, so that the load of online transaction is reduced.

The invention provides an online analytical processing (OLAP)-based intelligent analysis method and application thereof to the development of a business intelligence (BI) system. In the method, each dimension of a data cube is automatically traversed by cyclic means, and recursive vertical drilling and inter-dimension connection analysis are performed on each dimension, thereby obtaining a plurality of dimension members with the highest contribution degree for a current report total sum or a certain measure and combinations thereof. In the whole flow, manual analysis is not required, only the data cube is required to serve as input, and output comprises each measure in the cube and the combinations of N dimension members with the highest contribution degree for the measures.

The invention discloses a highway network operation-oriented decision support system, comprising a hardware platform and a software system, wherein the hardware platform comprises a data access end, a data interactive processing platform and a user terminal connected by network equipment in sequence; and the software system comprises a data access module, an on-line analysis processing module, a state early warning module, a mining analysis module, an auxiliary decision module and a technical support module. Data generated during highway network operation can be intelligently analyzed, multi-dimensional mining analysis is performed on the data under the support of basic data and knowledge and the coordination of the modules to discover a problem and propose a solving strategy, and a scientific and intelligent decision support system is thus established for providing qualitative and quantitative suggestion for various action decisions for improving the operation and service levels, and assisting in realizing secure, efficient and green goals of on-line operation and service.

The invention discloses a data processing method and a data processing device for on-line analysis processing. The data processing method for on-line analysis processing comprises the following steps of acquiring data in on-line analysis processing and partitioning the data so as to obtain a plurality of partitions; respectively calculating user numbers of de-weighting counting indexes of the partitions; and adding the obtained user numbers of the de-weighting counting indexes of the partitions so as to obtain the user number of de-weighting counting in the on-line analysis processing. By using the data processing method, the problem that the cost for an internal memory when in on-line analysis processing is high in the prior art is solved, and the effect of reducing the cost for the internal memory when in on-line analysis processing is achieved.

The invention discloses an IP address information query system. The system comprises an IP address information query module and an online analysis module, wherein the IP address information query module is used for querying corresponding IP address information, and comprises an information distribution unit, an information management unit, an information routing unit, a geographic position unit and an application attribute unit; and the online analysis module is used for extracting the IP address information from a database and analyzing corresponding IP addresses, and providing query data for the IP address information query module. The IP address information query system disclosed in the invention can be suitable for the query of IPv4 and IPv6 addresses, satisfy multi-application scene multi-dimensionality UP address information query, and realize the comprehensive analysis and query of IP addresses. Through online analysis processing, the query data is more objective, comprehensive, accurate and detailed.

The embodiment of the invention discloses a method and a device for analyzing a multi-dimensional query sentence in an online analysis processing server. The method comprises the following steps of: analyzing a multi-dimensional query sentence and generating a syntactic tree according to an analyzed result, wherein a node of the syntactic tree comprises a horizontal axis object, a longitudinal axis object, a slicing axis object, a calculating member object, a calculating unit object and a custom function CDF object; when a multi-dimensional query expression of various objects on the syntactictree is executed, if a function needs to be called, judging whether the function is a custom function or not according to a function definition of the custom function, if so, entering the executing process of the custom function; otherwise, judging whether the function is a standard function or not according to the function definition of a standard function; and if so, entering the executing process of a marking function. By the embodiment of the invention, the working efficiency of a developer in the development process of the whole OLAP system can be improved.

The invention relates to an online analyzing process system and the method that is used to online process the log created from device. The online analyzing process system comprises a log collection module used to dynamic collect the log sent from device; a log analyzing module used to analyze the collected log; log saving module used to store the log after being analyzed; intermediate process module used to intermediate process the log in the log saving module and create and save intermediate result; online analyzing process module used to process and display the intermediate result. The method of the corresponding online analyzing process method includes: log collection and analyzing step, log saving step, intermediate result creation step and online analyzing process step. The invention would realize online analyzing process by intermediate result, so the responding speed and process efficiency would be increased. It can also take dynamic collection and find problem in time.

The invention discloses a financial data service system, comprising an ETL unit, an OSD unit, a data warehouse DW, an on-line analysis processing unit OLAP and an enterprise service bus ESB. A data service subsystem set comprises a plurality of service subsystems which are used for processing relevant data of all subsystems; the enterprise service bus ESB is connected with the data service subsystem set, the ETL unit, the OSD unit and the on-line analysis processing unit for maintaining the same data in different subsystems in a plurality of subsystems at the same time. The financial data service system in the invention can effectively solve the problem of information island, ensure independence of all subsystems, reduce the maintaining cost of IT system and promote data safety, and the service ability of the IT system and utilization ability of all kinds of information reach new height.

The invention discloses a method and device for on-line analysis and processing of large data. The method comprises a storing step and a searching step. The data processed by ETL is assigned to the computing nodes for aggregation calculation. According to the method and device, the method combining the pre-calculation and compression is used to solve the storage pressure caused by large data to OLAP. Storage of historical data over a long period of time is achieved through cold and hot data separation. Moreover, distributed computing is used to separate computing pressure and quickly respond to searching requirements. The method and device for on-line analysis and processing of large data solves the storage pressure caused by large data to the OLAP by adopting the method combining pre-calculation and compression, achieves the storage of historical data over a long period of time through cold and hot data separation, and uses distributed computing to separate computing pressure and quickly respond to searching requirements.

The invention relates to the OLAP recommending technology, in particular to an online analytical processing (OLAP) query log mining and recommending method based on efficient mining of frequent closed sequences (BIDE). In the method, the possible next query is recommended to OLAP users, so that the process of browsing and analyzing multi-dimensional data by the users is simplified. The method has the advantages that: based on the characteristic of query operation in the field of OLAP, fields for expressing OLAP operation in log files are extracted, and the log files are abstracted to form a query sequence, so that the expression method of the log files is simplified; a query pattern is mined in the query sequence by a BIDE algorithm, so that the efficiency of subsequent recommending is improved on the premise of ensuring that the recommending accuracy is not reduced; a suffix tree is established on the query mode, so that a starting point of query matching is not needed to be searched for by a search algorithm in subsequent pattern matching to improve the speed of the pattern matching; and a matching algorithm of a fuzzy query pattern is provided to improve the recommending accuracy.

The invention discloses a cloud container service-based batch processing auction mechanism. The mechanism comprises the following steps of: firstly mapping a sub-task relational graph of bidders and the quantity of various required resources by utilizing a cloud container; importing a thought of online batch processing, waiting for a fixed time to carry out a round of auction on a batch of bidders; writing all the constraint conditions into an integral linear programming, processing unconventional constraints related to sub-task relation and completion time in the linear programming; writing a dual linear programming; updating an original solution through the principle of complementary slackness; selecting a reasonable and optimum scheduling calculation required cost for each bidder; selecting the bidder with the highest unit resource price and positive own utility to win the bidding; and finally updating the resource price of each time slot by utilizing residual amount of resources according to a Posted Price mechanism, so that the condition of exhausting the resources in advance is avoided and benefit is brought to accept the future bidders. The mechanism disclosed by the invention has the advantages of being incentive in compatibility, feasible in calculation, economical and effective.

The invention provides a data processing method and apparatus, and a data query method and apparatus. The data processing method comprises the steps that a load balance server receives a query request used for requesting to query predetermined data; the load balance server selects an OLAP (Online Analytical Processing) server used for processing the query request from an OLAP server cluster according to a selection policy, wherein the OLAP server cluster comprises at least two OLAP servers and the OLAP servers in the OLAP server cluster are independent mutually; and the load balance server forwards the query request to the OLAP server. Through the methods and the apparatuses, the problem that the OLAP cannot quickly make a response to user demands under the condition of high concurrency and large data volume of data stored in a database in related technologies is solved, so that the effect of quickly making a response to the user demands under the condition of high concurrency and large data volume of data stored in the database is achieved and the user experience is improved.

The invention provides a report penetration device and a report penetration method for an online analytical processing system. The device comprises an information transmitting module, an information merging module and a data query module, wherein the information transmitting module transmits context filtering information of a source list to a target list; the information merging module merges the context filtering information of the source list in context filtering information of the target list; and the data query module performs data query and displays the result data according to the context filtering information of the target list. According to the device, the context filtering information of the source list and the target list is combined, and the dimensionality information of the source list and the target list is actually and comprehensively considered, so that the penetrated data has significance.

The invention relates to a fast on-line analysis processing method based on a spatial position, and belongs to the field of geographic information processing methods. The method comprises the following steps: aggregating source data as aggregation table data represented in a quad-tree manner according to spatial dimension; and determining a selection range selected by a user on a map while generating a report, aggregating light-weight aggregation data of each quad-tree node belonging to the selection range according to a query dimension selected by the user to obtain a query result. Therefore, the method disclosed by the invention has the following advantages of: 1, supporting the generation of the report at any aggregation dimension in any range by integrating with pre-statistics based on geographical coordinates; 2, satisfying two capacities of real-time administrative division and random range query under a big data condition so as to make up the disadvantage of the traditional administrative division query.

The present invention discloses a telecommunication report generation system and the method. The telecommunication report generation system comprises a data warehouse for storing the specific format data generated according to the network management data and the service requires, a mapping unit for mapping the data in the network management system data base to the data warehouse according to the specific mapping rules, and a report unit for using the data in the data warehouse to generate a telecommunication report meeting the specific conditions based on the online analytical processing technology. The present invention can adapt to different network layers, different device manufacturers and different data base systems, therefore the users can easily customize the content and format of the report as required, and can select specific time strategy to generate the telecommunication report meeting the specific condition.