Patents
Literature
Hiro is an intelligent assistant for R&D personnel, combined with Patent DNA, to facilitate innovative research.
Hiro

31 results about "Data stream management system" patented technology

A data stream management system (DSMS) is a computer software system to manage continuous data streams. It is similar to a database management system (DBMS), which is, however, designed for static data in conventional databases. A DSMS also offers a flexible query processing so that the information need can be expressed using queries. However, in contrast to a DBMS, a DSMS executes a continuous query that is not only performed once, but is permanently installed. Therefore, the query is continuously executed until it is explicitly uninstalled. Since most DSMS are data-driven, a continuous query produces new results as long as new data arrive at the system. This basic concept is similar to Complex event processing so that both technologies are partially coalescing.

Estimating latencies for query optimization in distributed stream processing

A “Query Optimizer” provides a cost estimation metric referred to as “Maximum Accumulated Overload” (MAO). MAO is approximately equivalent to maximum system latency in a data stream management system (DSMS). Consequently, MAO is directly relevant for use in optimizing latencies in real-time streaming applications running multiple continuous queries (CQs) over high data-rate event sources. In various embodiments, the Query Optimizer computes MAO given knowledge of original operator statistics, including “operator selectivity” and “cycles / event” in combination with an expected event arrival workload. Beyond use in query optimization to minimize worst-case latency, MAO is useful for addressing problems including admission control, system provisioning, user latency reporting, operator placements (in a multi-node environment), etc. In addition, MAO, as a surrogate for worst-case latency, is generally applicable beyond streaming systems, to any queue-based workflow system with control over the scheduling strategy.
Owner:MICROSOFT TECH LICENSING LLC

Facilitating Flexible Windows In Data Stream Management Systems

Facilitating flexible windows in querying continuous data streams. In one embodiment, a software code is associated with a window, wherein execution of the software code determines the values to be included in the window. On receiving a query indicating the window, the result of the query is generated based on the values in the window determined by execution of the software code. The software code may be identified by an identifier and thus used for different queries on the same or different continuous data streams.
Owner:ORACLE INT CORP

Specifying A Family Of Logics Defining Windows In Data Stream Management Systems

Simplifying a user's task in specifying a family of logics, with each logic designed to potentially select different subsets of values from the same continuous data stream at the same time instant. In one embodiment, all the logics are together specified by a common user specified software code design to accept a set of parameters, with different logics resulting from execution of the software code with different parametric values. Thus, when closely related family of logics are to be developed, the common software code may be formulated, with the code being designed to accept parameters and providing different logics for different sets of parametric values corresponding to the parameters.
Owner:ORACLE INT CORP

Specifying a family of logics defining windows in data stream management systems

Simplifying a user's task in specifying a family of logics, with each logic designed to potentially select different subsets of values from the same continuous data stream at the same time instant. In one embodiment, all the logics are together specified by a common user specified software code design to accept a set of parameters, with different logics resulting from execution of the software code with different parametric values. Thus, when closely related family of logics are to be developed, the common software code may be formulated, with the code being designed to accept parameters and providing different logics for different sets of parametric values corresponding to the parameters.
Owner:ORACLE INT CORP

Efficient predicate prefilter for high speed data analysis

ActiveUS20090171890A1Aggressive early data reductionNot only redundant processingDigital data information retrievalDigital data processing detailsQuery planTheoretical computer science
A method and system are disclosed for operating a high speed data stream management system which runs a query plan including a set of queries on a data feed in the form of a stream of tuples. A predicate prefilter is placed outside the query plan upstream of the set of queries, and includes predicates selected from those used by the queries. Predicates are selected for inclusion in the prefilter based on a cost heuristic, and predicates are combined into composites using a rectangle mapping heuristic. The prefilter evaluates the presence of individual and composite predicates in the tuples and returns a bit vector for each tuple with bits representing the presence or absence of predicates in the tuple. A bit signature is assigned to each query to represent the predicates related to that query, and a query is invoked when the tuple bit vector and the query bit signature are compatible.
Owner:AT&T LABS

Unified window support for event stream data management

Data stream query mediation may utilize a query handler configured to receive a query from a stream application to be applied against a stream of data including multiple tuples representing events. A stream window manager may be configured to express the query in a specification which defines a window including a subset of the tuples, the specification defining content of the window as a range of the tuples having a range attribute over which the content is specified, defining when to update the window using a synchronization attribute specifying a movement of the window over time with respect to the content, and defining an evaluation of the content of the window using an evaluation attribute specifying when to perform the evaluation. A query translator may be configured to translate the query including mapping the range attribute, the synchronization attribute, and the evaluation attribute to a stream processing language of a data stream management system (DSMS), to thereby obtain a translated query. A DSMS mediator may be configured to provide the translated query to the DSMS for processing therewith.
Owner:SAP AG

Efficient predicate prefilter for high speed data analysis

A method and system are disclosed for operating a high speed data stream management system which runs a query plan including a set of queries on a data feed in the form of a stream of tuples. A predicate prefilter is placed outside the query plan upstream of the set of queries, and includes predicates selected from those used by the queries. Predicates are selected for inclusion in the prefilter based on a cost heuristic, and predicates are combined into composites using a rectangle mapping heuristic. The prefilter evaluates the presence of individual and composite predicates in the tuples and returns a bit vector for each tuple with bits representing the presence or absence of predicates in the tuple. A bit signature is assigned to each query to represent the predicates related to that query, and a query is invoked when the tuple bit vector and the query bit signature are compatible.
Owner:AT&T LABS

Systems and methods involving physician payment data

Methods and systems of managing physician payment data (PPD) may involve a data compilation system for compiling physician payment data from multiple sources; a data processing system for processing the compiled physician payment data; a data management system for creating a searchable database from the processed physician payment data; and a data distribution system for providing access to the searchable database. Exemplary embodiments of the invention may include a computer-implemented system for automated data compilation, processing, management, analysis, and distribution, such as facilitating online input, output, access and retrieval of PPD using software accessed via a network portal on the Internet. Numerous other aspects are provided.
Owner:OBSIDIAN HEALTHCARE DISCLOSURE SERVICES

Data stream management system for accessing mass data and method thereof

A data stream management system for accessing mass data and method thereof is disclosed. The system includes: a client computer and a number of distributed server groups. The client computer and the distributed server groups are connected via network. Each of the distributed server groups including: a determination unit, a dividing unit, a transmitting unit, a number of distributed servers and a dispatching server. The system divides a main data into a number of data sections and stores them in the distributed servers of different distributed server groups. The system can quickly integrate the distributed data sections back into the main data by uses of a global index.
Owner:KINGHOOD TECH

Method and system for managing data flow in a data transmission system

A data flow management system and method in which an application and its clients are made aware of the available credits for each type of transfer before the transfer is attempted. This enables the clients to transmit packets only when the RX side has issued a sufficient number of credits to insure that the transmission will not be stalled. The invention eliminates the need for FIFO buffers in the PCI-Express core, since the application will not transmit packets to the core until the required number of credits for the particular transfer type is available. Therefore, packet transmissions do not require buffering in the core, as they are only sent when they can be sent all the way through the core to the link. The efficient back-to-back transfer support enabled by this protocol increases the overall throughput and efficiency of the system as transfers through the application interface have fewer gaps therebetween, because the credit management protocol with its back-to-back feature reduces the idle times between packets traversing the application interface. An enhanced Quality of Service feature is also introduced by creating an environment where the low-latency packets can receive a highest attention and the lowest transmission wait time.
Owner:EMC IP HLDG CO LLC

Reliance oriented data stream management system

A computer-implemented method comprises receiving a plurality of data streams into a data stream management system, wherein each data stream is obtained from a data streaming source and a reliance level is associated with each of the data streaming sources. When a continuous query is registered that specifies a reliance level attribute, the query is executed over the plurality of data streams using only those data streams obtained from a data streaming source associated with a suitable reliance level. For example, the reliance level attribute may establish a minimum reliance level, such that data stream having a lesser reliance level are not used. CQL may be enhanced with such an extra attribute which allows end users to specify the desired reliance level when submitting a query.
Owner:LENOVO GLOBAL TECH INT LTD

Captcha (completely automated public test to tell computers and humans apart) data generation methods and related data management systems and computer program products thereof

CAPTCHA (Completely Automated Public Test to tell Computers and Humans Apart) data generation methods for use in an electronic device and related management systems are provided. First, the electronic device determines a first data set according to at least one first data corresponding to an operation to be performed, wherein the first data represents sensitive data corresponding to the operation. Then, the electronic device generates a group of CAPTCHA data corresponding to the first data set according to the first data. The electronic device may be a server or a client. When the electronic device is the client, the client obtains at least one generation module from the server to determine the first data set, and generate the CAPTCHA data. In some embodiments, during a data transmission procedure, the client performs the operation with the server using the CAPTCHA data.
Owner:F2WARE

Data transmission method and system using credits, a plurality of buffers and a plurality of credit buses

A data flow management system and method in which the application and its clients are made aware of the available credits for each type of transfer before the transfer is attempted. This enables the clients to transmit packets only when the RX side has issued a sufficient number of credits to insure that the transmission will not be stalled. The invention eliminates the need for FIFO buffers in the PCI-Express core, since the application will not transmit packets to the core until the required number of credits for the particular transfer type is available. Therefore, packet transmissions do not require buffering in the core, as they are only sent when they can be sent all the way through the core to the link. The efficient back-to-back transfer support enabled by this protocol increases the overall throughput and efficiency of the system as transfers through the application interface have fewer gaps therebetween, because the credit management protocol with its back-to-back feature reduces the idle times between packets traversing the application interface. An enhanced Quality of Service feature is also introduced by creating an environment where the low-latency packets can receive a highest attention and the lowest transmission wait time.
Owner:EMC IP HLDG CO LLC

Rate-adaptive data stream management system and method for controlling the same

Disclosed is a rate-adaptive data stream management system (DSMS) which is a precedence task, which has a descendent task, and a plurality of data channels and a plurality of feedback channels, the system including: a feedback analyzer which analyzes a control command transmitted from the descendent task; and a data channel selector which controls transmission of a data stream through the data channel with the descendent task based on the analysis result.
Owner:ELECTRONICS & TELECOMM RES INST

Data warehouse system

The invention provides a data warehouse system. A basic framework is constructed by relying on the storage and calculation capabilities of the big data platform; a scheduling management system, a bigdata platform batch processing framework module, a development operation and maintenance management system, a big data platform system, a big data batch processing task development tool, a data management system and other systems are developed. The capacity of the data warehouse is expanded, and the aspects of data architecture, data modeling, data management, the data warehouse, data development,operation and maintenance, task scheduling and the like are improved. According to the data warehouse, data storage can be carried out, and data exporting can be carried out on the obtained data based on the configuration information exported by the data, so that data exporting operation is supported. In addition, the data processing requirement can be received through the big data platform batchprocessing framework module, data needed by the data processing requirement are processed according to the data processing requirement, the data processing function is achieved, and the function of the database is expanded.
Owner:BANK OF NINGBO

Main-data system used for realizing enterprise internal-data standardization

The invention relates to the technical field of data management systems, and particularly to a main-data system used for realizing enterprise internal-data standardization. The main-data system comprises: a data reading / writing module, which is used for reading / writing data of all service systems; a main-data management module, which comprises a main-data storage sub-module and a main-data new-creating sub-module, wherein the main-data storage sub-module stores a main-data list, the main-data new-creating sub-module is used for adding new main data into the main-data list, and the main data include a data cleaning rule; and a data operation module, which is used for carrying out matching on the data in all the service systems through the data reading / writing module according to the data cleaning rule of the main data, and cleaning and replacing matching data according to the data cleaning rule. The main-data system used for realizing enterprise internal-data standardization provided bythe invention can solve the problem of main-data confusion existing in existing enterprise service systems.
Owner:重庆信联达软件有限公司

Rate-adaptive data stream management system and method for controlling the same

InactiveUS9954921B2Reduction in throughputEfficient data processing rateTransmissionRate adaptationControl data
Disclosed is a rate-adaptive data stream management system (DSMS) which is a precedence task, which has a descendent task, and a plurality of data channels and a plurality of feedback channels, the system including: a feedback analyzer which analyzes a control command transmitted from the descendent task; and a data channel selector which controls transmission of a data stream through the data channel with the descendent task based on the analysis result.
Owner:ELECTRONICS & TELECOMM RES INST

Method and portable device for managing memory in a data stream management system

Provided are method and device for managing a memory in a data stream management system (DSMS) of a portable device. The method includes moving data of a selected memory region that has a low priority to a secondary storage and storing a received data stream in the selected memory region.
Owner:SAMSUNG ELECTRONICS CO LTD

Method and apparatus for controlling load shedding in data stream management system

Provided are a method and apparatus for controlling load shedding for excluding data streams input into a data stream management system (DSMS). A method of selecting data not to be in the data process may be determined. A load shedding factor may also be determined. Data streams of the data process may be processed by applying the method of selecting the data according to the load shedding factor.
Owner:SAMSUNG ELECTRONICS CO LTD

Method and apparatus for controlling load shedding in data stream management system

Provided are a method and apparatus for controlling load shedding for excluding data streams input into a data stream management system (DSMS). A method of selecting data not to be in the data process may be determined. A load shedding factor may also be determined. Data streams of the data process may be processed by applying the method of selecting the data according to the load shedding factor.
Owner:SAMSUNG ELECTRONICS CO LTD

Apparatus and method for scheduling user defined operator (UDO) in data stream management system (DSMS)

An apparatus and a method of optimizing queries through scheduling User Defined Operators (UDOs) in a Data Stream Management System (DSMS), are provided. The apparatus includes a query optimizer configured to receive queries, each of the queries including the UDOs and data streams subject to respective operations of the UDOs, and group the data streams and UDOs into scheduling units, each of the scheduling units including one of the data streams and one of the UDOs. The apparatus further includes a scheduler configured to schedule an execution order in which the scheduling units are executed.
Owner:SAMSUNG ELECTRONICS CO LTD

Apparatus and method for scheduling user defined operator (UDO) in data stream management system (DSMS)

An apparatus and a method of optimizing queries through scheduling User Defined Operators (UDOs) in a Data Stream Management System (DSMS), are provided. The apparatus includes a query optimizer configured to receive queries, each of the queries including the UDOs and data streams subject to respective operations of the UDOs, and group the data streams and UDOs into scheduling units, each of the scheduling units including one of the data streams and one of the UDOs. The apparatus further includes a scheduler configured to schedule an execution order in which the scheduling units are executed.
Owner:SAMSUNG ELECTRONICS CO LTD

Reliance oriented data stream management system

A computer-implemented method comprises receiving a plurality of data streams into a data stream management system, wherein each data stream is obtained from a data streaming source and a reliance level is associated with each of the data streaming sources. When a continuous query is registered that specifies a reliance level attribute, the query is executed over the plurality of data streams using only those data streams obtained from a data streaming source associated with a suitable reliance level. For example, the reliance level attribute may establish a minimum reliance level, such that data stream having a lesser reliance level are not used. CQL may be enhanced with such an extra attribute which allows end users to specify the desired reliance level when submitting a query.
Owner:LENOVO GLOBAL TECH INT LTD

Archive management system based on block chain

The invention discloses an archive management system based on a block chain, and the system comprises a data flow management system which is used for the management of each archive forming process; a database which is used for storing an original data file of each node in the forming process of each file; a block chain which is used for storing an original data file of each node and a hash value and an electronic signature of each node in the forming process of each file, wherein each file in the block chain is subjected to security classification according to a security requirement; a comparison system which is used for regularly comparing the consistency of the block chain and the original data file on the database, and if not, giving an alarm and sending alarm information to the client; a sandbox system which comprises sandboxes with different security classifications, wherein the sandbox system is in data connection with the block chain, and the sandboxes with the different security classifications receive the archives with the corresponding security classifications; and a user which intervenes in the sandbox through the client to perform archive management, query and / or operation. The system can prevent files from being tampered, can avoid information leakage of confidential files, and can facilitate file information mining and application.
Owner:贵州梵瀚科技信息有限公司

Method and portable device for managing memory in a data stream management system using priority information

Provided are method and device for managing a memory in a data stream management system (DSMS) of a portable device. The method includes moving data of a selected memory region that has a low priority to a secondary storage and storing a received data stream in the selected memory region.
Owner:SAMSUNG ELECTRONICS CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products