Patents
Literature
Hiro is an intelligent assistant for R&D personnel, combined with Patent DNA, to facilitate innovative research.
Hiro

219 results about "Data grid" patented technology

A data grid is an architecture or set of services that gives individuals or groups of users the ability to access, modify and transfer extremely large amounts of geographically distributed data for research purposes. Data grids make this possible through a host of middleware applications and services that pull together data and resources from multiple administrative domains and then present it to users upon request. The data in a data grid can be located at a single site or multiple sites where each site can be its own administrative domain governed by a set of security restrictions as to who may access the data. Likewise, multiple replicas of the data may be distributed throughout the grid outside their original administrative domain and the security restrictions placed on the original data for who may access it must be equally applied to the replicas. Specifically developed data grid middleware is what handles the integration between users and the data they request by controlling access while making it available as efficiently as possible. The adjacent diagram depicts a high level view of a data grid.

System and method for distributed query processing using configuration-independent query plans

A system and method for distributed query processing may compile and optimize query plans for incoming query requests independent of hardware configurations and / or physical locations of data partitions in a distributed storage system (e.g., a data grid). The query plan may be divided into segments, and each segment may be instantiated on a remote query processing node of the distributed system by a query coordinator node according to metadata accessed at runtime by remote sub-query operators in the query plan. The metadata may include an indication of the physical locations of data partitions in the system and may be stored on one or more of the query processing nodes. The remote query processing nodes may execute the query plan segments and return results to the requestor. Cached query plans may be re-executed without recompilation, according to current metadata, even in the event of a node failure or data partition move.
Owner:AMAZON TECH INC

System and method for time sensitive scheduling data grid flow management

Controlling the flow of content and receipt of time sensitive scheduling data via a time sensitive scheduling data delivery network is described. This may involve accommodating the management of the display of potentially voluminous time sensitive scheduling data. This may also involve making all of the relevant time sensitive scheduling data information available from high capacity remote data stores accessible to all of a user's time sensitive scheduling data receiving devices via a time sensitive scheduling data network, and on demand by time sensitive scheduling data display zone category to the user's time sensitive scheduling data receiving devices. The user may dynamically manage which display zone classes and subclasses of time sensitive scheduling data appear, what time frame appears and how much time sensitive scheduling data appears on the user's time sensitive scheduling data receiving device display screens.
Owner:KEEP IN TOUCH SYST

Data mapping

The present invention provides for data to be bilaterally transferred between general applications such as databases and task specific applications. The transfer maps and transports data between applications. The first application includes a data structure with a data structure identifier and a table. The second application includes a data grid. The mapping of data is performed by: associating a column in the grid to a table data field; associating a mapping icon with the column; and associating the table identifier with the column. The transporting of data between the applications include: identifying a transport function; identifying at least one of the mapping; and transporting data according to the selected mapping and the selected transport function.
Owner:FORMAN ERNEST +2

Distribution type file system multi-file copy management method

The invention relates to a management method of a multifile copy of a distributed file system. A copy management mechanism based on a frequency is adopted, the state of a file copy is changed according to the read-write access frequency of the file and the information trend of an access resource, and the position transference is increased / reduced and stored through the trend of the quantity of the file copy. The management method includes copy grading management, copy creating policy, copy selection and orientation, and a copy consistency maintenance method. The creating method of the file copy includes the creating initiated by the user and the creating initiated by a crunodes, and adopts a data gridding method and a policy based on the benefit drive. The orientation of the copy maps a logic file on an appropriate copy, and a copy with minimum cost and highest access efficiency is selected to be provided to the user for using. The invention has the advantages that the provided service carries on the excellent characteristics of the distributed file system, which includes loose coupling, high usability, high reliability and high cost performance.
Owner:ZHEJIANG UNIV

Method, system, and computer code for finding spots defined in biological microarrays

A method (and system) for using information contained within the scanned image to create, in an automated (or semi-automated) process, an accurate data grid. The process has steps: enhance the image; locate blocks of spots; and find each individual spot in each of the blocks. Preferably, the method makes use of image filtering using a“Principal Frequency Filter” based on a mathematical determination of major periodic elements in the image to eliminate noisy, non-periodic signals, and of smoothed intensity profiles of the filtered image data. Here, the term Principal Frequency Filter is used to indicate an image-enhancing filter based upon a mathematical operation which identifies the major periodic components of the image.
Owner:NILES SCI

Design and storage method for resource and its access control policy in high-performance access control system

The present invention relates to a method of managing distributed file system with multi-duplicates, adopting a frequency-based duplicate management mechanism. According to information trends of the frequency of the files which are read, written, and visited as well as the source of visit, the status of the file duplicates is changed. Through the dynamic increase and decrease of the number of duplicates and the change of storage position, specifically including duplicate granularity management, duplicate creation strategy, duplicate selection and position, and duplicate consistency management. The method of creating duplicates of files comprises creation initiated by a user and creation initiated by nodes, adopting data grid and strategy based on motivation of profits. The duplicate position supply maps a logical file onto a proper duplicate and provides the user with a duplicate at the minimum cost and of the maximum visit efficiency. The present invention has the advantages that: services provided continue the favorable attributes of a distributed file system, including loose coupling, high availability, high reliability and high cost-effectiveness.
Owner:ZHEJIANG UNIV

Proximity grids for an in-memory data grid

Techniques are described for scaling an in-memory data grid to satisfy the needs of client applications requesting data from the in-memory data grid. The in-memory data grid may monitor a variety of factors, such as data traffic or number of received queries from a particular geographical region, to determine whether to create a proximity grid. A proximity grid is an extension of the in-memory data grid that services queries originating from a defined geographic region. Each proximity grid stores data objects relevant to the proximity grid's assigned geographic region. Queries originating from the client applications within the geographic regions are then routed to the corresponding proximity grid for execution. The proximity grid may be terminated when the need of the client applications within the geographic region has subsided.
Owner:IBM CORP

Data Grid Advisor

A system and method to generate an improved layout of a data grid in a database environment is provided. The data grid is a clustered in-memory database cache comprising one or more data fabrics, where each data fabric includes multiple in-memory database cache nodes. A data grid advisor capability can be used by application developers and database administrators to evaluate and design the data grid layout so as to optimize performance based on resource constraints and the needs of particular database applications.
Owner:SYBASE INC

Distributed space data enquiring and optimizing method under gridding calculation environment

A distributed spatial data query optimization method in a grid computing environment is applicable to the grid computing environment and comprises the following steps: (1) analyzing user queries to form a spatial join operation diagram of two or more spatial data grid services; (2) generating an estimation cost matrix of a spatial join operation which possibly exist among the spatial data grid services according to the spatial join operation diagram; (3) adopting a progressive query optimization method to update the estimation cost matrix orderly, and selecting a more preferable spatial join operation according to a formation rule of a spatial join operation balance tree and the estimation cost matrix; and (4) for the better spatial join operation selected in the step (3), generating a better spatial join operation execution proposal according to an executable parallel strategy of a spatial join computing grid resource situation and spatial subdivision. The method can adapt to the characteristics of dynamic change of the grid computing environment and rich computing resources, and can generate a better query execution proposal based on the characteristics, thus improving the efficiency of executing the distributed spatial data query in the grid environment.
Owner:INST OF GEOGRAPHICAL SCI & NATURAL RESOURCE RES CAS

Taxi cruising action analytical method based on global position system (GPS) data grid statistic

InactiveCN103218672ASolve space problemsSolve the problem that most grid points are recorded as 0ForecastingBackground informationData grid
The invention discloses a taxi cruising action analytical method based on global position system (GPS) data grid statistic in the field of traffic action research. Spatial distribution characteristics of cruising points are analyzed based on taxi traveling track GPS data identification cruising points to generate passenger carrying points and background information points representing factors such as land, population and road networks of the previous day, grid analysis technique is adopted to convert spatial point data into point frequency data based on grids, a zero-inflated negative binomial model (ZINB) is constructed to analyze historical passenger carrying point information, background information and influences of spatial autocorrelation of the cruising points on taxi cruising point choice action, and cruising strategies of a taxi are summarized. The taxi cruising action analytical method brings convenience to further taxi traffic behavior simulation and provides an effective way for optimizing taxi cruising action and solving problems of road resource waste, fuel consumption and environmental pollution caused by cruising.
Owner:JILIN UNIV

Write/read document operation method applied in multi-copy data grid system

The invention discloses a method used for the document reading / writing operation of multi-copy data grid system, which belongs to the operational field of high speed document writing. The invention is characterized in that the following steps are sequentially included: the user puts forward a writing document request to the copy access client terminal; after the identity is successfully authenticated by a metadata server, a server distance comparison module selects a copy storage server that is nearest to the user in logic distance, and selects the corresponding copy view information, and after confirmed by a view analytical module of the copy access client side as effectiveness, a reading and writing execution module of the copy access client sends data writing request to the copy storage server; after the copy storage server successfully executes writing operation, a copy view updating module of the metadata updates the copy view. The invention leads the user to select the nearest copy storage server to execute writing operation, meanwhile, the normal reading operation of the user is guaranteed.
Owner:TSINGHUA UNIV

Optimized transcript distributing method in data grid

The invention relates to an optimized transcript distributing method in a data grid, belonging to the field of grid computation, and concretely relates to a grid system, in particular to a transcript distributing method in the data grid system. The invention provides a distributed dynamic self-adaptive transcript distributing method in the data grid, aiming at reducing the access cost of the resource request party, and comprising the following steps of: calculating the transcript amount through the response time of resources; and determining proper transcript place via comprehensive consideration of factors of load factor, node performance, real-time bandwidth, and the like so that the transcript distribution can be dynamically suitable for variation of access request and the network communication state. Compared with the existing method for simply requiring transcript amount to improve the data access performance, the invention evaluates the transcript amount and the optimum transcript place from the overall situation of the system, thereby effectively balancing the relationship between the transcript amount and the transcript maintenance cost. The method is not only suitable for data grid systems of read-only resources and particularly suitable for data grid systems with read-write data resources.
Owner:BEIJING INSTITUTE OF TECHNOLOGYGY

Method and system for dynamic data modeling for use in real-time computerized presentations

A system and related method for dynamic data modeling for use in a real-time computerized presentation system includes a presentation engine having a visual interface. Computerized numerical models are each importable into the presentation engine. Each includes a data grid having data cells arranged by columns and rows, where numerical data values are stored within the data cells. At least one data input field controls a manipulation of a first numerical data value in a first data cell using a mathematical function applied to a second numerical data value in a second data cell. A numerical model display, displayable on the visual interface, is based on the first numerical data value and is changed in real-time based on the manipulation of the first numerical data value. A numerical model summary, displayable on the visual interface, combines numerical data from the computerized models imported into the presentation engine.
Owner:WELCH GLOBAL CONSULTING

Autonomic data partition placement in an in-memory data grid

A method for autonomic data partition placement in an in-memory data grid (IMDG) based on usage sampling is provided. The method may include sampling access pattern data, during a configurable window, of a client accessing one or more data objects in the IMDG. Analytics are applied to the sampled access pattern data to determine a replacement partition schema, based on the analyzed sampled access pattern data exceeding at least one performance threshold. The deployed partition schema is altered, based on the replacement partition schema.
Owner:IBM CORP

Push replication for use with a distributed data grid

Push replication techniques are described for use in an in-memory data grid. When applications on a cluster perform insert, update or delete operations in the cache, a push replication provider asynchronously pushes updates from the source cluster to one or more remote destination clusters. The push replication provider includes a pluggable internal transport to send the updates to the destination cluster. This pluggable transport can be switched to employ a different communication service or protocol. A publishing transformer can chain multiple filters and apply filters on a stream of updates from source cluster to the destination cluster. A batch publisher can be used to receive batches multiple updates and replicate those batch to the destination cluster. XML based configuration can be provided to configure the push replication techniques on a cluster. A number of cluster topologies can be utilized, including active / passive, active / active, multi-site active / passive, multi-site active / active and centralized replication arrangement.
Owner:ORACLE INT CORP

Method and system for safely transporting legacy data to an object semantic form data grid

A computer system architecture and process transforms the organizing principles of business data management seen in traditional or common place settings across disparate data stores into an object-semantic model. The transformation is implemented in a transitory, managed risk implementation approach for data access migration. This approach will enable data agility and will move data storage closer to information storage, while supporting the rapid development of business capabilities. This approach will bridge the gaps between relational database / file based storage (less expressive) and object-semantic representation (more expressive). This process / method will connect information residing in legacy data structures such as relational database / file based storage on disk drives to instances populating an expressive object-semantic model in persistent grid based memory. It will also maintain a linkage between the original legacy data to the enhanced object-semantic data allowing for ongoing modernization and removing the need for point migrations.
Owner:EXPRESS SCRIPTS STRATEGIC DEV INC

Failure recovery system and method of real-time streaming data processing based on memory data grid

ActiveCN105871603ALower latencyEnsuring Semantic GuaranteesData switching networksThird partyStream data
This invention relates to a failure recovery system and method of real-time streaming data processing based on a memory data grid. The system comprises a scheduler, a status server, a task queue and a task operation center. Since records and status information are separately stored, the status information stored in a snapshot is reduced; the delay of data processing is reduced, and simultaneously the snapshot mechanism is easier; the snapshot persistence of micro-batch is achieved by a data window; and the semantic guarantee of "just one time" is ensured through a storage structure of double-buffer; the network delay is reduced to some extent without using a third-party cluster to manage the data.
Owner:INST OF SOFTWARE - CHINESE ACAD OF SCI

Execution of dataflow jobs

A method, system and computer program product for storing data in memory. An example system includes at least one multistage application configured to generate intermediate data in a generating stage of the application and consume the intermediate data in a subsequent consuming stage of the application. A runtime profiler is configured to monitor the application's execution and dynamically allocate memory to the application from an in-memory data grid.
Owner:IBM CORP

Multi-source data grid fault identification method

The invention provides a multi-source data grid fault identification method, and relates to the field of dispatching automation of electric power systems. When an electric system is dispatched, the advantage that diagnosis is conducted by only depending on protecting action information is not beneficial for the judgment and immediate processing of an accident. The multi-source data grid fault identification method includes the following steps of setting up a parameter, collecting grid operation information in real time, sorting out grid fault reports when receiving action information of a relay protection device, organizing action reports according to a protection device when a real fault signal is detected, taking the time scale of the earliest received protection action as the zero-time of the action report, if other protection action signals belong to the same device and the time gap between the action time and the zero-time is less than a threshold value, arranging the protection action signals to be in the same action report, if received scattered wave records belong to the same device and the time gap is less than the threshold value, arranging the received scattered wave records to be in the same report. According to the technical scheme, after a fault occurs in the electrical system, the real grid fault can be quickly and accurately identified, and a clear grid fault report can be organized.
Owner:STATE GRID CORP OF CHINA +3

Query explain plan in a distributed data management system

A query explain plan is described for use with a distributed data system in order to help developers and IT experts to detect bottlenecks and to determine which queries are to blame for a slow running system. In accordance with an embodiment, the distributed data grid utilizes a facility to provide a distributed explain plan. This distributed explain plan provides visibility into how a query was answered by each node in the cluster. For example, one node may have applied the filters of the query in one sequence, while another node may have used a different sequence. Additionally, the distributed query explain plan can provide execution tracing, rendering information about the execution time of each step, total execution time and the like.
Owner:ORACLE INT CORP

Method and system for safely transporting legacy data to an object semantic form data grid

A computer system architecture and process transforms the organizing principles of business data management seen in traditional or common place settings across disparate data stores into an object-semantic model. The transformation is implemented in a transitory, managed risk implementation approach for data access migration. This approach will enable data agility and will move data storage closer to information storage, while supporting the rapid development of business capabilities. This approach will bridge the gaps between relational database / file based storage (less expressive) and object-semantic representation (more expressive). This process / method will connect information residing in legacy data structures such as relational database / file based storage on disk drives to instances populating an expressive object-semantic model in persistent grid based memory. It will also maintain a linkage between the original legacy data to the enhanced object-semantic data allowing for ongoing modernization and removing the need for point migrations.
Owner:EXPRESS SCRIPTS STRATEGIC DEV INC

Intelligent grid prediction correcting method and system

The invention discloses an intelligent grid prediction correcting method and system. The intelligent grid prediction correcting method includes the steps that meteorological data is imported; a map layer is loaded and displayed in a display area; a display time point is selected, and the meteorological data corresponding to the display time point is distributed into a grid shape to form a data grid layer; the data grid layer overlays the display area and is aligned with the map layer; according to the loaded meteorological data, isolines are generated and combined into an isoline layer; the isoline layer overlays the display area and is aligned with the map layer; a space correction point in the display area is clicked to form a correcting instruction, and according to the correcting instruction, the space correction point and the corresponding meteorological data in a peripheral extensive correction range are increased or decreased on the basis of a preset weight corresponding to space distribution; the corrected meteorological data is exported. The method and system have the advantages that correction of the meteorological data is more convenient and faster, correction of meteorology is more precise, and operation is smooth.
Owner:杭州幂拓科技有限公司

Eager block fetching for web-based data grids

Techniques for improving scrolling performance in a web-based data grid. In one set of embodiments, when a user scrolls through a data grid rendered in a viewport of the user's web browser, client-side code executing in the web browser can detect whether a scroll event has occurred that requires a portion of the viewport to be filled / refreshed with data from a server. The client-side code can further determine whether the scroll event is a short scroll or a long scroll, and can send a request to the server that indicates the type of scroll event. If the scroll event is a short scroll, the server can determine a first amount of data to fetch based on one or more first parameters. If the scroll event is a long scroll, the server can determine a second amount of data to fetch based on one or more second parameters.
Owner:ORACLE INT CORP

Mechanism to Enable and Ensure Failover Integrity and High Availability of Batch Processing

A method, system and computer program product for managing a batch processing job is presented. The method includes partitioning a batch processing job for execution by a cluster of computers. One of the computers from the cluster of computers is designated as a primary command server that oversees and coordinates execution of the batch processing job. Stored in an object data grid structure in the primary command server is an alarm setpoint, boundaries, waiting batch processes and executing batch process states. The object data grid structure is replicated and stored as a replicated object grid structure in a failover command server. If the primary command server fails, the failover command server freezes all of the currently executing batch processes, interrogates processing states of the cluster of computers, and restarts execution of the batch processes in the cluster of computers in accordance with the processing states of the cluster of computers.
Owner:IBM CORP

Non-disruptive data movement and node rebalancing in extreme OLTP environments

Systems and methods for non-disruptive cache startup, shutdown, data partition movement, and node rebalancing for a data fabric within a data grid in a database environment. The data grid is a clustered in-memory database (IMDB) cache comprising one or more data fabrics including multiple IMDB cache nodes. The method takes a time tag and moves data from source to destination nodes while allowing updates to data on the source nodes. The method propagates updates occurring after the time tag to destination nodes from source nodes and switches applications and ownership to the destination nodes. Another method slices data for a partitioned fabric and stores slices on nodes. Another method starts a data fabric by moving data from a grid backend to the nodes. In an embodiment, another method rebalances nodes in a non-disruptive manner. When a fabric is shutdown, the method saves data from the nodes to the grid backend.
Owner:SYBASE INC

Method for three-dimensional display of two-dimensional earthquake profile

ActiveCN105096385AAvoid the inadequacy of not being able to display more seismic data at the same timeImprove earthquake display capabilities3D-image rendering3D modellingDisplay contrastComputer graphics (images)
A method for three-dimensional display of a two-dimensional earthquake profile is disclosed. The method includes reading earthquake profile data from a disc and converting the earthquake profile data into a coding format used by the system. The method further includes vertex input layout establishment including earthquake data vertex input layout establishment and rendering and texture vertex input layout establishment, palette texture establishing and sampling, inclined texture establishing, i.e. rendering object while rendering texture, establishing earthquake data texture for storing earthquake data, creating effect files including creating a rendering to texture effect file and a rendering output effect file, rendering to texture, rendering numeralized earthquake sampling points to texture in an inclined way and creating a grid, and creating, rendering and outputting the earthquake data grid. Earthquake data are sent to a GPU through a floating point texture means, and accurate coloring of earthquake data vertexes and accurate pixel interpolation between vertexes are realized. A pallet is created in an index progressive way, the display contrast of an earthquake profile is improved, and three-dimensional display of a two-dimensional earthquake profile is realized.
Owner:BEIJING UNIV OF TECH

Full distributed duplicate copy positioning method for data grid

The invention discloses a full distributed copy positioning method used for a data network, wherein, judgment is made at first whether a user command is copy establishment, copy search or copy deletion, and then corresponding operations are respectively performed according to the following steps; judgment is made whether to end after the operations are finished; if continuous operation is required, the user command is accepted after return; if continuous operation is not required, the whole flow is ended; if the user command is copy establishment, physical mapping is registered through a copy catalog manager which is then registered into a local copy manager index; if the user command is copy search, a copy positioning request of a user is received and a mapping table is inquired, and then a physical address set corresponding to a logical file name is returned; if the user command is copy deletion, copy cancel on a routing list is finished through search of the local copy catalog manager index and the copy catalog manager corresponding to a copy. Compared with the prior copy positioning method, the method is characterized in adaptability, support of a copy positioning request of a multiple application domain data network, expansibility, high availability, high security and so on.
Owner:HUAZHONG UNIV OF SCI & TECH

Mobile terminal location data caching and real-time updating system and method

The invention discloses a mobile terminal location data caching and real-time updating system and a mobile terminal location data caching and real-time updating method. A server real-time location service saves and manages the latest location data of all mobile terminals by taking a grid container as a unit; a client caches terminal location data obtained from a background server also by taking the grid container as the unit, and attaches the latest updating timestamps to each grid container respectively; and the client transmits a request to a location server to acquire terminal location updating data in each grid in a currently displayed boundary to realize the incremental updating of the terminal location data cached by the client by taking the grid as the unit. By the terminal-location-data-grid-based management and incremental updating technology, the real-time updating of mobile terminal locations in the display range of a map is ensured, data traffic between the client and the location server is effectively reduced, and the needs of a plurality of client users in the simultaneous online browsing of a plurality of mobile terminals are satisfied.
Owner:亿海蓝(北京)数据技术股份公司

Refrigerator van temperature field actually-measured data visualization processing method and system

InactiveCN103793581ARealize data visualizationNo loss of three-dimensional propertiesSpecial data processing applicationsCool storageEngineering
The invention discloses a refrigerator van temperature field actually-measured data visualization processing method and system. The method comprises the steps of firstly, collecting temperature parameters of each layer of layout of various kinds of cargo packaging in different multi-layer stacking modes, obtaining a temperature contour line graphic set of each layer of cargos according to the obtained temperature parameters, and finally, determining the stacking scheme of the next cargo packaging according to the temperature contour line graphic set of each layer of cargos. According to the refrigerator van temperature field actually-measured data visualization processing method and system, the map counter line method is utilized for drawing counter lines, the situation of temperature field changes caused by different stacking modes can be seen clearly, and the data visualization can be achieved; the cargos are stacked in a layering mode no matter what method is adopted, the three-dimensional problem is converted into a two-dimensional problem, and the three-dimensional characteristics are not lost. Due to the fact that the discrete data meshing and the interpolation algorithm are adopted, the estimated temperature value of a non-sampling area can be obtained and basically conform to the practical situation. Actually-measured data are stored by the adoption of the layering thought, the logic stored in a database is more clear, and historical data are conveniently filed, retrieved and used.
Owner:中商商业发展规划院有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products