Memory computing service framework and implementation system

A service framework and in-memory computing technology, applied in computing, database management systems, program control design, etc., can solve problems such as inability to complete read-write separation of data, interface definitions, and call method storage models that cannot form a unified specification, so as to improve throughput Ability, effect of guaranteed speed

Pending Publication Date: 2021-10-08
JIANGSU SECURITIES
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0012] In order to overcome the above-mentioned deficiencies in the prior art, the present invention provides an in-memory computing service framework, which not only solves the problem that interface definitions, calling methods, and storage models cannot form a unified standard, but also solves the problem that data in various business systems cannot be separated from reading and writing. The problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Memory computing service framework and implementation system
  • Memory computing service framework and implementation system
  • Memory computing service framework and implementation system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] see figure 1 , this embodiment provides an in-memory computing service framework, the service framework uses Nats as a message bus for inter-service communication; the service triggers business logic processing by subscribing to a specified topic, and publishes the service in the form of a message after the processing is completed The memory state of the framework is sent to the specified topic for consumption by other services; the service framework uses Hazelcast to cache the service state.

[0045] In this embodiment, general data storage and query services are set based on Hazelcast and databases; an application service developed based on the service framework specifies the data that needs to be persisted through annotations when the data model is defined, and the fields for establishing query indexes. The storage and query services provided by the memory computing service framework automatically persist data and provide queries.

[0046] In this embodiment, the Ca...

Embodiment 2

[0056] see figure 2 , in the in-memory computing service framework provided in this embodiment, the service uses topics to communicate in the pub-sub mode based on Nats, and each topic contains the following attributes: name, type, encoding method of transmitted information on the topic, topic creator or all When a data producer publishes a message to a specified topic, the memory computing service framework SDK will extract the corresponding field value in the message according to the template attribute of the topic to form a subject, and Nats will route the message according to the subject and subscription conditions.

[0057] In this embodiment, all services use topics to communicate in a pub-sub mode based on Nats, and topic management is a core management capability of the service framework. Topic is one of the core concepts in the Nats framework. Each topic contains the following attributes: name (name), type (type), encoding (the encoding method of the message transmit...

Embodiment 3

[0062] see image 3 , the memory computing service framework provided in this embodiment includes a management center node Monitor, which manages the status of all services in the framework, and initialization operations such as service registration and login. Service startup (INIT state) needs to go through a) login, b) registration, c) synchronization parameters, d) check dependencies, etc., and finally start successfully (ACTIVE state). Such as image 3 , the service itself and the Monitor maintain their own status through heartbeats. If the Monitor does not receive the service heartbeat for a long time, it will judge that the service status is INACTIVE. After the service in the ACTIVE state stops, it finally enters the SHUTDOWN state; after the service in the INACTIVE state exits, it finally enters the SHUTDOWN state. Monitor will broadcast the status changes of any service, and other services can subscribe to these changes and make corresponding decisions. If the status...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a memory computing service framework and an implementation system. The service framework takes Nats as a message bus for communication between services; the service triggers business logic processing by subscribing a specified topic, and after the processing is completed, the memory state of the service framework is published to the specified topic in a message form; the service framework uses Hazelcast to cache a service state, and provides a unified persistence and query service to perform memory state persistence and query; query and subscription conditions are uniformly expressed by using SQL, and a Q & S subscription mode is creatively introduced to ensure that messages are not lost or duplicated in consumption. Through a predefined storage model and a unified storage query service, data storage and query are decoupled from business logic, read-write separation is realized, the problems of usability and reliability of data interaction are solved by introducing SQL, Q & S and other technologies, and the memory computing service framework is mainly applied to scenes such as transaction, risk control, shipping space, real-time monitoring, real-time index calculation and the like. The memory computing service framework can be popularized as a memory computing service standard framework.

Description

technical field [0001] The invention belongs to the field of memory computing, and relates to a memory computing service framework and an implementation system. Background technique [0002] Against the background of the tide of digitalization, with the growth of data production speed and data volume, as well as the improvement of real-time data processing requirements, the traditional data processing mode of "first landing, then processing" can no longer be accepted. Data must be generated with extreme Perform analysis and processing in a short period of time, and then output the results as the input of other systems. The database is no longer at the center of real-time data processing, but retreats behind the scenes as a carrier for analysis and operation after the data lands. However, for systems that require real-time performance, it is difficult to see the shadow of the database on the critical path, and most of them are based on the architecture of memory computing, bu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F16/2455G06F16/22G06F9/54G06F9/50
CPCG06F16/2228G06F16/24552G06F16/25G06F9/5083G06F9/546G06F2209/547
Inventor 罗文辉张俊何涛梁祖韬马志伟张龙陈珍珍陈星
Owner JIANGSU SECURITIES
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products