Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Rule analysis method and system based on YAML file

An analysis method and rule technology, applied in the rule analysis method and system field based on YAML files, can solve problems such as complex system modification, difficulty in customizing development and implementation, high cost of script language learning, and achieve fast learning, improved program flexibility, Easy to write effects

Pending Publication Date: 2020-05-08
USTC SINOVATE SOFTWARE
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The technical problem to be solved by the present invention is: how to solve the problems in the prior art such as complex system modification, difficulty in customizing development and implementation, and high cost of scripting language learning, and provides a rule analysis method based on YAML files

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Rule analysis method and system based on YAML file
  • Rule analysis method and system based on YAML file
  • Rule analysis method and system based on YAML file

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0043] Such as Figure 1~4 As shown, the present embodiment provides a technical solution: a rule analysis method based on a YAML file, comprising the following steps:

[0044] S1: Configure data source

[0045] Configure the data source, the data source includes the data source item (input item) and the data target source item (output item);

[0046] S2: Configure the data collection job

[0047] Configure the data collection job, that is, configure the flow direction of the data;

[0048] S3: Configure YAML file rules

[0049] Configure the rule of YAML file and preserve, and the content of configuration comprises the rule content of configuration processing logic item (filters item) and perfects whole rule information according to the information in the job configuration of step S2;

[0050] S4: Analyzing rules to collect data

[0051] After saving the configuration, analyze and obtain the collection process information according to the completed rules, and match the c...

Embodiment 2

[0074] In order to flexibly match the corresponding program flow for data collection and processing according to the configuration data, so that the system can be flexibly applied in multiple scenarios, this embodiment provides the following technical solutions:

[0075] 1. A rule file based on the following YAML format:

[0076]

[0077]

[0078] 2. Rule description

[0079] Input is used to represent the configuration information of the data source, and describes the connection login information and data source information of the data source library. After the program is parsed, connect to the data source and read the data according to the input information. Input supports multiple data sources, such as JDBC, Hbase, ftp, hdfs, kafka and other data sources. The above YAML file example only shows JDBC, which can be modified to other data source information according to the actual needs of the scenario;

[0080] Filters are used to process the data after the program re...

Embodiment 3

[0092] This embodiment provides a rule parsing method based on a YAML file, and the specific implementation steps are as follows:

[0093] 1. Configure the data source

[0094] The configured data source includes data source and data target source, and supports multiple data types;

[0095] 2. Configure the data collection job

[0096] Configure data collection operations, that is, configure the flow direction of data from where to where;

[0097] 3. Configure YAML rules

[0098] Configure the collection rules. The configured rules are mainly the content of the rules for configuring the filters. The input and output without special requirements keywords do not need to be listed in the page configuration. The program will automatically complete the entire rule information based on the information in the previous job configuration, for example exist Figure 4 In , there is no content after the input keyword, and the dateType keyword value is CSV after the ouput keyword, that...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a rule analysis method and system based on a YAML file, and belongs to the technical field of rule analysis, and the method comprises the steps: S1, configuring a data source;S2, configuring data acquisition operation; S3, configuring a YAML file rule; and S4, analyzing rule acquisition data. According to the method, program deployment only needs to be carried out once according to rule configuration of the YAML file, a user can meet different data acquisition requirements only by modifying configuration, and repeated deployment and repeated modification are not needed; according to the method, a new processing logic can be added in a program, other programs do not need to be modified, and a user only needs to configure newly-added logic keywords and correspondinginformation during configuration, so that customization requirements can be met, and the flexibility of the program is greatly improved; compared with a scripting language, the YAML language learningspeed is high, and the method has the advantages of being easy to compile, convenient to configure and convenient to read.

Description

technical field [0001] The invention relates to the technical field of rule analysis, in particular to a rule analysis method and system based on a YAML file. Background technique [0002] When it is necessary to judge and select the next execution process based on the configuration value, the existing technology uses different methods in different scenarios, that is, hard coding. At present, some systems also have a method of using rule analysis, but most of them are implemented using scripting languages ​​such as groovy and JavaScript. [0003] In the data acquisition system, it is necessary to collect and process data according to different configured data sources and write them into the configured target data source according to different requirements. Without the design of editable rules, the system is difficult to maintain, and can only be applied in a fixed and special scenario, and it is difficult to change and expand when there are new needs. [0004] There are ce...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/445G06F16/25
CPCG06F9/4451G06F16/25
Inventor 裴孝贞倪亮王慧王震冯强中
Owner USTC SINOVATE SOFTWARE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com