Method and device for evaluating model interpretation tool

A technique for evaluating models and models, applied in the field of machine learning, can solve problems such as lack of multiple model interpretation tools

Pending Publication Date: 2020-06-23
ALIPAY (HANGZHOU) INFORMATION TECH CO LTD
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there is still no method that can be applied to multiple model interpretation tools at the same time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for evaluating model interpretation tool
  • Method and device for evaluating model interpretation tool
  • Method and device for evaluating model interpretation tool

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] Embodiments of this specification will be described below with reference to the accompanying drawings.

[0035] figure 1 A schematic diagram of a system 100 for evaluating model interpretation tools according to an embodiment of the present specification is shown. Such as figure 1 As shown in , the system 100 includes a supervised learning model 11 , a model interpretation tool 12 and a computing unit 13 . The supervised learning model 11 can be any self-explanatory model, such as a linear regression model, a logistic regression model, a support vector machine model, a tree model, a Bayesian model, a KNN model, and the like. The supervised learning model 11 can be trained through multiple training samples related to a specific business, so as to become a business processing model, such as a risk control model. For example, the specific service is to classify users on the network platform, such as classifying users into low-risk users and high-risk users, high-spendin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a method and device for evaluating a model interpretation tool, and the method comprises the steps: training a first model through employing a plurality of training samples, so as to obtain the first model with a first parameter group, and the first model is a self-interpretation model; based on the self-interpretation of the first model with the first parameter group, obtaining a first importance sequence of the plurality of features; based on the plurality of training samples and the first parameter group, obtaining a second importance sequence of theplurality of features through a model interpretation tool; and determining the similarity between the second importance sequence and the first importance sequence so as to evaluate the model interpretation tool.

Description

technical field [0001] The embodiments of this specification relate to the technical field of machine learning, and more specifically, to a method and device for evaluating model interpretation tools. Background technique [0002] Machine learning is currently being used in various fields such as retail, technology, healthcare, science, and many more. A machine learning model essentially fits a complex function to the relationship between the data and the target. The machine learning model is very different from some simple rules. The rules clarify the relationship between data and targets, but the machine learning model is a black box with only input and output, and does not understand the internal mechanism. In some fields, especially in finance, such as insurance, banking, etc., data scientists often end up having to use more traditional and simpler machine learning models (linear models or decision tree models). However, although this type of simple model can provide a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/08G06N7/00G06N20/10
CPCG06N3/08G06N20/10G06N7/01
Inventor 方军鹏唐才智
Owner ALIPAY (HANGZHOU) INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products