Multi-modal deep learning model vulnerability analysis method and system

A technology of deep learning and analysis method, which is applied in the field of confrontation attack and model robustness analysis, to achieve the effects of efficient attack, improved performance, and good attack effect

Pending Publication Date: 2022-07-08
尚蝉(浙江)科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Aiming at the vacancy of multimodal deep learning model adversarial sample generation and robustness analysis methods in the existing research, the present invention proposes an analysis method and system for the vulnerability of multimodal machine learning models

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-modal deep learning model vulnerability analysis method and system
  • Multi-modal deep learning model vulnerability analysis method and system
  • Multi-modal deep learning model vulnerability analysis method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045]The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be pointed out that the following embodiments are intended to facilitate the understanding of the present invention, but do not have any limiting effect on it.

[0046] In an embodiment provided by the present invention, such as figure 1 Shown is the architecture diagram of the multi-modal model vulnerability analysis system of the present invention, which mainly includes six modules: multi-modal data set preprocessing module, single-modal local model module, visual confrontation sample generation module, audio confrontation sample generation module module, text adversarial sample generation module and target model vulnerability detection module. The following six modules are introduced separately:

[0047] 1. Multimodal dataset preprocessing module

[0048] The main purpose of this module is to extract features from the dataset for loc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a multi-modal deep learning model vulnerability analysis method and system, and belongs to the field of countermeasure attack and model robustness analysis. According to the method, robustness of a target model is tested by generating a series of white-box adversarial samples. The method mainly comprises the following steps: firstly, obtaining a target multi-modal deep learning model and a training data set used by the target multi-modal deep learning model; respectively extracting a visual modal feature, a text modal feature and an audio modal feature in the data set; respectively training single-mode local models by using the extracted data set features; testing the training effect of the single-mode local model to obtain adversarial sample generation weights of different modes; the visual mode and the audio mode generate disturbance by using a gradient descent method based on PGD, and the natural language text mode generates disturbance by using a synonym replacement method of gradient approximation optimization; and obtaining a vulnerability analysis result of the target model through the attack success rate of a series of generated multi-modal adversarial sample inspection models.

Description

technical field [0001] The invention relates to the field of adversarial attack and model robustness analysis, in particular to a method and system for analyzing the vulnerability of a multimodal deep learning model. Background technique [0002] With the continuous development of deep learning-related technologies and the increasing number of application scenarios in academia and industry in recent years, the demand for simultaneous analysis of multiple modal data has emerged, which has promoted the development of multi-modal machine learning. Multimodal machine learning is mainly used to find the correlation between multiple modalities and use the information of multiple modalities to make decisions at the same time. The most common ones are natural language modalities, sound signal modalities, and visual signal modalities. In the past ten years, multimodal machine learning has fully entered the era of deep learning, and has been widely used in tasks and scenarios such as ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F40/289G06F16/35G06N20/00
CPCG06F40/289G06F16/35G06N20/00
Inventor 纪守领李泽宇张旭鸿陈建海
Owner 尚蝉(浙江)科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap