Virtual character driving method, device and equipment based on expression recognition

A virtual character and expression technology, applied in the field of virtual character drive based on expression recognition, can solve problems such as unsmooth communication, low degree of anthropomorphism, and lack of intelligence, and achieve the goal of improving the degree of anthropomorphism, smooth interaction, and increasing recognition ability Effect

Pending Publication Date: 2022-07-29
ALIBABA (CHINA) CO LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] This application provides a virtual character driving method, device and equipment based on facial expression recognition to solve the problem of low anthropomorphic degree of traditional virtual characters, which leads to unsmooth and unintelligent communication process

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Virtual character driving method, device and equipment based on expression recognition
  • Virtual character driving method, device and equipment based on expression recognition
  • Virtual character driving method, device and equipment based on expression recognition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this application. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present application as recited in the appended claims.

[0032] First, the terms involved in this application are explained:

[0033] Multi-modal interaction: Users can communicate with avatars through text, voice, expressions, etc. The avatars can understand user text, voice, expressions and other information, and can in turn communicate with users through text, voice, expressions, etc.

[0034] Duplex interaction: real-time, two-way interaction, the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a virtual character driving method, device and equipment based on expression recognition, and relates to the fields of artificial intelligence, deep learning, machine learning, virtual reality and the like in the computer technology. According to the method, the face image of the user is obtained in real time in the conversation between the virtual character and the user, and the target classification of the current expression of the user is accurately recognized according to the face image of the user through the base model and the multi-modal alignment model for face expression recognition; and when it is determined that the target classification belongs to a preset expression classification and currently meets a response triggering condition of the target classification, determining corresponding driving data according to a response strategy corresponding to the expression classification of the user expression, and driving the virtual character to execute a corresponding response behavior according to the driving data and a three-dimensional image rendering model of the virtual character. Therefore, the virtual character can make a timely response to the expression of the user, the personification degree of the virtual character is improved, and the interaction between the virtual character and people is smoother and more intelligent.

Description

technical field [0001] The present application relates to the fields of artificial intelligence, deep learning, machine learning, and virtual reality in computer technology, and in particular, to a method, device, and device for driving a virtual character based on facial expression recognition. Background technique [0002] The traditional interaction between virtual characters and people is mainly based on voice. The interaction between virtual characters and people only stays at the voice level, and does not have the ability to understand visual information such as human expressions. Feedback, for example, during the avatar broadcast process, if the content currently broadcast by the avatar is not the information that the person who is the interaction object wants to obtain, the person will make an impatient or even angry expression. The dialogue is carried out smoothly and effectively, but the avatar does not have this ability; when the user interrupts the avatar broadca...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06V40/16G06V20/40G06T13/40G06N3/04G06N3/08G06V10/774G06V10/82
CPCG06V40/175G06V40/172G06V20/46G06T13/40G06N3/04G06N3/08G06V10/774G06V10/82G06N3/045
Inventor 马远凯朱鹏程张昆才冷海涛罗智凌周伟钱景李禹王郁菲
Owner ALIBABA (CHINA) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap