Method and device for simulating speech based on face changing technology and virtual reality technology

A virtual reality technology and technology, applied in the field of speech simulation based on face changing technology and virtual reality technology, can solve problems such as lack of personalization in practice, and achieve the effect of improving speech ability, improving speech ability and reducing stress level.

Pending Publication Date: 2020-08-28
TSINGHUA UNIV
View PDF3 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, they all lack the attention that the virtual practice environment and virtual practice objects should meet different practice scenarios and requirements, resulting in a lack of personalization in their practice.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for simulating speech based on face changing technology and virtual reality technology
  • Method and device for simulating speech based on face changing technology and virtual reality technology
  • Method and device for simulating speech based on face changing technology and virtual reality technology

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0040] Please refer to Figure 1-3 , the present embodiment provides a method for simulating a speech based on face-changing technology and virtual reality technology, including the following steps:

[0041] S1: Generate at least one virtual lecture venue 101 and at least one virtual audience 102 based on face-changing technology and virtual reality technology, and select a virtual lecture venue 101 and at least one virtual audience 102 from at least one virtual lecture venue 101 and at least one virtual audience 102 ;

[0042] S2: After the real-world speaker 10 wears the VR device 12 and starts giving a speech, the real-time anxiety level data of the real-world speaker 10 is obtained. According to the real-time anxiety level data of the real-world speaker 10, the posture of the virtual audience 102 changes to give a speech The audience will give real-time feedback on the effect of the speech and their anxiety level until the end of the speech;

[0043] Further, in some emb...

Embodiment 2

[0046] Please refer to Figure 4 , this implementation is further improved on the basis of embodiment 1. In step 2, the method for generating at least one virtual lecture place 101 includes:

[0047] Upload the required pictures of the lecture venue or select the pictures of the lecture venue from the provided cases, and generate a 360° lecture venue based on the pictures of the lecture venue based on virtual reality technology. The purpose of this setting is to make the visual effect better, make the lecture place closer to reality, and increase the sense of substitution.

[0048] In some embodiments of the present invention, a method of simulating speech based on face-changing technology and virtual reality technology, in step 2, the method of generating at least one virtual audience 102 includes:

[0049] Upload the information of the virtual audience 102 required by the speaker, and use the Deepfake face-changing technology to generate the virtual audience 102 through the...

Embodiment 3

[0055] Please refer to Figure 5 , this implementation is further improved on the basis of Embodiment 1 and Embodiment 2. The difference from Embodiment 1 and Embodiment 2 is that: the camera device 11 is used to monitor the entire speech process of the speaker 10 in the real world, and the speech is played through the player 13 Video, for the speech video, according to the speech review conditions, a report on the effect of the practice speech and the level of anxiety is given. The purpose of this setting is to consider that the speaker's body movements such as gestures will also change during the speech practice. It has been observed that the speaker will repeat the same movement when he is nervous, and the anxiety level can also be generated through the speaker's body movements data to generate a report on the performance and anxiety levels of the practice speech.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a device for simulating speech based on a face changing technology and a virtual reality technology. The method comprises the following steps: acquiring anxiety level data of a speaker in the real world at a normal level; generating at least a virtual speech place and a virtual audience; acquiring real-time anxiety level data of a real-world speaker, and changing the posture of the virtual audience according to the real-time anxiety level data of the real-world speaker so as to feed back a speech effect and the anxiety level to the speaker in real time; andrecording real-time anxiety level data from beginning to end of the speech of the speaker in the real world, and generating a report of the speech practice effect and the anxiety level. The method has the advantages that a user can design a speech place and audiences and receive interactive feedback in virtual reality, the response of the virtual audiences provides real-time feedback for the user, the user is helped to reduce the pressure level of the user, the speech state is adjusted in time, and the speech ability of the user is improved.

Description

technical field [0001] The present invention relates to the field of face-changing technology and virtual reality technology, in particular, to a method and device for simulating speech based on face-changing technology and virtual reality technology. Background technique [0002] Excellent public speaking skills can play a key role in personal character building, confidence building and career development. While public speaking skills are important for most careers, social anxiety disorder can make it difficult for a large proportion of people to express themselves effectively while speaking. According to the survey, 25% of people are most afraid of speaking, surpassing fear of heights, fear of the dark or fear of blood. The important skill of presenting and speaking effectively in public is not part of the formal education system in schools. This leads to few opportunities for people to practice speaking, but the skill of speaking can only be improved through practice. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01
CPCG06F3/011G06F2203/012
Inventor 王运涛瑞图史元春
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap