Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Digital human driving system based on blendshape

A driving system and digital human technology, applied in the field of character rendering, can solve problems such as the reduction of the picture effect, and achieve the effect of rapid deployment

Inactive Publication Date: 2020-09-04
江苏原力数字科技股份有限公司
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to provide a blendshape-based digital human drive system to solve the problem that the existing digital human rendering work will reduce the picture effect when deployed in different application scenarios

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Digital human driving system based on blendshape
  • Digital human driving system based on blendshape

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0014] Such as figure 1 As shown, a blendshape-based digital human driving system includes a network receiving module, a service analysis module, a digital human driving module, a state detection module and a video stream transmission module.

[0015] Such as figure 2 Shown:

[0016] (1) The network receiving module establishes a long connection through websocket, receives the network data sent by the user, and stores each frame of network data (json data of 40ms) in the original data queue; the network data includes audio data and video data;

[0017] Websocket is a protocol provided by HTML5 for full-duplex communication on a single TCP connection. Websocket makes the data exchange between the client and the server easier, allowing the server to actively push data to the client. In the websocket API, the browser and the server only need to complete a handshake, and a persistent connection can be created directly between the two, and two-way data transmission can be perf...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a digital human driving system based on blendshape, and the digital human driving system comprises: a network receiving module which builds long connection through websocket, receives network data transmitted by a user, and stores each frame of network data in an original data queue; a service analysis module which is used for analyzing the network data, converting the network data into structural body data corresponding to the digital person and putting the structural body data into a frame sequence queue; ta digital human driving module which is used for taking away afirst frame from the frame sequence queue in each main cycle in the virtual engine and then setting the first frame to a blendshape of a corresponding channel of a skeleton grid extraction object of the virtual engine; a state detection module which is used for judging the state and transmitting state information to a user through http; and a video stream transmission module which is used for enabling a picture rendered by the unreal engine to flow into a webpage instant messaging proxy server through webpage instant messaging, analyzing the picture and displaying the picture on a webpage browser. A cross-platform deployment mode is realized.

Description

technical field [0001] The invention belongs to the technical field of character rendering, and in particular relates to a digital human drive system based on blendshape. Background technique [0002] At present, there are two companies mainly engaged in digital human work in the market, namely faceme and soul machine. Their digital human images are rendered and driven by their own systems, which causes the character rendering effect to depend on Issues with the renderer. And if it needs to be deployed to mobile devices, the effect of the screen needs to be discounted twice. In order to solve the above problems, this application proposes a blendshape-based digital human drive system that can quickly implement digital human deployment in different application scenarios. Contents of the invention [0003] The purpose of the present invention is to provide a digital human driving system based on blendshape, so as to solve the problem that the existing digital human renderin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T13/40G06T13/80G06F16/957
CPCG06T13/40G06T13/80G06F16/9574
Inventor 赵锐侯志迎钟凌霄
Owner 江苏原力数字科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com