Human-computer interaction system integrating visual questions and answers in web3D environment

A human-computer interaction and visual technology, applied in the field of human-computer interaction systems, can solve problems such as weak interactivity, lack of fun, single interaction mode, etc., and achieve good presentation effects, improved interactivity, and improved efficiency

Active Publication Date: 2020-02-28
UNIV OF ELECTRONIC SCI & TECH OF CHINA
View PDF9 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The technical problem to be solved by the present invention is: to propose a human-computer interaction system that integrates visual question and answer in the web3D environment, and solve the problem of single interaction mode in traditional multimedia teaching. Weak, uninteresting questions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human-computer interaction system integrating visual questions and answers in web3D environment
  • Human-computer interaction system integrating visual questions and answers in web3D environment
  • Human-computer interaction system integrating visual questions and answers in web3D environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] The present invention aims to propose a human-computer interaction system that integrates visual question and answer in a web3D environment, and solves the problems of single interaction mode, weak interactivity and lack of interest in traditional multimedia teaching. The present invention utilizes WebGL technology to import the scene model made by the modeling tool through the model loader in the web browser, render the scene through the renderer, and finally display a large-scale VR world; Question answering model, the visual question answering model adopts the feature fusion and reasoning of the attention mechanism. Based on this visual question answering model, learners' questions are obtained and answered, and fed back to the 3D education scene on the web, so as to realize the intelligent human of web3D+AI machine interaction.

[0024] In the present invention, the human-computer interaction system integrated into the visual question and answer in the web3D environ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of VR education, discloses a human-computer interaction system integrating visual questions and answers in a web3D environment, and solves the problems of single interaction mode, low interactivity and lack of interestingness in traditional multimedia teaching. The system comprises a web end and a server end. The web end is connected with the server end through aSocket. The web terminal uses a WebGL technology, imports an education scene model made by a modeling tool through a model loader. A scene is rendered through a renderer, so that a 3D education sceneis displayed in a browser, questions and picture input information of a user are acquired and transmitted to a server side, feedback answers of the server side are acquired, and answer display is performed in the 3D education scene in combination with interactive animation. A visual question and answer model used for an education system is arranged in the server side, and after question and picture input information input by the web side is received, corresponding answers are obtained through the visual question and answer model and fed back to the web side.

Description

technical field [0001] The invention relates to the field of VR education, in particular to a human-computer interaction system integrating visual question and answer in a web3D environment. Background technique [0002] Thanks to the development of educational informatization and intelligent hardware, the human-computer interactive learning system based on multimedia technology has been widely used in teaching. However, the current multimedia teaching has the following defects: (1) The interactive mode is single, and students can only operate through the mouse and keyboard; (2) The design of the interactive interface is monotonous, lacking in interest and difficult to attract students' attention. [0003] According to relevant research by domestic and foreign educators and psychologists, the degree of interest in students' learning is one of the most important factors affecting students' learning effects besides intelligence. Therefore, if the human-computer interaction in...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/958G06F16/332G06F16/583G06K9/46G09B5/14G06N3/04G06N3/08
CPCG06F16/958G06F16/3329G06F16/583G09B5/14G06N3/084G06V10/44G06N3/044G06N3/045
Inventor 谢宁孔文喆申恒涛
Owner UNIV OF ELECTRONIC SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products