VR-based nuclear radiation environment scene construction and man-machine interaction method

A human-computer interaction and environment technology, applied in the input/output of user/computer interaction, 3D modeling, mapping and navigation, etc., can solve problems such as weak interaction, low efficiency, and increased difficulty for operators to operate

Active Publication Date: 2021-11-23
SOUTHWEAT UNIV OF SCI & TECH
View PDF19 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] At the current level of technology, although the robot has a certain intelligence, it is not enough to implement completely autonomous actions. The human-in-the-loop remote control is still an indispensable part of the current robot system towards practical applications.
However, the traditional remote control of robots mainly has the following problems: using display devices such as LCD screens to provide the operator with robot environment information, which makes the operator less immersive in the third perspective; the control of issuing motion-level instructions for the robot is not only inefficient And the interaction is not strong, which increases the difficulty of the operator's operation and easily makes the operator feel tired

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • VR-based nuclear radiation environment scene construction and man-machine interaction method
  • VR-based nuclear radiation environment scene construction and man-machine interaction method
  • VR-based nuclear radiation environment scene construction and man-machine interaction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with specific embodiments of the present invention and corresponding drawings.

[0030] Such as figure 1 Shown is a flow chart of an embodiment of a VR-based nuclear radiation environment scene construction and human-computer interaction method of the present invention. An embodiment includes the following steps S11 to S18.

[0031] S11, sensor calibration, determine the internal reference of RGBD camera and IMU, the calibration of external reference of RGBD camera and nuclear radiation detector and IMU and RGBD camera;

[0032] In one embodiment of the present invention, the nuclear radiation detector can use a gamma camera, and the external reference between the RGBD camera and the gamma camera includes two parts: the relative pose value of the RGBD camera and th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a nuclear radiation environment scene construction and man-machine interaction method based on VR. The method comprises the following steps: calibrating a sensor; acquiring scene information in a nuclear radiation environment to generate a dense three-dimensional point cloud map; generating a three-dimensional scene model and a map through a three-dimensional curved surface reconstruction algorithm; fusing the nuclear radiation information to the three-dimensional scene map; modeling the robot in Unity 3D to obtain a virtual robot model; importing the three-dimensional scene model and the chartlet into Unity 3D, and optimizing the whole virtual scene in the Unity 3D; displaying the virtual scene and related parameters in unity 3D; and the robot entering the environment again to realize repositioning and real-time interaction. The VR-based nuclear radiation environment scene construction and man-machine interaction method provided by the invention has the characteristic of quickly and accurately modeling the nuclear radiation environment and a more immersive interaction mode, and can effectively deal with the tasks of emergency, maintenance, decommissioning and the like in the nuclear radiation environment.

Description

technical field [0001] The invention belongs to the technical field of scene reconstruction and human-computer interaction, and in particular relates to a VR-based nuclear radiation environment scene construction and human-computer interaction method. Background technique [0002] With the promotion and application of nuclear power generation, radiation and other industries, as well as the decommissioning of nuclear facilities and the extensive development of nuclear waste treatment and disposal, the risk of nuclear safety accidents such as nuclear leakage, nuclide proliferation, and loss of strong radioactive sources has increased. However, due to the restrictions of strong ionizing radiation, toxicity, and pollution in the nuclear environment, workers are often unable to directly enter the accident site. The three-dimensional fusion and reconstruction of nuclear radiation scene space and radiation information will help operators to analyze the nuclear radiation environment...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/73G06T17/05G06T17/20G06F3/01G01C21/00G01C25/00
CPCG06T7/74G06T17/05G06T17/20G06F3/011G06F3/012G01C21/3841G01C25/005G06T2207/10028G06T2207/10024
Inventor 徐锋郭中远陈国栋陈妍洁王贵洋
Owner SOUTHWEAT UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products