HoloLens-based multi-person cooperative interaction method

Abstract

The invention discloses a HoloLens-based multi-person cooperative interaction method. The multi-person cooperative interaction method comprises a command post local multi-person cooperative interaction mode and a forward-rear multi-person remote cooperative interaction mode, and performs natural man-machine interaction according to user identity roles, operation habits, interactive action trends and the like; the fidelity and immersion of situation awareness are enhanced while the natural and fluent interactive capability of a system is improved; vivid and intuitive battlefield situations and visual information interactive interfaces are intelligently and efficiently provided for commanders and staff officers; and the method is used for supporting establishment of a future advanced command post cooperative command operation system for warfighters of different levels and different fight forms.

Description

technical field [0001] The invention relates to a human-computer interaction technology, in particular to a HoloLens-based multi-person collaborative interaction method. Background technique [0002] Human-computer interaction is the process of using a specific language between humans and machines to achieve information exchange between humans and computers through a series of interactive operations. Human-computer interaction technology is one of the major issues in the information field in the 21st century, and with the development of emerging technologies such as sensor technology, intelligent computing technology, embedded systems, cloud computing, and big data, new development trends have emerged: First, human-computer interaction has become It is no longer limited to the interaction between human and computer, but extends to the entire physical space, information space and social space, forming the mutual communication and integration of human-machine-thing; Mobile no...

AI Technical Summary

Problems solved by technology

[0004] At present, our army has initially formed the basic system of land, sea, air, rocket force and joint combat command and control system. The traditional sand table discussion and discussion and map operations are time-consuming, laborious and inefficient, and based on the mouse, keyboard and touch screen The interactive mode changes the original command and operation mode of the commander, and requires the commander to conduct command in a way limited by the system, which limits the command efficiency of the commander

Based on the fact that Hololens can provide commanders with a more natural and smooth interaction method, however, there is currently no research on multi-person collaborative interaction. Therefore, in the process of command operations and collaborative operations, commanders need to understand the situational environment, collaborators, and collaborative tasks. As well as the need to accurately perceive and understand various information of shared objects and interact with them using smarter and more natural collaborative operation methods

Images