Autonomous mobile cruise and control robot linked with MR glasses and system thereof

Abstract

The invention relates to the field of robots, in particular to an autonomous mobile cruise and control robot. The robot comprises a driving device, a panoramic stereoscopic camera shooting tripod head, an environment detection device mounting base, a remote operation controller and two mounting platforms, wherein the two mounting platforms are arranged above the two ends of the length direction ofthe driving device through first damping buffering mechanisms correspondingly, the two first damping buffering mechanisms are arranged at the two ends in the length direction of the driving device correspondingly, the top of each first damping buffering mechanism is hinged to the corresponding mounting platform, the panoramic stereoscopic camera shooting tripod head and the environment detectiondevice mounting base are arranged on the two mounting platforms correspondingly through second damping buffering mechanisms, each second damping buffering mechanism is fixedly arranged at the upper end of the corresponding mounting platform, and the remote operation controller controls the driving device and the panoramic stereoscopic camera shooting tripod head. According to the robot, people canbe replaced for exploration detection and MR stereoscopic video acquisition, and people with a head-mounted MR display helmet can observe a scene shot by the robot at a long distance, and the MR is driven through the head action to adjust the shooting direction of the robot.

Description

technical field [0001] The present invention relates to the field of robots based on Internet of Things communication, in particular to an autonomous mobile patrol robot linked with MR glasses and a system thereof. Background technique [0002] As a multi-functional and high-performance execution tool, robotic equipment with autonomous mobility can be integrated into the Internet of Things system, which can not only replace human beings to complete some high-strength, difficult, and high-risk types of work, but also promote the upgrading of traditional industries. It can also change the existing work and product forms in many fields such as home furnishing, tourism, security, logistics, and construction. [0003] MR (Mix reality) technology, that is, mixed reality technology, refers to the superposition of real things and virtual scenes for three-dimensional display. Real things and virtual objects are fully integrated, indistinguishable from each other, and interact in real...

AI Technical Summary

Problems solved by technology

One is that it is not easy to control the shooting direction of the camera equipped on the robot; traditionally, users use the remote control to issue commands to adjust the shooting direction of the robot pan / tilt, and at the same time observe the relative positions of the robot and its surrounding objects. In the state of the glasses, the user's field of vision is completely closed by the MR display glasses. It is not easy to use the remote control, and it is not easy to observe the relative positions of the robot and its surrounding objects, which brings great inconvenience to the adjustment of the shooting direction.

The second is that the panoramic stereoscopic video displayed by MR is prone to screen tremors, which increases the user's sense of vertigo; as we all know, users are prone to feel dizzy when watching MR display, which is a negative effect brought by the immersive visual experience, but the existing Most of the MR display content is prefabricated games or movies, and the picture of the panoramic stereoscopic video itself is still stable; while at the front end, the autonomous mobile robot is used to collect panoramic stereoscopic video and display it in real time through MR, and the robot is affected by factors such as the road surface during the moving process. Interference causes the collected panoramic stereoscopic video images to have a certain degree of jitter, and the jitter will be more obvious to the user when it is displayed through MR immersive display, giving the user the illusion that the surrounding environment is trembling, which greatly increases dizziness sense

Images