Automatic driving vending truck and man-machine interaction method thereof

Abstract

The invention relates to the technical field of unmanned vehicles, automatic driving and unmanned driving, and provides an automatic driving vending truck and a man-machine interaction method thereof.The man-machine interaction method comprises the steps of recognizing a purchasing user and a position of the purchasing user; paying by the purchasing user; identifying a hand position of the purchasing user according to an image acquired by a camera in real time; sending an article purchased by the purchasing user to the hand position of the purchasing user; and prompting the purchasing user tolift the hand or open a palm through voice, and adjusting a coordinate of the sent article through the image acquired by the camera in real time till that the purchasing user acquires the article purchased by the purchasing user. The man-machine interaction method provided by the invention is suitable for shopping of various special crowds (such as blind people, deaf-mutes and disabled people with mobility difficulties), practicability of the automatic driving vending truck is improved, non-contact shopping is realized, and public health safety is improved.

Description

technical field [0001] The invention relates to unmanned vehicles, automatic driving and the fields of unmanned driving, and in particular to an automatic driving vending vehicle and a human-computer interaction method thereof. Background technique [0002] In public places in life, such as stations, squares, shopping malls, etc., there are many people traveling, including blind people. Blind people usually have sensitive senses of touch and hearing. Some of them only have visual impairments, but no hearing impairments and speech impairments. , they can purchase water, beverages, snacks and other commodities in physical stores, and can identify, purchase and pay for commodities through touch and hearing, but this can only be done with the unilateral sensitivity of the blind. Purchasing goods in physical stores is not convenient and quick. [0003] Blind people can also shop through unmanned vending machines in public places, but the existing unmanned vending machines, the o...

AI Technical Summary

Problems solved by technology

[0002] In public places in life, such as stations, squares, shopping malls, etc., there are many people traveling, including blind people. Blind people usually have sensitive senses of touch and hearing. Some of them only have visual impairments, but no hearing impairments and speech impairments. , they can purchase water, beverages, snacks and other commodities in physical stores, and can identify, purchase and pay for commodities through touch and hearing, but this can only be done with the unilateral sensitivity of the blind. Buying goods in physical stores is not convenient and quick

[0003] Blind people can also shop through unmanned vending machines in public places, but the existing unmanned vending machines, the operation process and operation step prompts are all reminded by touching the human-computer interaction device, and blind people cannot shop smoothly at all. Even with sound prompts, blind people still cannot accurately press the buttons on touch human-computer interaction devices

It can be seen that the existing unmanned vending machines cannot bring convenience to blind people's shopping. At the same time, during the current epidemic period, direct or indirect contact with traditional payment methods such as cash, swiping cards, and touch screen operations will cause certain health and safety hazards.

Images