272 results about "Virtual robot" patented technology

In an automated interface program designed to interact and communicate with users, said program executing actions when a category among a predefined set of categories is activated, a method is disclosed for automatically verifying the performance of said program, the steps of said method comprising: specifying inputs under which the program should be tested; associating said inputs with conditions within categories in the program, each said condition comprising at least one response which could be given if said condition is satisfied; executing said program under at least one said input; determining whether the associated condition is satisfied upon said input; and determining whether the response associated with said condition is given upon said input. In another aspect of the present invention, the test inputs are embedded within the script itself, and specifically, within categories that can be automatically listed upon compilation of the script. Such list of test inputs can then be automatically executed to test the program. The execution of a test input can be used to check whether the test input activated the category in which the test input is embedded. The response given upon execution of a test input can then determine whether other categories are erroneously activated; or whether inputs, other than the test input, erroneously activate the category associated with the test input.

The invention discloses a health protection robot system and a data processing method thereof, and relates to the field of medical care, in particular to an intelligent health protection system which is used for integrating fragmented health data so as to realize scientific user health behavior intervention. The invention aims to provide a health protection system which has the advantages of being simple in structure, low in cost and convenient in operation, integrates the fragmented health data, carries out intelligent analysis and carries out intervention on the user health behavior by the system. The health protection robot system comprises an acquisition module, a server and a terminal, wherein the acquisition module is used for collecting the health and medical care data of a user; the server carries out comparison, analysis and model operation through the uploaded health and medical care data, generates a health data summarization and evaluation report and a health intervention scheme, and provides control and support for the operation of a virtual robot; and the terminal is used for a registered user to carry out login, causes the registered user to receive the health data in the acquisition module and is provided with a display module used for displaying the health data and system functions.

The present invention provides a method for planning a path for an autonomous walking humanoid robot that takes an autonomous walking step using environment map information, the method comprising: an initialization step of initializing path input information of the autonomous walking humanoid robot using origin information, destination information, and the environment map information; an input information conversion step of forming a virtual robot including information on the virtual robot obtained by considering the radius and the radius of gyration of the autonomous walking humanoid robot based on the initialized path input information; a path generation step of generating a path of the virtual robot using the virtual robot information, the origin information S, the destination information G, and the environment map information; and an output information conversion step of converting the path of the autonomous walking humanoid robot based on the virtual robot path generated in the path generation step.

The invention discloses a method for building a robot simulation drilling system based on a reality scene. The method comprises the following steps: obtaining depth image information of the reality scene, and transforming the depth image information into discrete three-dimensional point cloud data; interpreting the three-dimensional point cloud data into a semantic map which can be understood by a robot; inputting the discrete three-dimensional point cloud data into three-dimensional modeling software, and carrying out geometric modeling on a virtual scene, so as to obtain a three-dimensional entity model of the virtual scene; introducing the three-dimensional entity model into a 3DS MAX to map and render, so as to obtain a three-dimensional space scene model; carrying out geometric modeling on the robot in the 3DS MAX, so as to obtain a virtual robot model; introducing the three-dimensional space scene model and the virtual robot model into an OGRE (object-oriented graphics rendering engine), building a physical model and a power model of the three-dimensional space scene, and building a virtual scene simulation system.

The invention discloses a method for achieving industrial robot off-line programming based on three-dimensional modeling software. The principle of the method is that a three-dimensional modeling software application programming interface (API) which is suitable for COM or object linking and embedding (OLE) and the like is used in the three-dimensional modeling software environment, model and space matrix data in the three-dimensional modeling software are obtained, a robot virtual body model and a mathematical model are built, and a virtual robot motion control system is realized; discretization from a curve to a point is conducted through obtained space line data, and therefore a motion trail of a robot is generated, actual robot operation is simulated; and an industrial robot controller operational procedure generating module is built, an actual controller executable file is generated and lead out so as to be operated in an actual robot controller, and industrial robot off-line programming can be achieved. The method can achieve off-line programming operation rapidly and generate optimal gesture of corresponding points automatically, time for generating training data is short, and a space curve trail can be achieved conveniently and rapidly, wherein a basis of the space curve trail is difficult to find in reality to conduct teaching.

A virtual robot (or BOT) is disclosed that interfaces and automatically interacts with users desiring to be guided or informed about certain aspects or features of the entity with which they are interacting. Several mechanisms are further disclosed that aid the effectiveness of that interaction. Mechanisms to focus the attention of the BOT on certain aspects of the interaction or communication are disclosed. These mechanisms can be made explicitly or can be performed automatically. Mechanisms are disclosed to aid the BOT to automatically learn from its interactions with users to increase the effectiveness of the interaction.

A virtual robot (or BOT) is disclosed that interfaces and automatically interacts with users desiring to be guided or informed about certain aspects or features of the entity with which they are interacting. Several mechanisms are further disclosed that aid the effectiveness of that interaction. Mechanisms to focus the attention of the BOT on certain aspects of the interaction or communication are disclosed. These mechanisms can be made explicitly or can be performed automatically. Mechanisms are disclosed to aid the BOT to automatically learn from its interactions with users to increase the effectiveness of the interaction.

The invention provides a multi-mode interaction method for a multi-mode virtual robot. An image of the virtual robot is displayed in a preset display region of a target hardware device; and the constructed virtual robot has preset role attributes. The method comprises the following steps of obtaining a single-mode and / or multi-mode interaction instruction sent by a user; calling interfaces of a semantic comprehension capability, an emotion recognition capability, a visual capability and a cognitive capability to generate response data of all modes, wherein the response data of all the modes is related to the preset role attributes; fusing the response data of all the modes to generate multi-mode output data; and outputting multi-mode output data through the image of the virtual robot. The virtual robot is adopted for performing conversation interaction; on one hand, an individual with an image can be displayed on a man-machine interaction interface through a high-modulus 3D modeling technology; and on the other hand, the effect of natural fusion of voices and mouth shapes as well as expressions and body actions can be achieved through an animation of a virtual image.

The present invention relates to a PC-based robot control system, which is a new type of a robot control machine. The present invention has aimed at a task-based control machine configuration not a centralized control configuration so that a multi-tasking function is possible through a distributed control system. An embodiment of the present invention provides a task-based robot control system, including robot system interface means that receives a control command for controlling a robot; system kernel means that controls the creation and distinction of one or more software-based virtual robot control machines of virtual robot controller means, which will be described later, in a software way and controls the synchronization between the virtual robot control machines, based on the control command received from the robot system interface means; the virtual robot controller means having one or more software-based virtual robot control machines whose creation and distinction are controlled under the control of the system kernel means, wherein a generated virtual robot control machine processes a robot control execution sentence input through the robot system interface means; and hardware means that actually drives the robot according to a control signal generated by the processing of the execution sentence by the virtual robot control machine.

The invention discloses a virtual robot and real robot integration based picking system. The virtual robot and real robot integration based picking system comprises a vision positioning system, a real robot and a virtual robot simulation system; a picking target is positioned through the vision positioning system and the real-time picking of the real robot is guided after the three-dimensional space coordinate information of the picking target is obtained; meanwhile the obtained three-dimensional space coordinate information is transmitted to the virtual robot simulation system through a data transmission line and the real-time simulation is performed on the picking process through a virtual robot. According to the virtual robot and real robot integration based picking system and method, a virtual simulation technology is combined with a machine vision technology, the robot under the virtual environment and the real robot are driven based on calculation data of a binocular vision system to perform the visual positioning and the picking behavior simultaneously, and accordingly the contrast of the accuracy of the vision positioning and the effectiveness validation of the picking behavior are implemented.

The invention discloses a Kinect-based man-machine interaction method for a two-arm robot. In the method, operators are allowed to control a six-degree-of-freedom virtual robot to complete an operation task through a natural hand three-dimensional action; and the operators are helped to control the robot and know the action and ambient environment of the robot on the basis of the visual man-machine interaction. According to the method, the visual guidance-based semi-autonomous shared control can be realized, and an end effector with an object grabbing task obtains the more exact position and range due to the semi-autonomous shared control of the visual guidance, so that the grabbing is more exact.

The invention relates to a robot teaching system based on an RGB-D image and a teaching device. The system comprises an RGB-D camera, an upper computer, the posture teaching device and an AR teaching system; the AR teaching system comprises an AR registration card, an augmented reality module, a virtual robot model including a robot end actuator, a path planning unit and a posture teaching unit, the RGB-D camera collects the RGB image and a depth image of the physical work environment in real time, in the path planning unit, the path points of the robot end actuator are selected, three-dimension coordinates of the path points of the robot end actuator in the basic coordinate system of the virtual robot model are calculated, the posture teaching unit takes the received posture data as the posture of the path points of the current motion, according to the position and the posture of the path points, the virtual robot model is driven to move, and teaching is finished. The complex posture tracking system is not needed, a physical robot does not participate in teaching, and through augmented reality simulation, the teaching programming is finished.

A robot simulator includes a generating unit, a display unit, a display control unit, and a simulation instructing unit. The generating unit generates a virtual image that includes a virtual robot obtained by imaging an actual robot having at least one axis and an operation handle capable of operating three-dimensional coordinate axes having a predetermined control point of the virtual robot as the origin. The display control unit displays on the display unit the generated virtual image. The simulation instructing unit, when an operator's operation for the operation handle is received, acquires at least one of a displacement amount of the control point and a rotation amount of the three-dimensional coordinate axes attributable to the operator's operation, and instructs the generating unit to regenerate the virtual image in which a posture of the virtual robot is changed in accordance with the displacement amount or the rotation amount thus acquired.

The invention provides a multimode virtual robot interaction method, comprising the following steps of starting a virtual robot, displaying an image of the virtual robot in a preset display area, wherein the virtual robot has a set character and a background story; obtaining a single-mode and / or multimode interaction instruction sent by a user; calling a robot capability interface to analyze the single-mode and / or multimode interaction instruction, thereby obtaining an interaction instruction intention; screening and generating multimode response data related to the set character and the background story according to a current application scene and the set character; and outputting the multimode response data through the image of the virtual robot. According to the method, the virtual robot with the set story and character attribute is used for carrying out conversation interaction, so a user seems to have a conversation with a person. The virtual robot provided by the invention also has a function of screening and generating the multimode response data according to the set character attribute and the set story, so the virtual robot has certain selectivity and initiative for the interaction content.

The invention discloses an emotion output method and dialogue interaction system for a virtual robot. The method includes the steps of displaying a virtual robot image in a current interactive interface; obtaining users' input information; conducting emotional analysis on the input information, and obtaining emotional parameters; outputting response data aiming at the input information, wherein the response data includes expression data corresponding to the virtual robot image; making the virtual robot image to make coherent actions and / or expressions matched with the emotional parameters. According to the emotion output method, the virtual robot can display emotion to the users, thereby greatly improving the personification degree of the virtual robot and the communication desire of the users.

A robot server for controlling a robot, a system for providing content having the same, and a method thereof are provided. The robot server communicating with the robot includes a virtual robot object and a virtual robot object manager. The robot server executes commands that are generated in correspondence to the robot and received from the robot, and controls the robot. The virtual robot object manager generates the virtual robot object corresponding to the robot and activates the virtual robot object when connected to the robot.

The invention discloses a virtual robot multi-mode interaction method and system applied to a video live-broadcasting platform. A video live-broadcasting platform application gets access to a virtual robot with multi-mode interaction ability. The multi-mode interaction method comprises a step of displaying a virtual robot with a specific image in a preset display area, entering into a default live-broadcasting auxiliary mode, and receiving multi-mode data and a multi-mode instruction inputted in a live-broadcasting room in real time, a step of analyzing the multi-mode data and the multi-mode instruction, and judging and determining a target live-broadcasting auxiliary mode by using the multi-mode interaction ability of the virtual robot, and a step of starting the target live-broadcasting auxiliary mode and allowing the virtual robot to carry out multi-mode interaction and display according to the target live-broadcasting auxiliary mode. The multi-mode interaction of multiple modes is displayed by using live-broadcasting mode conversion, the user interest is improved, the user stickiness is maintained, and the user experience is improved.

The invention involves a obstacle-overcoming scheme for robots based on virtue robot. In this scheme, the model of an obstacle is established through enveloping of regular objects. The scheme also incorporates the methodologies of the joint space method and C space method. With the prerequisite of maintaining a relatively high precision, the obstacle field is determined through projections on H and V planes. Thus the problem of 3D obstacle-overcoming scheme is converted into a 2D problem in two planes. The methodology represented in this scheme can improve the level of safety, real-time and efficiency of the scheme.

The invention relates to a robot online teaching system based on reality enhancing. The robot online teaching system comprises a teaching manipulator, an orientation tracking sensor, a virtual robot model positioning device, a reality enhancing displayer and a computer. The computer comprises a storage, a processor and a communication module. Programs are stored in the storage, and the programs comprise a feeding calculation module, a robot forward kinematics model, a robot control logic and failure arrangement module, a virtual robot rendering module and an orientation tracking module. In therobot online teaching system, operation personnel can drive a virtual robot model to move through the physical teaching manipulator, and superpose the virtual robot model into a real scene by enhancing a reality technology, teaching training or teaching programming can be conducted without a physical robot, the safety of robot teaching training is improved, the cost is lowered, and the robot online teaching system can be widely applied to teaching and teaching programming.

The invention relates to a remote control platform based on virtual reality robot hand, which is formed by a man-machine interface system and a remote-control robot hand system. Wherein, said man-machine interface system is a virtual operation platform formed by one computer to supply the operation interface of operator; said remote-control robot hand system comprises a robot hand connected to the robot hand controller; a robot hand controller connected to an upper control computer; and a CCD camera aiming said robot hand to pick up its position and state; while said upper computer and CCD camera via cables are both connected to said virtual operation platform. The invention can realize remote operation and the offline operation to realize the simulation on variable control algorithmic. It can reduce the control notes most, to improve the response speed and the cost of hardware and software.

The invention relates to a virtual robot system for promoting physical and mental health of a user and an intervention method of the virtual robot system. The system comprises a server, a user control terminal and user equipment, wherein the server, the user control terminal and the user equipment are sequentially connected; the server is used for receiving setting of the user control terminal, customizing and supporting a functional module, summarizing, processing and analyzing data of the user control terminal, giving a health advice, performing data storage and realizing logic operation and supporting of a robot; the user equipment comprises a projector, a display device, a loudspeaker, a headphone, an intelligent wearable device, an intelligent weighing scale, an intelligent control massage device, a treadmill, an exercise bicycle, a training machine and other intelligent body-building devices. The system can be reminded to start automatically through self-timing, start actively or be controlled to start through a voice instruction. Physical and mental health of the user is promoted through pressure relief, massaging, relaxing, exercising, intelligent interaction in the whole process and sharing and communicating in a health communication group, and better experience is realized.

Disclosed is a method and system for the use of virtual robots (Bots) to assist in the answering of inquiries from persons over the Internet, telephone, wireless, or other form of electrical, digital, or electronic communication. Such method and system consists of (1) a Bot processor consisting of (a) a connection interface capable of receiving, directly or indirectly, inputs from a user in natural or machine language, which the Bot processor then responds to in natural or machine language, and (b) an engine capable of recognizing an input and providing a response; and (2) a service desk consisting of (a) a human being, (b) a connection interface that connects directly or indirectly to the Bot processor and to the front end, and (c) a display where the human being can see, in humanly comprehensible form, information transmitted by the user and / or the Bot processor.

The invention discloses a virtual robot multimodal interaction method and system applied to a live video platform. An application of the live video platform is provided with a virtual robot for associating the live video, the virtual robot has multimodal interaction ability, and the public opinion monitoring method comprises the following steps: information collection step: collecting public opinion information of live broadcast in the current specific direct broadcasting room, wherein the public opinion information comprises viewed text feedback information; public opinion monitoring step: calling text semantic understanding ability and generating a public opinion monitoring result of the specific direct broadcasting room; and a scene event response step: judging an event characterized by the public opinion monitoring result, calling the multimodal interaction ability, and outputting multimodal response data through the virtual robot. By adoption of the virtual robot multimodal interaction method and system disclosed by the invention, the viewing feedback information of audience can be monitored and prompted in real time, the live video operation is assisted by the virtual robot to keep the viscidity with the users consistently, and thus the user experience is improved.

A robot server for controlling a robot, a system for providing content having the same, and a method thereof are provided. The robot server communicating with the robot includes a virtual robot object and a virtual robot object manager. The robot server executes commands that are generated in correspondence to the robot and received from the robot, and controls the robot. The virtual robot object manager generates the virtual robot object corresponding to the robot and activates the virtual robot object when connected to the robot.

The invention relates to a system and method for editing and controlling the actions of a movable robot. The invention enables in particular the creation and modification of behaviour and movements according to a factual logic as well as to a time logic, the latter controlling the factual logic and thus enabling the synchronisation of the behaviour and movements of the various sub-units of the robot. For this purpose, the system is organised into behaviour and movement layers which comprise sequences of actions and a timeline. The actions may be programmed via boxes interconnected by signals which convey information. The boxes are arranged into a hierarchical structure in which the lowest level includes a script that can be interpreted by a virtual robot which simulates the execution of commands and, when applicable, by a physical robot. The movements of the robot can also be controlled in a graphical manner by means of movement screens.

The present invention provides a method for performing dialogue interaction through using a virtual robot. The image of the virtual robot is constructed when an application begins operating, and is displayed in a preset display area. The method comprises the following steps that: single-modal and / or multi-modal interaction request data are obtained; a multi-modal robot capability interface for current interaction is called; reply data for the interaction request data are generated through using the multi-modal robot capability; and reply data are outputted in a multi-modal form through the constructed image of the virtual robot. According to the method of the invention, the virtual robot is adopted to perform dialogue interaction, and therefore, on the one hand, individuals involved in dialogues can be enriched, an individual of a certain image is displayed on the user graphical interface of a chatting system through a three-dimensional image or a two-dimensional image, so that the imagination space of a user can be enhanced; and on the other hand, content to be expressed by dialogue information can be completely displayed through the animated display of the virtual image.

The invention discloses an interaction output method and system for an intelligent robot. The method comprises the steps of obtaining multimodality input data of a user; analyzing the multimodality input data to obtain an analysis result; determining a current interaction requirement according to the analysis result, and calling set output characters matched with the interaction requirement, wherein the characters are borne by images of a virtual robot; generating and outputting interaction response data aiming at the analysis result based on the set output characters. By means of the interaction output method and system for the intelligent robot, the individualized characteristics shown by the robot are matched with a current man-machine interaction progress to the greatest extent while the intelligent robot has the individualized characteristics, the anthropopathic level of the intelligent robot is increased, and the user experience of the intelligent robot is also greatly improved.

The invention discloses an augmented reality based robot demonstration representation method and device. The method comprises the following steps of: performing filtering processing and data optimizing on gesture pose obtained by somatosensory equipment; sending optimized data to augmented reality equipment through a wireless network, and representing demonstration track of an operator by drivinga virtual robot in the AR equipment; observing represented track of the virtual robot from the augmented reality equipment via a demonstrator, regulating a demonstration point with relatively great errors through voice, modifying a previous demonstration point, and repeating operations until errors of all demonstration points are within a satisfactory limit, thereby completing demonstration; and converting the final demonstration track into a joint angle needed for driving a real robot, and controlling the real robot to represent a demonstration path of the operator. The device comprises somatosensory equipment, a PC, a microphone, optical see-through type augmented reality equipment, a WiFi router and a robot. The augmented reality based robot demonstration representation method and device have the advantages of being relatively low in professional requirements of the demonstrator, avoiding damaging an operating robot, being high in repeating efficiency and the like.

The embodiment of the invention provides a robot simulation control method and device. The method comprises the steps that the stereoscopic image of a virtual robot corresponding to a real robot is displayed in a preset area of a robot operation control interface; the control parameters of the robot are acquired; the control parameters are transmitted to the virtual robot, so that the virtual robot moves according to the control parameters; the stereoscopic image of the motion process of the virtual robot is displayed in the preset area; and according to the control parameters, the motion trajectory of the virtual robot is drawn on the stereoscopic image of the motion process of the virtual robot. According to the invention, a user can clearly and visually observe the motion state of the robot.

Disclosed herein are an apparatus and method for synchronization robots. According to an aspect of the present invention, a portable robot synchronization apparatus includes a storage unit configured to store data defining physical models and behaviors of a real robot, a manipulation unit, an output unit, a communication unit configured to perform wired and wireless communication with the real robot or a server, and a control unit configured to model a size and behavior of a virtual robot, having a shape and behavior of the real robot, in response to a manipulation command received through the manipulation unit, on the basis of the data stored in the storage unit, output the modeled virtual robot through the output unit, and control the behavior of the virtual robot in response to the behavior of the real robot when communicating with the real robot through the communication unit.