Binocular-vision-based high-precision virtual assembling system algorithm

Abstract

The invention relates to a binocular-vision-based high-precision virtual assembling system algorithm. The algorithm is characterized in that a Kinect sensor is used for collecting user motion space information as input information of a virtual assembling system; a hand model is established by applying an OpenGL unit; the established hand model is compared with a collected hand image and calculation is carried out to obtain a similarity degree of the hand model and the hand image; with an improved particle swarm optimization algorithm, a hand model of the collected image is obtained; on the basis of the hand model and calibration information of the Kinect sensor, a depth image is obtained by rendering and thus the gesture tracking and identification can be realized and information input of the virtual assembling system can be completed, thereby realizing the high-precision virtual assembling process. With the algorithm, accurate and stable three-dimensional real-time tracking of a gesture can be realized and no special mark or complicated image collection equipment is needed, so that the requirement and cost of hardware equipment are reduced. A training sample is not needed, so that application extension can be carried out easily.

Description

technical field [0001] The invention relates to a high-precision virtual assembly system algorithm based on binocular vision. Background technique [0002] In the process of product design and manufacturing, assembly is a very important link, and the efficiency and quality of assembly directly affect the final quality of the product. According to relevant information, the cost of assembly accounts for 30% to 50% of the total manufacturing cost, and may even be higher. In the traditional assembly process, since the assembly usually cannot be completed at one time, it is necessary to repeatedly assemble and modify the design, and the modification process needs to rely on the physical model. This complicated work not only makes the assembly process extremely complicated, but also makes the assembly cost quite high. Virtual assembly is the use of computer tools to make or assist decision-making in assembly relationship engineering through analysis, virtual models, visualizatio...

AI Technical Summary

Problems solved by technology

Model-based approaches provide continuous solutions, but are expensive and depend on the availability of rich visual information, typically provided by multifunctional camera systems

Appearance-based methods require relatively less computational cost and less complex hardware, but their recognition of gestures is discontinuous and cannot achieve accurate tracking and recognition of gestures

Images