The invention discloses a sweet pepper recognition and picking
sequence determination method based on multi-view three-dimensional reconstruction. Firstly,
point cloud data of a target fruit is obtained through multi-view three-dimensional reconstruction in combination with a plurality of views, so that
point cloud noise can be effectively reduced, and the influence of leaf shielding can be reduced; recognizing the obtained RGBD
point cloud information through an HSV
recognition algorithm, and filtering out non-red sweet pepper fruit point cloud; solving the number of point clouds of the sweet pepper fruits and the number of point clouds in each point cloud of the sweet pepper fruits through Euclidean clustering; and finally, the recognized fruit point cloud clusters, namely the sweet pepper fruit point cloud, are processed, the size of each fruit point cloud cluster, the grabbing difficulty degree and the distance from the optimal grabbing point in each fruit point cloud cluster to the
tail end of the mechanical arm are obtained, and the optimal grabbing sequence of the fruits is obtained through a multi-target optimization
algorithm. According to the method, information in multiple aspects is combined to determine how the picking
robot grabs the recognized fruits, the picking sequence of the fruits is determined, the grabbing success rate of the picking
robot can be increased. Meanwhile,
energy consumption of the mechanical arm is reduced, the picking success rate is increased, and the fruit damage rate is reduced.