The invention discloses a hole making and riveting quality control method and device based on machine vision. The device can achieve shooting of a plane hole or a curved hole in a workpiece through a CCD camera through the linkage of a first sliding table, a second sliding table, a first sliding block, a second sliding block and a connecting rod, the diameter and the roundness of the hole are detected through gray processing, median filtering, threshold segmentation, edge extraction, least square fitting and other operations, the structure is stable, the automation degree is high, operation is easy, the detection precision is high, and distortion can be avoided when the curved hole is detected. The method is based on an engineering calculation method, a relation model of a pressing riveting force and the size of an upset head is obtained under the condition that the influence of friction force of the end face of the upset head on normal stress is considered, a process monitoring riveter is arranged for workers to indirectly control the size of the upset head through the pressing riveting force, the pressing riveting quality control precision is high, timely discovery and timely remedy can be achieved, error accumulation is avoided, and therefore, the riveting quality and efficiency are improved.