The invention discloses a grinding device with a grinding dust removing function for derusting the surface of a steel pipe. The device comprises two supporting seats, a driving mechanism, a hollow shaft, a plurality of grinding mechanisms, an adjusting mechanism and a grinding dust removing mechanism, the hollow shaft is rotatably arranged on the two supporting seats, the driving mechanism drivesthe hollow shaft to rotate, an adjusting mechanism is arranged on the peripheral surface of the rear end of the hollow shaft, a grinding mechanism is arranged on the adjusting mechanism, the grindingmechanism comprises a constant-force spring, a spring box, a shaft body, a gear, a rack, a sliding rail, a sliding seat, a mounting seat and a grinding head, a spring box and a sliding rail are arranged on the mounting base, a rotatable shaft body is arranged on the spring box, and the spring box is internally provided with a constant-force spring which is fixedly connected with the spring box andthe shaft body respectively. Compared with the prior art, the device has the advantages that the grinding uniformity is good, the derusting effect is good, the application range is wide, and the working efficiency is improved.