The invention discloses an impurity removal method of oil-based neodymium iron boron oil sludge wastes, and belongs to the technical field of recycling of rare earth permanent magnetic materials. Aiming at the problems of high content of carbon, hydrogen and oxygen, fine powders, extremely easy agglomeration of the powders and the like in oil-based slicing oil sludge wastes, an organic solvent, aninorganic solvent, a surfactant and an acid solution are used for cleaning the inorganic impurities oil sludge wastes, organic impurities, oxides and inorganic impurities in the oil sludge are removed by combining an ultrasonic and magnetic separation method, and regenerated neodymium iron boron powders which are low in carbon, hydrogen and oxygen content, good in performance and relatively highin purity are obtained. The method has the significant characteristics and advantages that, 1) the process is short, and the oil sludge is used as raw materials to directly obtain the regenerated neodymium iron boron powders; 2), the efficiency is high, and the performance of the regenerated powders is good, and the purity of the regenerated powders is relatively high; 3) the cost is low, and theconsumed energy in the process flow is less and the used raw materials and reagents are easy to obtain; and 4) the process is simple and easy to operate, and the repeatability is good.