The invention discloses a video encoding and decoding system based on image inpainting predication in the technical field of video processing. The system comprises a macroblock partitioning module, a macroblock predication module, a residual encoding module, a residual decoding module and a macroblock rebuilding module, wherein the macroblock predication module comprises an intra-frame predication submodule, an inter-frame predication submodule, an image impainting predication submodule and a mode selection submodule. In the invention, on the basis of a H.264 mixed video encoding standard system, the image inpainting predication submodule is added, which makes up the deficiency of the traditional video encoding and decoding system; and compared with the traditional video encoding and decoding system H.264, the video encoding efficiency is improved and the system has better adaptability and error resistance.