The invention discloses an image three-dimensional representation method based on parallax hierarchical segmentation, and a system. Firstly, parallax information of 3D images are obtained by utilizing an existing parallax estimation algorithm; secondly, depth direction quantized intervals are determined according to stereoscopic visual acuity of the visual sense and complexities of image contents in the depth direction, and different depth plane segmentation methods are established; a parallax map is segmented relying on depth intervals according to the quantized intervals determined by various depth planes, and image segmentation templates corresponding to the various depth planes are formed; and, finally, an original image is segmented by utilizing the image segmentation templates of the various depth planes, image contents obtained through segmentation are located on the corresponding depth planes and are redrawn on various planes of the corresponding depth spaces, and a depth space distributed three-dimensional representation manner corresponding to the image is formed. The original image is segmented based on the parallax information of the 3D images, and inner depth information of image objects in various depth intervals in the 3D images is significantly and visually representated.