The invention provides an image stitching method and apparatus. The image stitching method includes the steps: according to the deviation values of corresponding pixel points in a first overlapped area and a second overlapped area, the color difference value and the edge difference value, obtained through pre-calculation, of the corresponding pixel points in the first overlapped area and the second overlapped area, constructing a difference matrix, wherein as the deviation values of the corresponding pixel points are the main characteristic for distinguishing a close-range object and a distant view object, the deviation value corresponding to the distant view object is smaller and the deviation value corresponding to the close-range object is greater. Besides, according to the difference matrix, when the first overlapped area is stitched with the second overlapped area, the selected stitching seam is relatively smaller in the difference value, and when the different value is smaller, the corresponding deviation value is smaller too. Therefore, at the moment, the optimum stitching seam is formed at the distant view object in the image and is not formed at the close-range object in the image, so that the stitching effect is relatively more nature.