The invention discloses a panorama video interactive transmission method, server and client end, and is used for guaranteeing the panorama video quality in the interactive processes such as zoom or visual angle free transforming. The method of a client end side comprises the steps that an interest area in a previous period panorama video is confirmed by the client end, a working state of the client end is confirmed according to a touch-controlled action, an edge region, a general region and a non-interest region of the panorama video are confirmed according to the interest area and the working state, and then according to the interest area, the edge region, the general region and the non-interest region, video parameters of to-be-obtained slices corresponding to each partial video contained in the panorama video are confirmed, the confirmed video parameters of the to-be-obtained slices corresponding to each partial video are brought in a slice request and sent to the server, returned slices of the server is received according to the slice request, finally received slices are combined and rendered in the next period, and the panorama video is formed.