The invention discloses a VNC-based multi-screen
interaction method and device. The method includes: detecting screen change rate of a VNC
server desktop; if the screen change rate detected is larger than or equal to a first preset value, detecting window change rates of windows in the VNC
server desktop one by one; if the window change rates of the windows are larger than or equal to a second preset value; encoding the windows by H264,
JPEG or MJPEG; transmitting the windows encoded to a VNC viewer desktop. The second preset value is larger than the first preset value. The invention further discloses the VNC-based multi-screen
interaction device. Through the application of the VNC-based multi-screen
interaction method and device, the problem that the VNC
server desktop changes fast, for example, images obviously jam or slow down when video or
animation is played, is solved effectively.