A language translation method, system, program and handheld terminal based on real-time communication. The method includes: establishing a communication link with the opposite end, and also including: when establishing the communication link, prompting whether to enter the language translation mode, and determining whether to enter the language translation mode according to the user's choice, and then selecting the language translation type, so The above language translation types include at least the manual selection mode and the AI automatic recognition mode. The manual selection mode is that after the communication link is established and it is determined to be in the language translation mode, the language translation is performed according to the user's choice, and then converted into voice through the voice module or through The display module is converted into text; the AI automatic recognition mode is, when the communication link is established and the language translation mode is confirmed, the language used by both parties in the communication is identified, and the language and / or dialect used by the other end is converted to that used by the local end The language and / or standard language are then converted into sound by the voice module and / or converted into text by the display module. The invention can translate the speech language and / or dialect used by the opposite terminal into a language that the local user can understand, so that the communication is very convenient.