The invention discloses a television channel background recognition method which includes that a television station caption is intercepted according to time when a user switches channels, an initial television station caption template is established, television station caption templates in a television station caption base are updated dynamically, image analysis is conducted on television station captions transmitted by a client, simultaneously television station caption recognition is conducted, the television station captions are compared with the television station caption templates, and the television station captions which succeed in comparison are fed back to a data base and used as accordance of a television watching behavior habit of a user. Due to the fact that the television station captions of switched channels are intercepted when the user switches the channels and are compared with the dynamically updated television station caption templates in the television station caption base, calculation time is greatly saved, effects of a server on overall performance are avoided, television channel recognition is quickened, matching rate of a single television station caption is high, television channel recognition accuracy is improved, and the television station captions are suitable for being used as the accordance of the television watching behavior habit of the user.