The invention discloses a natural image
character recognition method and
system based on a deep neural network. The method comprises the steps of
image acquisition and fusion, character positioning,
character recognition and rationality judgment. The
system comprises an
image acquisition and fusion unit, a character detection unit, a
character recognition unit and a rationality judgment unit. Thecharacter detection unit automatically locates the region of the characters in the image through the character
detector obtained by training. The character recognition unit firstly classifies the characters into three categories: Chinese, English and numbers through the constructed multi-interface CNN and then recognizes the characters of the corresponding category. The rationality judgment unit fuses the output result of the recognition unit with the prediction result of the character-based LSTM model so as to improve the rationality of Chinese continuous character recognition. According to the natural image character recognition method and
system, the characters in the natural image can be intelligently recognized, and the core
processing model is composed of the deep neural network andcan simulate the
human brain to the maximum extent, and thus the robustness and the recognition accuracy are high.