The invention discloses a self-learning human body behavior recognition and anomaly detection method, which comprises the following steps of: generating a salient region vector in a monitoring video,and updating a salient region in a timing self-learning manner; for the same salient region, calculating a state feature vector and an action value of the current frame according to the human body behavior state of the current frame, a human body behavior state prediction value and an award value after the current frame is transferred to the next frame, and an action in the state; executing the current target network, calculating the current human body behavior action value, and updating the target action network and the target value network; and after the network parameters converge or meet the maximum number of iterations, counting the weighted sum of the feedback reward value of the current action network and the human body behavior action value of the target value network within the time T to obtain a behavior abnormality level. The method disclosed by the invention has the advantages of low complexity, real-time performance, high detection efficiency and high detection accuracy.