The invention relates to an on-duty person violation behavior detection method and system, belongs to the technical field of intelligent video analysis, and solves the problems of low efficiency, highcost and low recognition accuracy of an existing detection method. The method comprises the following steps: constructing a target detection network model, and training by using a data set; acquiringmultiple paths of videos at different angles in the same scene in real time, carrying out multi-target detection and tracking by utilizing a trained target detection network model and a target tracking algorithm, acquiring personnel information in each path of videos, carrying out integration processing, and judging whether behaviors of personnel on duty are abnormal or not. According to the invention, an environment camera video is used as an input video source for intelligent video analysis; the system supports multi-channel video source input and fusion analysis, greatly improves the recognition accuracy of illegal behaviors through deep learning and data modeling means, and achieves the real-time and accurate monitoring of the duty behaviors of personnel on duty in scenes such as a monitoring center, a duty room, a command center and the like.