The invention provides a vehicle number and traffic flow speed based highway congestion detection method. The method comprises the steps of making statistics on a vehicle number; calculating a traffic flow speed; and according to the vehicle number and the traffic flow speed, judging a highway congestion state. According to the method, non vehicle characteristic points are not generated, most errors can be avoided, and only a certain vehicle (less than or equal to a threshold N) region is selected, so that the calculation amount is greatly reduced; and based on a TIDM8127 camera platform, the test rate of a 352x288 cif video reaches 15fps (frame per second), so that real-time accurate detection is realized.