The invention discloses a machine vision based technical inspection and detection system and method for railway trains and belongs to the field of technical inspection on railway freight trains. According to the system, a light-duty rail, a portable moving device, a laser device, an optical image acquisition device and a wireless transmitting device are arranged outside a train inspection room; a wireless receiving device, a communication management server, a control server and a central server are arranged in the train inspection room. According to the system and the method, the automation and the intellectualization of technical inspection on the railway trains are achieved through controlling the portable moving device running on the light-duty rail, automatically acquiring image and video data on the bottom of a vehicle, carrying out data processing and outputting a current state of each component of the vehicle, an air testing test result and a repair processed result. According to the system and the method, manpower can be replaced for outdoor vehicle guarding operation, and the high quality, the accuracy and the reliability of train inspection can be guaranteed; the system and the method can adapt to various climatic conditions and natural environments and high-strength operation, so that the work efficiency of train inspection is increased.