The present application relates to a voice interaction device evaluation method, system, computer device and storage medium. The method includes: obtaining test information of a test dimension, wherein the test dimension is the type of function to be tested of a device loaded with voice interaction; playing a test voice corresponding to the test information to the device to be tested, and receiving the test voice from the device to be tested. The test response information, wherein the device under test is a device loaded with voice interaction to be tested; according to the test response information, the device evaluation value of the device under test is obtained. The method can be used to evaluate the device according to the function and use effect of the device to be tested, and the operability is strong, and the function and use effect of the device can be easily known, and it is easy to understand the function to be tested, save time, and improve efficiency. At the same time, an instructive evaluation can be generated to guide the device under test to improve its performance.