The invention discloses a mental stress analysis system based on the heart sound HRV theory. According to the mental stress analysis system, the heart rate variability is taken as the evaluation index of the stress level, based on the influences of the heart sound HRV analysis on the mental stress and the fatigue degree, the heart rate variability and the heart sound analysis are combined, and the mental stress analysis system capable of accurately measuring human mental stress is provided. For the system, a wireless heart sound collector is adopted, so that the long-time collection of heart sounds is realized, and the time for collecting the heart sounds needs to be maintained for 3-5 min; in order to rapidly and effectively extract the heart rate variability from heart sound signals, the adaptive algorithm for extracting HRV from the heart sounds is provided; through time-domain and frequency-domain analysis on HRV, 12 time-domain indexes and frequency-domain indexes are obtained, and the graphical representation is carried out on the 8 main characteristic indexes. Compared with the electrocardiographic mental stress analysis meter, the mental stress analysis system provided by the invention has the advantages that the use is convenient, the operation is simple, the functions are complete, especially, the cost is low, and the mental stress analysis system is suitable for being popularized and used in primary medical units, families, schools and individuals.