Violin supplementary learning experience system based on augmented reality (AR)

Abstract

The invention discloses a violin supplementary learning experience system based on augmented reality (AR). The system comprises an image acquisition unit, an image analysis unit, a storage unit, an operation unit, a processing unit and a display unit, wherein the image acquisition unit is used for acquiring a video image that a current user holds a violin fingerboard in real time; the video image also contains fingernails of a hand holding a violin; the image analysis unit is used for analyzing an image of the current violin, identifying regions of a counter and a finger plate of the current violin and identifying and locating four strings of the violin; the storage unit stores a music score as well as virtual animation elements for finger pressing action and fiddle bow operation, which correspond to a syllable and a musical note; the processing unit is used for displaying on the display unit according to counter and finger plate regions of the current violin and the four located strings of the violin and setting a region for displaying the animation elements; and the processing unit calls a corresponding music score in the storage unit and the virtual animation elements for the corresponding pressing action and fiddle bow operation and displaying the virtual animation elements in the display region.

Description

technical field [0001] The invention relates to a violin auxiliary learning experience system based on AR augmented reality. Background technique [0002] It has always required a lot of repetitive practice to master the violin, a very difficult instrument to play. In the learning process, the music teacher needs to supervise the students' practice in real time. At the same time, the students need to start from the basic skills and repeat a lot of continuous training until they form muscle memory before they can truly acquire the violin playing skills. The whole learning process is extremely long And boring, requires great perseverance and habit to complete. This high threshold discourages many music lovers, especially violin lovers, which greatly hinders the popularization of violin and affects the popularization of comprehensive music literacy. [0003] AR enhanced display technology can obtain the information of surrounding targets through Internet technology within the...

AI Technical Summary

Problems solved by technology

[0004] Since the performance of violin and other musical instruments has a relatively fixed method, mainly two parts are the method of moving the bow and pressing the strings with the fingers holding the violin. It is necessary to complete the core finger pressing and string running actions, which brings the possibility of standardization of actions. If AR enhanced display technology is used to give corresponding prompts to the score, it is expected to get rid of the traditional learning process of playing and reduce the burden of violin playing. threshold

Images