Learning to play and perform violin is a complex task, that requires high conscious control and coordination for the player. In this paper, our aim is to understand which technology and motion features can be used to efficiently and effectively distinguish a professional performance from a student one trading off intrusiveness and accuracy. We collected and made freely available a dataset consisting of Motion Capture (MOCAP), Electromyography, Accelerometer, and Gyroscope (MYO), and Microsoft Kinect (KINECT) recordings of different violinists with different skills performing different exercises covering different pedagogical and technical aspects. We then engineered peculiar features starting from the different sources (MOCAP, MYO, and KINECT) and trained a data-driven classifier to distinguish between two different levels of violinist experience, namely Beginners and Experts. We then studied how much accuracy we loose when, instead of using MOCAP data (the most intrusive and costly technology), MYO data (which is less intrusive than MOCAP), or KINECT data (the less intrusive technology) are exploited. In accordance with the hierarchy present in the dataset, we study two different scenarios: extrapolation with respect to other exercises and violinists. Furthermore, we study which features are the most predictive of the quality of a violinist to corroborate the significance of the results. Results, both in terms of accuracy and insight into the cognitive problem, support the proposal and the use of the presented technique as an effective tool for students to monitor and enhance their home study and practice.

https://doi.org/10.1007/978-3-030-85099-9_30

D’Amato, V., Volta, E., Oneto, L., Volpe, G., Camurri, A., Anguita, D. (2021). Accuracy and Intrusiveness in Data-Driven Violin Players Skill Levels Prediction: MOCAP Against MYO Against KINECT. In: Rojas, I., Joya, G., Català, A. (eds) Advances in Computational Intelligence. IWANN 2021. Lecture Notes in Computer Science(), vol 12862. Springer, Cham

Vincenzo DAmato DAmato

Università di Genova