论文标题
交互式彩虹评分：以视觉为中心的多模式长笛辅导系统
Interactive Rainbow Score: A Visual-centered Multimodal Flute Tutoring System
论文作者
论文摘要
学习演奏乐器是本质上的多模式，我们已经看到在音乐游戏和计算机辅助音乐辅导系统中应用视觉和触觉反馈的趋势。但是，大多数当前系统仍被设计为掌握单个音乐片段。目前尚不清楚学到的技能如何推广到新作品。我们旨在探讨这个问题。在这项研究中，我们贡献了交互式彩虹评分，这是一种交互式视觉系统，可提高视觉播放的学习，这是读音乐并将视觉表示形式映射到性能动作的一般音乐技能。交互式彩虹得分的关键设计是将音高（以及相应的动作）与有色符号相关联，并通过实时互动将这种关联进一步增强。定量结果表明，互动特征平均将学习效率提高31.1％。进一步的分析表明，在早期学习中运用相互作用至关重要。
Learning to play an instrument is intrinsically multimodal, and we have seen a trend of applying visual and haptic feedback in music games and computer-aided music tutoring systems. However, most current systems are still designed to master individual pieces of music; it is unclear how well the learned skills can be generalized to new pieces. We aim to explore this question. In this study, we contribute Interactive Rainbow Score, an interactive visual system to boost the learning of sight-playing, the general musical skill to read music and map the visual representations to performance motions. The key design of Interactive Rainbow Score is to associate pitches (and the corresponding motions) with colored notation and further strengthen such association via real-time interactions. Quantitative results show that the interactive feature on average increases the learning efficiency by 31.1%. Further analysis indicates that it is critical to apply the interaction in the early period of learning.
