论文标题
符合音乐表达的面部动作
Sonification of Facial Actions for Musical Expression
论文作者
论文摘要
面孔在社会互动和非语言交流中的核心作用表明，我们探索面部动作作为音乐表达的一种手段。本文介绍了一种利用面部检测和光学流动算法的新型系统的设计，实现和初步研究，以特定于地形的方式将面部运动与声音合成相关联。我们在各种手势映射和应用程序中报告了我们的经验，并描述了使用该系统进行音乐性能的初步实验。
The central role of the face in social interaction and non-verbal communication suggests we explore facial action as a means of musical expression. This paper presents the design, implementation, and preliminary studies of a novel system utilizing face detection and optic flow algorithms to associate facial movements with sound synthesis in a topographically specific fashion. We report on our experience with various gesture-to-sound mappings and applications, and describe our preliminary experiments at musical performance using the system.
