论文标题

看到声音,听力形状:一项游戏的研究,用于评估声音张口

Seeing Sounds, Hearing Shapes: a gamified study to evaluate sound-sketches

论文作者

Löbbers, Sebastian, Fazekas, György

论文摘要

声形关联是听觉和视觉域之间的跨模式关联子集,主要是在将一组有目的精心制作的形状与声音匹配的背景下进行的。最近的研究探索了人类如何通过自由形式的草图来代表声音,以及如何将图形草图输入用于声音生产。在本文中,在两次在线展览活动中与82名参与者进行的游戏研究中研究了通过这些自由形式草图传达声音特征的潜力。结果表明,参与者设法以比随机基线表明的更高的速度识别声音,但是在视觉上很难编码细微差异的音差差异。

Sound-shape associations, a subset of cross-modal associations between the auditory and visual domain, have been studied mainly in the context of matching a set of purposefully crafted shapes to sounds. Recent studies have explored how humans represent sound through free-form sketching and how a graphical sketch input could be used for sound production. In this paper, the potential of communicating sound characteristics through these free-form sketches is investigated in a gamified study that was conducted with eighty-two participants at two online exhibition events. The results show that participants managed to recognise sounds at a higher rate than the random baseline would suggest, however it appeared difficult to visually encode nuanced timbral differences.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源