论文标题
触碰？演讲？还是触摸和演讲？研究用于视觉网络探索和分析的多模式相互作用
Touch? Speech? or Touch and Speech? Investigating Multimodal Interaction for Visual Network Exploration and Analysis
论文作者
论文摘要
由于用户需要与视图中的元素（例如节点，链接）和接口控件（例如，滑块，下拉菜单）互动，交互在视觉网络探索过程中起着至关重要的作用。特别是随着网络的大小和复杂性的增长，交互式显示支持多模式输入（例如触摸，语音，笔，凝视）具有促进视觉网络探索和分析过程中流体相互作用的潜力。尽管与网络可视化的多模式互动似乎是一个有前途的想法，但仍然存在许多开放问题。例如，用户实际上是否更喜欢多模式输入而不是单峰输入，如果是，为什么？它是否使他们能够更自然地互动，或者具有多种输入模式混淆用户？为了回答这样的问题，我们在网络可视化工具的背景下进行了定性用户研究，将基于语音和触摸的单峰接口与将两者结合的多模式接口进行了比较。我们的结果证实，参与者强烈更喜欢多模式输入，而不是单峰输入归因于以下方面的偏爱：1）表达自由，2）言语和触摸的互补性质，以及3）两种模式的结合提供的综合相互作用。我们还描述了为执行通用网络可视化操作的参与者所采用的交互模式，并突出了未来的多模式网络可视化系统的主题。
Interaction plays a vital role during visual network exploration as users need to engage with both elements in the view (e.g., nodes, links) and interface controls (e.g., sliders, dropdown menus). Particularly as the size and complexity of a network grow, interactive displays supporting multimodal input (e.g., touch, speech, pen, gaze) exhibit the potential to facilitate fluid interaction during visual network exploration and analysis. While multimodal interaction with network visualization seems like a promising idea, many open questions remain. For instance, do users actually prefer multimodal input over unimodal input, and if so, why? Does it enable them to interact more naturally, or does having multiple modes of input confuse users? To answer such questions, we conducted a qualitative user study in the context of a network visualization tool, comparing speech- and touch-based unimodal interfaces to a multimodal interface combining the two. Our results confirm that participants strongly prefer multimodal input over unimodal input attributing their preference to: 1) the freedom of expression, 2) the complementary nature of speech and touch, and 3) integrated interactions afforded by the combination of the two modalities. We also describe the interaction patterns participants employed to perform common network visualization operations and highlight themes for future multimodal network visualization systems to consider.
