论文标题
分类:使用分子可视化的可伸缩纪录片
Molecumentary: Scalable Narrated Documentaries Using Molecular Visualization
论文作者
论文摘要
我们提出了一种使用实时科学可视化生产文献式内容的方法。我们产生分子纪录,即具有分子生物学结构模型的分子纪录片。我们采用可扩展的方法,而不是刚性的传统生产管道。我们的方法是由互动科学可视化的快速演变所激发的,这在科学传播中表现出巨大的潜力。但是,如果没有某种形式的解释或指导,新手和外行者通常会发现很难从可视化本身中获得见解。我们使用言语渠道整合了此类知识,并沿着引人入胜的视觉呈现提供。为了实现分子的综合,我们沿两个主要的生产步骤提供了技术解决方案:1)准备故事结构; 2)将故事变成具体的叙事。第一步,将来自异质资源的模型的信息汇编为故事图。本地知识与远程资源结合使用,以完成故事图并丰富最终结果。在第二步中,使用故事图合成了叙述,即序列呈现的故事元素。我们提出了一种使用自动摄像头和可视化过渡的方法,用于遍历故事图并生成虚拟游览的方法。由域专家撰写的文本使用文本到语音功能将其转变为口头表示,并作为评论提供。使用所描述的框架,我们将自动直通式直线构成模仿手动撰写的纪录片的描述。此外,我们演示了第二种情况:通过文本输入指导纪录片叙事。
We present a method for producing documentary-style content using real-time scientific visualization. We produce molecumentaries, i.e., molecular documentaries featuring structural models from molecular biology. We employ scalable methods instead of the rigid traditional production pipeline. Our method is motivated by the rapid evolution of interactive scientific visualization, which shows great potential in science dissemination. Without some form of explanation or guidance, however, novices and lay-persons often find it difficult to gain insights from the visualization itself. We integrate such knowledge using the verbal channel and provide it along an engaging visual presentation. To realize the synthesis of a molecumentary, we provide technical solutions along two major production steps: 1) preparing a story structure and 2) turning the story into a concrete narrative. In the first step, information about the model from heterogeneous sources is compiled into a story graph. Local knowledge is combined with remote sources to complete the story graph and enrich the final result. In the second step, a narrative, i.e., story elements presented in sequence, is synthesized using the story graph. We present a method for traversing the story graph and generating a virtual tour, using automated camera and visualization transitions. Texts written by domain experts are turned into verbal representations using text-to-speech functionality and provided as a commentary. Using the described framework we synthesize automatic fly-throughs with descriptions that mimic a manually authored documentary. Furthermore, we demonstrate a second scenario: guiding the documentary narrative by a textual input.