论文标题

使用嘈杂的频道模型中的文档接地对话系统中可控的事实

Controllable Factuality in Document-Grounded Dialog Systems Using a Noisy Channel Model

论文作者

Daheim, Nico, Thulke, David, Dugast, Christian, Ney, Hermann

论文摘要

在这项工作中,我们为对话框中的文档响应生成提供了一个模型,该模型根据贝叶斯定理分解为两个组件。一个组成部分是传统的未接地响应生成模型,而另一组件基于对话框上下文和生成的响应对接地文档的重建进行建模。我们提出了不同的近似解码方案,并在多个开放域和面向任务的对话框数据集上评估了我们的方法。我们的实验表明,与基线模型相比,该模型在自动事实指标方面更为事实。此外,我们概述了组件之间如何引入缩放因子,可以控制模型输出中的事实和流利度之间的权衡。最后,我们将我们的方法比较了最近提出的方法,以控制接地对话,CTRL(ARXIV:2107.06963)中的事实,并表明两种方法都可以合并以实现其他改进。

In this work, we present a model for document-grounded response generation in dialog that is decomposed into two components according to Bayes theorem. One component is a traditional ungrounded response generation model and the other component models the reconstruction of the grounding document based on the dialog context and generated response. We propose different approximate decoding schemes and evaluate our approach on multiple open-domain and task-oriented document-grounded dialog datasets. Our experiments show that the model is more factual in terms of automatic factuality metrics than the baseline model. Furthermore, we outline how introducing scaling factors between the components allows for controlling the tradeoff between factuality and fluency in the model output. Finally, we compare our approach to a recently proposed method to control factuality in grounded dialog, CTRL (arXiv:2107.06963), and show that both approaches can be combined to achieve additional improvements.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源