论文标题
简直梦想:富丽堂皇的象征性语言理解
Just-DREAM-about-it: Figurative Language Understanding with DREAM-FLUTE
论文作者
论文摘要
比喻性语言(例如,“他像风一样飞行”)很难理解,因为很难仅凭表面形式传达了什么隐式信息。我们假设要很好地执行此任务,读者需要在心理上阐述所描述的场景,以确定语言的明智含义。我们提出了做到这一点的象征性语言理解系统,首先形成了前提和假设中描述的情况的“心理模型”,然后才做出一个需要/矛盾的决定并产生解释。 Dream-Flute使用现有场景详细模型Dream,用于构建其“心理模型”。在Giglang2022共享的任务评估中,Dream-Flute获得了(联合)的第一名(ACC@60 = 63.3%),并且可以通过合奏技术表现得更好,从而证明了这种方法的有效性。更普遍的是,这项工作表明,在预验证的语言模型中添加反射性组件可以提高其性能超出标准微调(ACC@60提高3.3%)。
Figurative language (e.g., "he flew like the wind") is challenging to understand, as it is hard to tell what implicit information is being conveyed from the surface form alone. We hypothesize that to perform this task well, the reader needs to mentally elaborate the scene being described to identify a sensible meaning of the language. We present DREAM-FLUTE, a figurative language understanding system that does this, first forming a "mental model" of situations described in a premise and hypothesis before making an entailment/contradiction decision and generating an explanation. DREAM-FLUTE uses an existing scene elaboration model, DREAM, for constructing its "mental model." In the FigLang2022 Shared Task evaluation, DREAM-FLUTE achieved (joint) first place (Acc@60=63.3%), and can perform even better with ensemble techniques, demonstrating the effectiveness of this approach. More generally, this work suggests that adding a reflective component to pretrained language models can improve their performance beyond standard fine-tuning (3.3% improvement in Acc@60).