论文标题

关系神经机器

Relational Neural Machines

论文作者

Marra, Giuseppe, Diligenti, Michelangelo, Giannini, Francesco, Gori, Marco, Maggini, Marco

论文摘要

已经证明,在有大量培训数据的几项任务中,深度学习已被证明可以取得令人印象深刻的结果。但是,深度学习仅关注预测的准确性,忽略了导致决策的推理过程,这是生命至关重要的应用中的主要问题。概率逻辑推理允许利用统计规律性和特定领域专业知识来在不确定性下执行推理,但是其与处理感官数据的层的可扩展性和脆性集成极大地限制了其应用程序。由于这些原因,将深层体系结构和概率逻辑推理结合起来是朝着在复杂环境中运行的智能代理的基本目标。本文提出了关系神经机器,这是一个新颖的框架,允许共同训练学习者的参数和第一个基于逻辑的推理者的参数。在纯粹的亚符号学习的情况下,关系神经机能够从监督的数据中恢复经典学习,而在纯符号推理的情况下,马尔可夫逻辑网络,同时允许共同训练和推断混合学习任务。设计了适当的算法解决方案,以使学习和推论在大规模问题中可进行。实验在不同的关系任务中显示出令人鼓舞的结果。

Deep learning has been shown to achieve impressive results in several tasks where a large amount of training data is available. However, deep learning solely focuses on the accuracy of the predictions, neglecting the reasoning process leading to a decision, which is a major issue in life-critical applications. Probabilistic logic reasoning allows to exploit both statistical regularities and specific domain expertise to perform reasoning under uncertainty, but its scalability and brittle integration with the layers processing the sensory data have greatly limited its applications. For these reasons, combining deep architectures and probabilistic logic reasoning is a fundamental goal towards the development of intelligent agents operating in complex environments. This paper presents Relational Neural Machines, a novel framework allowing to jointly train the parameters of the learners and of a First--Order Logic based reasoner. A Relational Neural Machine is able to recover both classical learning from supervised data in case of pure sub-symbolic learning, and Markov Logic Networks in case of pure symbolic reasoning, while allowing to jointly train and perform inference in hybrid learning tasks. Proper algorithmic solutions are devised to make learning and inference tractable in large-scale problems. The experiments show promising results in different relational tasks.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源