论文标题
使用Euler神经网络学习三段论
Learning Syllogism with Euler Neural-Networks
论文作者
论文摘要
传统的神经网络将所有内容表示为矢量,并能够在一定程度上近似逻辑推理的子集。由于基本的逻辑关系通过区域之间的拓扑关系更好地表示,因此我们提出了一个新颖的神经网络,将所有内容表示为球,并且能够将拓扑配置作为欧拉图学习。因此,欧拉神经网络(ENN)的名字就是这样。球的中心向量是可以继承传统神经网络的代表力的向量。 ENN区分球之间的四个空间状态,即断开连接,部分重叠,是一部分,是逆部分。在每个状态内,为有效的推理定义了理想值。一种具有六个整流空间单元(RESU)的新型后传出算法可以优化代表逻辑前提的欧拉图,从中可以从中推导出逻辑结论。与传统的神经网络相反,ENN可以精确地代表三24个三段论的结构。创建了两个大型数据集:一个从WordNet-3.0中提取的一个涵盖了所有类型的三段论推理,另一个从DBPEDIA提取了所有家庭关系。实验结果批准了ENN在逻辑表示和推理中的卓越力量。可应要求提供数据集和源代码。
Traditional neural networks represent everything as a vector, and are able to approximate a subset of logical reasoning to a certain degree. As basic logic relations are better represented by topological relations between regions, we propose a novel neural network that represents everything as a ball and is able to learn topological configuration as an Euler diagram. So comes the name Euler Neural-Network (ENN). The central vector of a ball is a vector that can inherit representation power of traditional neural network. ENN distinguishes four spatial statuses between balls, namely, being disconnected, being partially overlapped, being part of, being inverse part of. Within each status, ideal values are defined for efficient reasoning. A novel back-propagation algorithm with six Rectified Spatial Units (ReSU) can optimize an Euler diagram representing logical premises, from which logical conclusion can be deduced. In contrast to traditional neural network, ENN can precisely represent all 24 different structures of Syllogism. Two large datasets are created: one extracted from WordNet-3.0 covers all types of Syllogism reasoning, the other extracted all family relations from DBpedia. Experiment results approve the superior power of ENN in logical representation and reasoning. Datasets and source code are available upon request.