论文标题

图形神经网络可以计数子结构吗?

Can Graph Neural Networks Count Substructures?

论文作者

Chen, Zhengdao, Chen, Lei, Villar, Soledad, Bruna, Joan

论文摘要

检测和计算图中某些子结构的能力对于解决图形结构数据的许多任务很重要,尤其是在计算化学和生物学以及社交网络分析的情况下。受此启发的启发,我们建议通过计算归因的图形子结构的能力来研究图神经网络(GNN)的表达能力,从而扩展了在图同构测试和功能近似中检查其功能的最新作品。我们区分了两种类型的子结构计数:引起的纸张计数和子图表,并为流行的GNN体系结构建立正面和负面答案。具体而言,我们证明传递神经网络(MPNN),2-Weisfeiler-Lehman(2-WL)(2-WL)和2个不变的图形网络(2个符号)无法执行由3个或更多节点组成的子结构的诱导材料计数,而它们可以执行由3个或更多节点组成的子结构,而它们可以执行由3个或更多节点组成的子结构。作为中介步骤,我们证明了2-WL和2-igns等于区分非同构图,部分回答了Maron等人中提出的一个开放问题。 (2019)。我们还证明了K-WL和K-igns以及具有有限数量的迭代次数的K-WL的阳性结果。然后,我们进行支持的实验,以支持MPNN和2个符号的理论结果。此外,由墨菲等人的子结构计数和启发。 (2019年),我们提出了局部关系池模型,并证明它不仅对子结构计数有效,而且还能够在分子预测任务上实现竞争性能。

The ability to detect and count certain substructures in graphs is important for solving many tasks on graph-structured data, especially in the contexts of computational chemistry and biology as well as social network analysis. Inspired by this, we propose to study the expressive power of graph neural networks (GNNs) via their ability to count attributed graph substructures, extending recent works that examine their power in graph isomorphism testing and function approximation. We distinguish between two types of substructure counting: induced-subgraph-count and subgraph-count, and establish both positive and negative answers for popular GNN architectures. Specifically, we prove that Message Passing Neural Networks (MPNNs), 2-Weisfeiler-Lehman (2-WL) and 2-Invariant Graph Networks (2-IGNs) cannot perform induced-subgraph-count of substructures consisting of 3 or more nodes, while they can perform subgraph-count of star-shaped substructures. As an intermediary step, we prove that 2-WL and 2-IGNs are equivalent in distinguishing non-isomorphic graphs, partly answering an open problem raised in Maron et al. (2019). We also prove positive results for k-WL and k-IGNs as well as negative results for k-WL with a finite number of iterations. We then conduct experiments that support the theoretical results for MPNNs and 2-IGNs. Moreover, motivated by substructure counting and inspired by Murphy et al. (2019), we propose the Local Relational Pooling model and demonstrate that it is not only effective for substructure counting but also able to achieve competitive performance on molecular prediction tasks.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源