论文标题
神经体系结构的半监督评估员
A Semi-Supervised Assessor of Neural Architectures
论文作者
论文摘要
神经体系结构搜索(NAS)旨在自动设计令人满意的性能的深层神经网络。其中,体系结构性能预测因子对于有效重视中间神经体系结构至关重要。但是,为了训练该预测因子,通常必须收集许多神经体系结构及其相应的实际表现。与以完全监督的方式优化的经典绩效预测变量相反,本文提出了对神经体系结构的半监督评估者。我们采用自动编码器来发现神经体系结构的有意义的表示。在搜索空间中以每个神经体系结构为个体实例,我们构建了一个图形来捕获其内在相似性,其中涉及标记和未标记的体系结构。引入了图形卷积神经网络,以根据学说的表示及其图形建模的关系来预测体系结构的性能。 NAS基准-101数据集的广泛实验结果表明,我们的方法能够大大减少所需的完全训练的架构以寻找有效的体系结构。
Neural architecture search (NAS) aims to automatically design deep neural networks of satisfactory performance. Wherein, architecture performance predictor is critical to efficiently value an intermediate neural architecture. But for the training of this predictor, a number of neural architectures and their corresponding real performance often have to be collected. In contrast with classical performance predictor optimized in a fully supervised way, this paper suggests a semi-supervised assessor of neural architectures. We employ an auto-encoder to discover meaningful representations of neural architectures. Taking each neural architecture as an individual instance in the search space, we construct a graph to capture their intrinsic similarities, where both labeled and unlabeled architectures are involved. A graph convolutional neural network is introduced to predict the performance of architectures based on the learned representations and their relation modeled by the graph. Extensive experimental results on the NAS-Benchmark-101 dataset demonstrated that our method is able to make a significant reduction on the required fully trained architectures for finding efficient architectures.