论文标题
关于WVA结构问题的实证研究
Empirical investigations on WVA structural issues
论文作者
论文摘要
在本文中，我们希望介绍有关克服神经网络中灾难性遗忘方法的某些问题的经验验证结果。首先，在引言中，我们将尝试详细描述灾难性遗忘的问题，以及为那些尚不熟悉该主题的人克服它的方法。然后，我们将讨论我们在先前论文中提出的WVA方法的本质和局限性。此外，我们将介绍将WVA方法应用于梯度或权重的优化步骤，选择此方法中的最佳衰减功能的问题，并根据神经网络的顺序训练中的任务数量选择该方法的最佳超参数。
In this paper we want to present the results of empirical verification of some issues concerning the methods for overcoming catastrophic forgetting in neural networks. First, in the introduction, we will try to describe in detail the problem of catastrophic forgetting and methods for overcoming it for those who are not yet familiar with this topic. Then we will discuss the essence and limitations of the WVA method which we presented in previous papers. Further, we will touch upon the issues of applying the WVA method to gradients or optimization steps of weights, choosing the optimal attenuation function in this method, as well as choosing the optimal hyper-parameters of the method depending on the number of tasks in sequential training of neural networks.
