论文标题
使用参数修剪的数据集蒸馏
Dataset Distillation Using Parameter Pruning
论文作者
论文摘要
在这项研究中,我们提出了一种基于参数修剪的新型数据集蒸馏方法。所提出的方法可以通过在蒸馏过程中修剪难以匹配的参数来综合更健壮的蒸馏数据集并提高蒸馏性能。两个基准数据集的实验结果显示了该方法的优越性。
In this study, we propose a novel dataset distillation method based on parameter pruning. The proposed method can synthesize more robust distilled datasets and improve distillation performance by pruning difficult-to-match parameters during the distillation process. Experimental results on two benchmark datasets show the superiority of the proposed method.