论文标题

用于嘈杂知识转移的双校正适应网络

Dual-Correction Adaptation Network for Noisy Knowledge Transfer

论文作者

Wang, Yunyun, Zheng, Weiwen, Chen, Songcan

论文摘要

以前的无监督域适应性(UDA)方法旨在通过从富含标签的源域到未标记的目标域的单向知识传递来促进目标学习,而到目前为止,尚未共同考虑其从目标到源的反向适应性。实际上,在某些真正的教学实践中,老师可以帮助学生学习,同时在某种程度上从学生那里获得晋升,这激发了我们探索域之间的双向知识转移,因此在本文中提出了双重校正适应网络(DUALCAN)。但是,由于跨域的不对称标记知识,从未标记的目标转移到标记的来源会带来比共同的源与目标对应物更加困难的挑战。首先,由源预测的目标伪标记通常涉及模型偏差引起的噪音,因此在反向适应中,它们可能会损害源绩效并带来负目标对源传输。其次,源域通常包含先天噪声,这将不可避免地加剧目标噪声,从而导致跨域的噪声扩增。为此,我们进一步引入了噪声识别和校正(NIC)模块,以纠正和回收两个域中的噪声。据我们所知,这是对嘈杂UDA的双向适应的首次幼稚尝试,并且自然适用于无噪声UDA。给出理论理由以说明我们的直觉的理性。经验结果证实了Dualcan的有效性,其性能在最先进的工作中取得了显着提高,尤其是对于极端嘈杂的任务(例如,PW-> PR和PR-> RW的办公室家庭)的有效性。

Previous unsupervised domain adaptation (UDA) methods aim to promote target learning via a single-directional knowledge transfer from label-rich source domain to unlabeled target domain, while its reverse adaption from target to source has not jointly been considered yet so far. In fact, in some real teaching practice, a teacher helps students learn while also gets promotion from students to some extent, which inspires us to explore a dual-directional knowledge transfer between domains, and thus propose a Dual-Correction Adaptation Network (DualCAN) in this paper. However, due to the asymmetrical label knowledge across domains, transfer from unlabeled target to labeled source poses a more difficult challenge than the common source-to-target counterpart. First, the target pseudo-labels predicted by source commonly involve noises due to model bias, hence in the reverse adaptation, they may hurt the source performance and bring a negative target-to-source transfer. Secondly, source domain usually contains innate noises, which will inevitably aggravate the target noises, leading to noise amplification across domains. To this end, we further introduce a Noise Identification and Correction (NIC) module to correct and recycle noises in both domains. To our best knowledge, this is the first naive attempt of dual-directional adaptation for noisy UDA, and naturally applicable to noise-free UDA. A theory justification is given to state the rationality of our intuition. Empirical results confirm the effectiveness of DualCAN with remarkable performance gains over state-of-the-arts, particularly for extreme noisy tasks (e.g., ~+ 15% on Pw->Pr and Pr->Rw of Office-Home).

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源