论文标题

关于整合自我监督学习和元学习的效率

On the Efficiency of Integrating Self-supervised Learning and Meta-learning for User-defined Few-shot Keyword Spotting

论文作者

Kao, Wei-Tsung, Wu, Yuan-Kuei, Chen, Chia-Ping, Chen, Zhi-Sheng, Tsai, Yu-Pao, Lee, Hung-Yi

论文摘要

用户定义的关键字发现是检测用户定义的新口语术语的任务。这可以看作是一些射击学习问题,因为用户可以通过提供许多示例来定义其所需的关键字是不合理的。为了解决这个问题,以前的工作试图合并自我监督的学习模型或应用元学习算法。但是,目前尚不清楚自我监督的学习和元学习是否是互补的,两种方法的组合对于少数射击关键字发现最有效。在这项工作中,我们通过利用各种自学学习模型并将它们与各种元学习算法结合在一起,系统地研究了这些问题。我们的结果表明,休伯特与匹配网络相结合可以取得最佳成果,并且对几个示例的变化非常有力。

User-defined keyword spotting is a task to detect new spoken terms defined by users. This can be viewed as a few-shot learning problem since it is unreasonable for users to define their desired keywords by providing many examples. To solve this problem, previous works try to incorporate self-supervised learning models or apply meta-learning algorithms. But it is unclear whether self-supervised learning and meta-learning are complementary and which combination of the two types of approaches is most effective for few-shot keyword discovery. In this work, we systematically study these questions by utilizing various self-supervised learning models and combining them with a wide variety of meta-learning algorithms. Our result shows that HuBERT combined with Matching network achieves the best result and is robust to the changes of few-shot examples.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源