论文标题
学习长尾顺序用户行为建模的可转移参数
Learning Transferrable Parameters for Long-tailed Sequential User Behavior Modeling
论文作者
论文摘要
顺序用户行为建模在以用户为导向的服务(例如产品购买,新闻供稿消费和在线广告)中起着至关重要的作用。顺序建模的性能在很大程度上取决于历史行为的规模和质量。但是,用户行为的数量固有地遵循了长尾分布,很少探索。在这项工作中,我们认为,专注于尾部用户可以通过从优化和特征角度学习可转移参数来带来更多的好处,并解决长时间问题。具体来说,我们提出了一个梯度对齐优化器,并采用对抗性训练计划,以促进知识从头部到尾部的转移。这种方法还可以处理新用户的冷启动问题。此外,它可以直接适应各种良好的顺序模型。与最先进的基线相比,在四个现实世界数据集上进行了广泛的实验验证了我们框架的优势。
Sequential user behavior modeling plays a crucial role in online user-oriented services, such as product purchasing, news feed consumption, and online advertising. The performance of sequential modeling heavily depends on the scale and quality of historical behaviors. However, the number of user behaviors inherently follows a long-tailed distribution, which has been seldom explored. In this work, we argue that focusing on tail users could bring more benefits and address the long tails issue by learning transferrable parameters from both optimization and feature perspectives. Specifically, we propose a gradient alignment optimizer and adopt an adversarial training scheme to facilitate knowledge transfer from the head to the tail. Such methods can also deal with the cold-start problem of new users. Moreover, it could be directly adaptive to various well-established sequential models. Extensive experiments on four real-world datasets verify the superiority of our framework compared with the state-of-the-art baselines.