论文标题

在足球场上进行实时球员检测的多模式和多视图蒸馏

Multimodal and multiview distillation for real-time player detection on a football field

论文作者

Cioppa, Anthony, Deliège, Adrien, Huda, Noor Ul, Gade, Rikke, Van Droogenbroeck, Marc, Moeslund, Thomas B.

论文摘要

监视公共体育设施的占用对于评估其使用和激励在新地方的建设至关重要。在足球场的情况下,要覆盖的区域很大,因此应使用几个常规摄像头,这使设置昂贵且复杂。作为替代方案,我们开发了一个系统,该系统可以从独特的廉价和广角鱼眼摄像机中检测到玩家,该相机由单个窄角热摄像机辅助。在这项工作中,我们采用知识蒸馏方法训练网络,在这种方法中,学生和老师具有不同的方式和对同一场景的不同观点。特别是,我们设计了一种自定义数据增强,并结合了运动检测算法,以处理未覆盖的Fisheye相机区域的训练。我们表明,我们的解决方案可有效检测Fisheye相机拍摄的整个场地的玩家。在在线蒸馏的情况下,我们对其进行定量和质量评估,在线蒸馏中,学生在不断适应最新视频条件的同时,实时检测玩家。

Monitoring the occupancy of public sports facilities is essential to assess their use and to motivate their construction in new places. In the case of a football field, the area to cover is large, thus several regular cameras should be used, which makes the setup expensive and complex. As an alternative, we developed a system that detects players from a unique cheap and wide-angle fisheye camera assisted by a single narrow-angle thermal camera. In this work, we train a network in a knowledge distillation approach in which the student and the teacher have different modalities and a different view of the same scene. In particular, we design a custom data augmentation combined with a motion detection algorithm to handle the training in the region of the fisheye camera not covered by the thermal one. We show that our solution is effective in detecting players on the whole field filmed by the fisheye camera. We evaluate it quantitatively and qualitatively in the case of an online distillation, where the student detects players in real time while being continuously adapted to the latest video conditions.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源