论文标题

使用hamnosys符号的无监督手语音素聚类

Unsupervised Sign Language Phoneme Clustering using HamNoSys Notation

论文作者

Mocialov, Boris, Turner, Graham, Hastie, Helen

论文摘要

传统上,在受控设置中收集了手语资源,用于涉及监督标志分类或语言研究的特定任务,并附有特定的注释类型。迄今为止,很少有人探索在社交媒体平台上在线找到的签名视频,以及使用无监督的方法应用于此类资源。由于该领域正在努力在与培训期间所见的数据不同的数据上实现可接受的模型性能,这需要在手语数据中获得更多多样性,从而摆脱了在受控实验室环境中获得的数据。此外,由于手语数据收集和注释带有大型开销,因此希望加速注释过程。考虑到上述趋势,本文将收集在线数据的一面侧付诸实践,以追求通过音素集群自动生成和注释手语语言语言语言。

Traditionally, sign language resources have been collected in controlled settings for specific tasks involving supervised sign classification or linguistic studies accompanied by specific annotation type. To date, very few who explored signing videos found online on social media platforms as well as the use of unsupervised methods applied to such resources. Due to the fact that the field is striving to achieve acceptable model performance on the data that differs from that seen during training calls for more diversity in sign language data, stepping away from the data obtained in controlled laboratory settings. Moreover, since the sign language data collection and annotation carries large overheads, it is desirable to accelerate the annotation process. Considering the aforementioned tendencies, this paper takes the side of harvesting online data in a pursuit for automatically generating and annotating sign language corpora through phoneme clustering.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源