论文标题

LSA-T:第一个连续的阿根廷手语数据集用于手语翻译

LSA-T: The first continuous Argentinian Sign Language dataset for Sign Language Translation

论文作者

Bianco, Pedro Dal, Ríos, Gastón, Ronchetti, Franco, Quiroga, Facundo, Stanchi, Oscar, Hasperué, Waldo, Rosete, Alejandro

论文摘要

手语翻译(SLT)是一个活跃的研究领域,涵盖了人类计算机的互动,计算机视觉,自然语言处理和机器学习。该领域的进展可能导致聋人的更高水平。据我们所知,本文介绍了第一个连续的阿根廷手语(LSA)数据集。它包含从CN Sordos YouTube频道中提取的LSA的14,880个句子级视频,每个签名者都有标签和关键点注释。我们还提出了一种推断活动签名者的方法,对数据集特征的详细分析,一种可视化工具,用于探索数据集和神经SLT模型,以作为未来实验的基线。

Sign language translation (SLT) is an active field of study that encompasses human-computer interaction, computer vision, natural language processing and machine learning. Progress on this field could lead to higher levels of integration of deaf people. This paper presents, to the best of our knowledge, the first continuous Argentinian Sign Language (LSA) dataset. It contains 14,880 sentence level videos of LSA extracted from the CN Sordos YouTube channel with labels and keypoints annotations for each signer. We also present a method for inferring the active signer, a detailed analysis of the characteristics of the dataset, a visualization tool to explore the dataset and a neural SLT model to serve as baseline for future experiments.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源