论文标题

换能器的快速和平行解码

Fast and parallel decoding for transducer

论文作者

Kang, Wei, Guo, Liyong, Kuang, Fangjun, Lin, Long, Luo, Mingshuang, Yao, Zengwei, Yang, Xiaoyu, Żelasko, Piotr, Povey, Daniel

论文摘要

传感器体系结构在语音识别领域变得越来越流行,因为它自然流式传输且精度高。传感器的缺点之一是,由于无约束数量的符号可以在每个时间步中发射,因此很难以快速和并行的方式解码。在这项工作中,我们介绍了换能器损失的受约束版本,以学习序列之间的严格单调比对。我们还通过限制可以在传感器解码时可以发出的符号数量来改善标准的贪婪搜索和梁搜索算法,从而使与批处理并行解码更有效。此外,我们提出了一个有限状态自动机(FSA)并行束搜索算法,该算法可以有效地在GPU上运行。实验结果表明,我们在解码方面实现了轻微的单词错误率(WER)的提高以及显着的加速。我们的工作是开源的,公开可用\ footNote {https://github.com/k2-fsa/icefall}。

The transducer architecture is becoming increasingly popular in the field of speech recognition, because it is naturally streaming as well as high in accuracy. One of the drawbacks of transducer is that it is difficult to decode in a fast and parallel way due to an unconstrained number of symbols that can be emitted per time step. In this work, we introduce a constrained version of transducer loss to learn strictly monotonic alignments between the sequences; we also improve the standard greedy search and beam search algorithms by limiting the number of symbols that can be emitted per time step in transducer decoding, making it more efficient to decode in parallel with batches. Furthermore, we propose an finite state automaton-based (FSA) parallel beam search algorithm that can run with graphs on GPU efficiently. The experiment results show that we achieve slight word error rate (WER) improvement as well as significant speedup in decoding. Our work is open-sourced and publicly available\footnote{https://github.com/k2-fsa/icefall}.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源