论文标题
在音乐音频剪辑上的歌词线条
Generation of lyrics lines conditioned on music audio clips
论文作者
论文摘要
我们提出了一个在音乐音频中生成新颖的歌词线条的系统。双峰神经网络模型学会了在任何给定的简短音频剪辑上生成线条。该模型由频谱图变异自动编码器（VAE）和文本VAE组成。自动评估和人类评估都证明了我们的模型在产生与给定音频剪辑相匹配的情感影响的线路上的有效性。该系统旨在用作词曲作者的创造力工具。
We present a system for generating novel lyrics lines conditioned on music audio. A bimodal neural network model learns to generate lines conditioned on any given short audio clip. The model consists of a spectrogram variational autoencoder (VAE) and a text VAE. Both automatic and human evaluations demonstrate effectiveness of our model in generating lines that have an emotional impact matching a given audio clip. The system is intended to serve as a creativity tool for songwriters.
