论文标题

使用神经序列模型进行有或没有阅读障碍的普通话读者的基于眼睛跟踪的分类

Eye-tracking based classification of Mandarin Chinese readers with and without dyslexia using neural sequence models

论文作者

Haller, Patrick, Säuberli, Andreas, Kiener, Sarah Elisabeth, Pan, Jinger, Yan, Ming, Jäger, Lena

论文摘要

已知眼睛运动反映了阅读中的认知过程,心理阅读研究表明,患有和没有阅读障碍的读者之间的眼光凝视模式有所不同。近年来,研究人员试图根据使用支持向量机(SVM)的眼睛运动对读者进行阅读障碍。但是,这些方法(i)基于参与者阅读的所有单词的高度聚合特征,因此无视眼动运动的顺序性,(ii)不考虑语言刺激及其与读者眼动的相互作用。在目前的工作中,我们提出了两个简单的序列模型,它们可以在整个刺激上处理眼睛运动,而无需在整个句子上汇总特征。此外,我们以两种方式将语言刺激纳入模型 - 上下文化的单词嵌入和手动提取的语言特征。这些模型是根据中文数据集进行评估的,该数据集包含有和没有阅读障碍儿童的眼睛运动。我们的结果表明,(i)即使对于诸如中国的逻辑脚本,序列模型也能够在眼睛凝视序列上对阅读障碍进行分类,达到最先进的性能,并且(ii)结合语言刺激也无助于提高分类性能。

Eye movements are known to reflect cognitive processes in reading, and psychological reading research has shown that eye gaze patterns differ between readers with and without dyslexia. In recent years, researchers have attempted to classify readers with dyslexia based on their eye movements using Support Vector Machines (SVMs). However, these approaches (i) are based on highly aggregated features averaged over all words read by a participant, thus disregarding the sequential nature of the eye movements, and (ii) do not consider the linguistic stimulus and its interaction with the reader's eye movements. In the present work, we propose two simple sequence models that process eye movements on the entire stimulus without the need of aggregating features across the sentence. Additionally, we incorporate the linguistic stimulus into the model in two ways -- contextualized word embeddings and manually extracted linguistic features. The models are evaluated on a Mandarin Chinese dataset containing eye movements from children with and without dyslexia. Our results show that (i) even for a logographic script such as Chinese, sequence models are able to classify dyslexia on eye gaze sequences, reaching state-of-the-art performance, and (ii) incorporating the linguistic stimulus does not help to improve classification performance.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源