Yuqin Lin

dblp:270/4469 · DBLP profile ↗
← Back
8ranked-venue papers
5as first author
6since 2021 · last 2024
—ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Graphics, computer vision, multimedia, augmented reality and games · 7 · 4 first-author · 5 since 2021Artificial intelligence and machine learning · 6 · 3 first-author · 5 since 2021
YearPublicationVenuePosition
2024 Exploring Pre-trained Speech Model for Articulatory Feature Extraction in Dysarthric Speech Using ASR
Yuqin Lin, Longbiao Wang, Jianwu Dang 0001, Nobuaki Minematsu
INTERSPEECH1
2023 Disordered speech recognition considering low resources and abnormal articulation
Yuqin Lin, Jianwu Dang 0001, Longbiao Wang, Sheng Li 0010, Chenchen Ding
Speech Commun.1
2023 CFDRN: A Cognition-Inspired Feature Decomposition and Recombination Network for Dysarthric Speech Recognition
abstract
As an essential technology in human–computer interactions, automatic speech recognition (ASR) ensures a convenient life for healthy people; however, people with speech disorders, who truly need support from such a technology, have experienced difficulties in the use of ASR. Disordered ASR is challenging because of the large variabilities in disordered speech. Humans tend to separately process different spectro-temporal features of speech in the left and right hemispheres of their brain, showing significantly better ability in speech perception than machines, especially in disordered speech perception. Inspired by human speech processing, this paper proposes a cognition-inspired feature decomposition and recombination network (CFDRN) for dysarthric ASR. In the CFDRN, slow- and rapid-varying temporal processors are designed to decompose features into stable and changeable features, respectively. A gated fusion module was developed to selectively recombine the decomposed features. Moreover, this study utilised an adaptation approach based on unsupervised pre-training techniques to alleviate data scarcity issues in dysarthric ASR. The CFDRNs were added to the layers of the pre-trained model, and the entire model is adapted from normal speech to disordered speech. The effectiveness of the proposed method was validated on the widely used TORGO and UASpeech dysarthria datasets under three popular unsupervised pre-training techniques, wav2vec 2.0, HuBERT, and data2vec. When compared to the baseline methods, the proposed CFDRN with the three pre-training techniques achieved 13.73%$\sim$16.23% and 4.50%$\sim$13.20% word error rate reductions on the TORGO and UASpeech datasets, respectively. Furthermore, this study clarified several major factors affecting dysarthric ASR performance.
Yuqin Lin, Longbiao Wang, Yanbing Yang 0003, Jianwu Dang 0001
IEEE ACM Trans. Audio Speech Lang. Process.1
2022 Finer-grained Modeling units-based Meta-Learning for Low-resource Tibetan Speech Recognition
Siqing Qin, Longbiao Wang, Sheng Li 0010, Yuqin Lin, Jianwu Dang 0001
INTERSPEECH4
2022 Language-specific Characteristic Assistance for Code-switching Speech Recognition
Tongtong Song, Meng Ge, Longbiao Wang, Yongjie Lv, Yuqin Lin, Jianwu Dang 0001
INTERSPEECH7
2022 Self-Distillation Based on High-level Information Supervision for Compressing End-to-End ASR Model
Tongtong Song, Longbiao Wang, Yuqin Lin, Yongjie Lv, Meng Ge, Qiang Yu 0005, Jianwu Dang 0001
INTERSPEECH5
2020 End-to-End Articulatory Modeling for Dysarthric Articulatory Attribute Detection
abstract
In this study, we focus on detecting articulatory attribute errors for dysarthric patients with cerebral palsy (CP) or amyotrophic lateral sclerosis (ALS). There are two major challenges for this task. The pronunciation of dysarthric patients is unclear and inaccurate, which results in poor performances of traditional automatic speech recognition (ASR) systems and traditional automatic speech attribute transcription (ASAT). In addition, the data is limited because of the difficulty of recording. This study proposes an end-to-end automatic speech attribute transcription (E2E-ASAT) method for detecting articulatory attribute errors more precisely. To use the limited data more effectively, the parameters of the acoustic model are refactored into two layers and only one layer is retrained. Our proposed method showed good performances in both ASR and articulatory attribute detection. Our system has a potential as a rehabilitation tool.
Yuqin Lin, Longbiao Wang, Jianwu Dang 0001, Sheng Li 0010, Chenchen Ding
ICASSP1
2020 Staged Knowledge Distillation for End-to-End Dysarthric Speech Recognition and Speech Attribute Transcription
Yuqin Lin, Longbiao Wang, Sheng Li 0010, Jianwu Dang 0001, Chenchen Ding
INTERSPEECH1