VLDB 2026 Research / reviewers in the wild / expert
Shuyan Dong
dblp:132/3932 · also Shuyan Annie Dong
· DBLP profile ↗
8ranked-venue papers
1as first author
7since 2021 · last 2024
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 6 · 1 first-author · 5 since 2021Graphics, computer vision, multimedia, augmented reality and games · 6 · 1 first-author · 5 since 2021
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2024 | Control System Autonomy Improvement: An Attempt to Introduce Meta-Heuristic Algorithms into Closed-loop UAV Control SystemsabstractThis study proposes integrating Genetic Algorithms (GAs) into control systems to enhance autonomy, particularly for unmanned aerial vehicle (UAV) operations. Traditional control systems, which rely on expert knowledge and complex mathematical calculations, limit autonomy. In contrast, GAs offer robust global search capabilities, helping to avoid local optima and enhancing computational efficiency through parallel processing. Utilizing a modified Nonlinear Auto-Regressive eXogenous (NARX) model with feedback regulation ensures system stability and accurate tracking of target values, allowing the system to learn dynamic relationships essential for control in complex nonlinear conditions. We introduce a new GA-NARX based autonomous UAV control system designed for exploration in unfamiliar environments. Our enhanced system features a self-optimizing control mechanism that enables global optimization for peak performance. This advanced control system minimizes human-machine interaction by leveraging GAs' predictive abilities to anticipate future states while significantly improving the control precision. Overall, the design of this autonomous control system aims to optimize coordination and control strategies for UAV swarms, offering innovative solutions for efficient flight patterns. Shuyan Dong, Saptarshi Das, Alex Thornton, Stuart Townley |
ICARCV | 1 |
| 2023 | Introducing Semantics into Speech EncodersabstractDerek Xu, Shuyan Dong, Changhan Wang, Suyoun Kim, Zhaojiang Lin, Bing Liu, Akshat Shrivastava, Shang-Wen Li, Liang-Hsuan Tseng, Guan-Ting Lin, Alexei Baevski, Hung-yi Lee, Yizhou Sun, Wei Wang. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2023. Derek Xu, Shuyan Dong, Changhan Wang, Suyoun Kim, Zhaojiang Lin, Akshat Shrivastava, Shang-Wen Li 0001, Liang-Hsuan Tseng, Guan-Ting Lin, Alexei Baevski, Hung-yi Lee, Yizhou Sun, Wei Wang 0010 |
ACL (1) | 2 |
| 2022 | SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative CapabilitiesabstractHsiang-Sheng Tsai, Heng-Jui Chang, Wen-Chin Huang, Zili Huang, Kushal Lakhotia, Shu-wen Yang, Shuyan Dong, Andy Liu, Cheng-I Lai, Jiatong Shi, Xuankai Chang, Phil Hall, Hsuan-Jui Chen, Shang-Wen Li, Shinji Watanabe, Abdelrahman Mohamed, Hung-yi Lee. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2022. Hsiang-Sheng Tsai, Heng-Jui Chang, Wen-Chin Huang, Zili Huang, Kushal Lakhotia, Shu-Wen Yang, Shuyan Dong, Andy T. Liu, Cheng-I Lai, Jiatong Shi, Xuankai Chang, Phil Hall, Hsuan-Jui Chen, Shang-Wen Li 0001, Shinji Watanabe 0001, Abdel-rahman Mohamed, Hung-yi Lee |
ACL (1) | 7 |
| 2022 | DUAL: Discrete Spoken Unit Adaptive Learning for Textless Spoken Question AnsweringabstractSpoken Question Answering (SQA) is to find the answer from a spoken document given a question, which is crucial for personal assistants when replying to the queries from the users.Existing SQA methods all rely on Automatic Speech Recognition (ASR) transcripts.Not only does ASR need to be trained with massive annotated data that are time and cost-prohibitive to collect for low-resourced languages, but more importantly, very often the answers to the questions include name entities or out-of-vocabulary words that cannot be recognized correctly.Also, ASR aims to minimize recognition errors equally over all words, including many function words irrelevant to the SQA task.Therefore, SQA without ASR transcripts (textless) is always highly desired, although known to be very difficult.This work proposes Discrete Spoken Unit Adaptive Learning (DUAL), leveraging unlabeled data for pre-training and finetuned by the SQA downstream task.The time intervals of spoken answers can be directly predicted from spoken documents.We also release a new SQA benchmark corpus, NMSQA, for data with more realistic scenarios.We empirically showed that DUAL yields results comparable to those obtained by cascading ASR and text QA model and robust to real-world data.Our code and model will be open-sourced 1 . Guan-Ting Lin, Yung-Sung Chuang, Ho-Lam Chung, Shu-Wen Yang, Hsuan-Jui Chen, Shuyan Dong, Shang-Wen Li 0001, Abdel-rahman Mohamed, Hung-yi Lee, Lin-Shan Lee |
INTERSPEECH | 6 |
| 2022 | Superb @ SLT 2022: Challenge on Generalization and Efficiency of Self-Supervised Speech Representation LearningabstractWe present the SUPERB challenge at SLT 2022, which aims at learning self-supervised speech representation for better performance, generalization, and efficiency. The challenge builds upon the SUPERB benchmark and implements metrics to measure the computation requirements of self-supervised learning (SSL) representation and to evaluate its generalizability and performance across the diverse SUPERB tasks. The SUPERB benchmark provides comprehensive coverage of popular speech processing tasks, from speech and speaker recognition to audio generation and semantic understanding. As SSL has gained interest in the speech community and showed promising outcomes, we envision the challenge to uplevel the impact of SSL techniques by motivating more practical designs of techniques beyond task performance. We summarize the results of 14 submitted models in this paper. We also discuss the main findings from those submissions and the future directions of SSL research. Tzu-hsun Feng, Shuyan Dong, Ching-Feng Yeh, Shu-Wen Yang, Tzu-Quan Lin, Jiatong Shi, Kai-Wei Chang 0001, Zili Huang, Xuankai Chang, Shinji Watanabe 0001, Abdel-rahman Mohamed, Shang-Wen Li 0001, Hung-yi Lee |
SLT | 2 |
| 2021 | SUPERB: Speech Processing Universal PERformance BenchmarkabstractSelf-supervised learning (SSL) has proven vital for advancing research in natural language processing (NLP) and computer vision (CV).The paradigm pretrains a shared model on large volumes of unlabeled data and achieves state-of-the-art (SOTA) for various tasks with minimal adaptation.However, the speech processing community lacks a similar setup to systematically explore the paradigm.To bridge this gap, we introduce Speech processing Universal PERformance Benchmark (SUPERB).SUPERB is a leaderboard to benchmark the performance of a shared model across a wide range of speech processing tasks with minimal architecture changes and labeled data.Among multiple usages of the shared model, we especially focus on extracting the representation learned from SSL for its preferable re-usability.We present a simple framework to solve SUPERB tasks by learning task-specialized lightweight prediction heads on top of the frozen shared model.Our results demonstrate that the framework is promising as SSL representations show competitive generalizability and accessibility across SUPERB tasks.We release SUPERB as a challenge with a leaderboard 1 and a benchmark toolkit 2 to fuel the research in representation learning and general speech processing. Shu-Wen Yang, Po-Han Chi, Yung-Sung Chuang, Cheng-I Lai, Kushal Lakhotia, Yist Y. Lin, Andy T. Liu, Jiatong Shi, Xuankai Chang, Guan-Ting Lin, Tzu-Hsien Huang, Wei-Cheng Tseng, Ko-tik Lee, Da-Rong Liu, Zili Huang, Shuyan Dong, Shang-Wen Li 0001, Shinji Watanabe 0001, Abdel-rahman Mohamed, Hung-yi Lee |
Interspeech | 16 |
| 2021 | Meta Learning to Classify Intent and Slot Labels with Noisy Few Shot ExamplesabstractRecently deep learning has dominated many machine learning areas, including spoken language understanding (SLU). However, deep learning models are notorious for being data-hungry, and the heavily optimized models are usually sensitive to the quality of the training examples provided and the consistency between training and inference conditions. To improve the performance of SLU models on tasks with noisy and low training resources, we propose a new SLU benchmarking task: few-shot robust SLU, where SLU comprises two core problems, intent classification (IC) and slot labeling (SL). We establish the task by defining few-shot splits on three public IC/SL datasets, ATIS, SNIPS, and TOP, and adding two types of natural noises (adaptation example missing/replacing and modality mismatch) to the splits. We further propose a novel noise-robust few-shot SLU model based on prototypical networks. We show the model consistently outperforms the conventional fine-tuning baseline and another popular meta-learning method, Model-Agnostic Meta-Learning (MAML), in terms of achieving better IC accuracy and SL F1, and yielding smaller performance variation when noises are present. Shang-Wen Li 0001, Jason Krone, Shuyan Dong, Yaser Al-Onaizan |
SLT | 3 |
| 2020 | ASR Error Correction with Augmented Transformer for Entity Retrieval
Haoyu Wang 0002, Shuyan Dong, James Logan, Ashish Kumar Agrawal, Yang Liu 0004 |
INTERSPEECH | 2 |