Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.

Changhao Pan

dblp:382/3463 · DBLP profile ↗
← Back
8ranked-venue papers
1as first author
8since 2021 · last 2026
0009-0004-6023-1764ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 5 · 5 since 2021Graphics, computer vision, multimedia, augmented reality and games · 4 · 1 first-author · 4 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Computer graphics and multimedia
6 papers
Audio and music processing · 66% Visual content generation and editing · 12% Virtual and augmented reality · 11%
Artificial intelligence
3 papers
Generative modeling · 52% Question answering and dialogue systems · 37% Speech recognition and synthesis · 11%
Human-computer interaction and pervasive computing
1 paper
Human-AI interaction · 100%

Topics — the 18 heaviest of 21, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Audio and music processing › music generation
singing voice synthesis
2.432025
TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching · AAAI 2025
GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks · NeurIPS 2024
TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control · EMNLP 2024
Audio and music processing
spatial audio
1.722025
MRSAudio: A Large-Scale Multimodal Recorded Spatial Audio Dataset with Refined Annotations · NeurIPS 2025
A Multimodal Evaluation Framework for Spatial Audio Playback Systems: From Localization to Listener Preference · ACM Multimedia 2025
Natural language and speech › Question answering and dialogue systems
spoken dialogue systems
1.012026
SDiaReward: Modeling and Benchmarking Spoken Dialogue Rewards with Modality and Colloquialness · ACL (1) 2026
Machine learning › Generative modeling
multimodal generation
0.912025
ISDrama: Immersive Spatial Drama Generation through Multimodal Prompting · ACM Multimedia 2025
Virtual and augmented reality
immersive content generation
0.912025
ISDrama: Immersive Spatial Drama Generation through Multimodal Prompting · ACM Multimedia 2025
Multimedia analysis and retrieval › multimedia dataset construction
multimodal dataset
0.912025
MRSAudio: A Large-Scale Multimodal Recorded Spatial Audio Dataset with Refined Annotations · NeurIPS 2025
Audio and music processing
sound event detection
0.912025
A Multimodal Evaluation Framework for Spatial Audio Playback Systems: From Localization to Listener Preference · ACM Multimedia 2025
Audio and music processing
sound source localization
0.912025
MRSAudio: A Large-Scale Multimodal Recorded Spatial Audio Dataset with Refined Annotations · NeurIPS 2025
Audio and music processing › music analysis
singing voice analysis
0.812024
GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks · NeurIPS 2024
Visual content generation and editing › style transfer
zero-shot style transfer
0.812024
TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control · EMNLP 2024
Human-AI interaction › large language model interaction › language-based interaction
natural language interface
0.812024
Interactive Table Synthesis With Natural Language · IEEE Trans. Vis. Comput. Graph. 2024
Machine learning › Generative modeling
audio generation
0.312025
TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching · AAAI 2025
Machine learning › Generative modeling
flow matching
0.312025
TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching · AAAI 2025
Virtual and augmented reality
immersive audio
0.312025
MRSAudio: A Large-Scale Multimodal Recorded Spatial Audio Dataset with Refined Annotations · NeurIPS 2025
Data integration and cleaning
data transformation
0.212024
Interactive Table Synthesis With Natural Language · IEEE Trans. Vis. Comput. Graph. 2024
Audio and music processing
speech synthesis
0.212024
TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control · EMNLP 2024
Visual content generation and editing
style control
0.212024
TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control · EMNLP 2024
Visual content generation and editing
style transfer
0.212024
GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks · NeurIPS 2024

Methods — techniques the papers use, named apart from their topics

technique detection · 1.7prompt-based prediction · 1.7multimodal prompting · 1.7flow matching · 1.7diffusion model · 1.7prompting · 1.5large language model · 1.5reward modeling · 1.0benchmarking · 1.0two-stage training · 0.9multimodal encoder · 0.9mean-opinion score prediction · 0.9binaural audio · 0.9ambisonic audio · 0.9
YearPublicationVenuePosition
2026 SDiaReward: Modeling and Benchmarking Spoken Dialogue Rewards with Modality and Colloquialness
abstract
Jingyu Lu, Yuhan Wang, Fan Zhuo, Xize Cheng, Changhao Pan, Xueyi Pu, Yifu Chen, Chenyuhao Wen, Tianle Liang, Zhou Zhao. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2026.
Jingyu Lu 0001, Fan Zhuo, Xize Cheng, Changhao Pan, Xueyi Pu, Chenyuhao Wen, Tianle Liang, Zhou Zhao 0001
ACL (1)5
2025 TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching
abstract
Singing voice synthesis has made remarkable progress in generating natural and high-quality voices. However, existing methods rarely provide precise control over vocal techniques such as intensity, mixed voice, falsetto, bubble, and breathy tones, thus limiting the expressive potential of synthetic voices. We introduce TechSinger, an advanced system for controllable singing voice synthesis that supports five languages and seven vocal techniques. TechSinger leverages a flow-matching-based generative model to produce singing voices with enhanced expressive control over various techniques. To enhance the diversity of training data, we develop a technique detection model that automatically annotates datasets with phoneme-level technique labels. Additionally, our prompt-based technique prediction model enables users to specify desired vocal attributes through natural language, offering fine-grained control over the synthesized singing. Experimental results demonstrate that TechSinger significantly enhances the expressiveness and realism of synthetic singing voices, outperforming existing methods in terms of audio quality and technique-specific control.
Wenxiang Guo, Yu Zhang 0126, Changhao Pan, Rongjie Huang 0001, Ruiqi Li 0002, Zhiqing Hong, Zhou Zhao 0001
AAAI3
2025 ISDrama: Immersive Spatial Drama Generation through Multimodal Prompting
Yu Zhang 0126, Wenxiang Guo, Changhao Pan, Tao Jin 0004, Zhou Zhao 0001
ACM Multimedia3
2025 A Multimodal Evaluation Framework for Spatial Audio Playback Systems: From Localization to Listener Preference
abstract
Spatial audio playback defines immersive listening. However, objective evaluation methods for perceptual dimensions like sound field and sound image remain underdeveloped, hindered by the lack of fine-grained spatial audio datasets and the neglect of echoes and reverberation in diverse playback conditions. To address these challenges, we propose MESA, a multi-modal evaluation framework for spatial audio systems, and introduce PSA-MOS, a high-quality multi-scene spatial audio dataset. Specifically: 1) PSA-MOS provides 50 hours of high-quality spatial audio recordings spanning 6 playback scenarios and 7 device types, with detailed localization annotations and fine-grained MOS ratings across four perceptual dimensions. 2) We develop SAE-Encoder, a spatial audio encoder that captures both acoustic-spatial cues and fine-grained perceptual patterns. 3) MESA integrates visual scene context to enhance evaluation robustness through echo and reverberation modeling. Experimental results demonstrate that SAE-Encoder achieves superior performance in SELD tasks. With a two-stage training strategy, MESA exhibits strong correlation with human perceptual assessments, effectively guiding spatial audio quality optimization. The demos are available at https://david-pigeon.github.io/mesaDemo.
Changhao Pan, Wenxiang Guo, Yu Zhang 0126, Zhetao Chen, Han Wang 0019, Zhou Zhao 0001
ACM Multimedia1
2025 MRSAudio: A Large-Scale Multimodal Recorded Spatial Audio Dataset with Refined Annotations
abstract
Humans rely on multisensory integration to perceive spatial environments, where auditory cues enable sound source localization in three-dimensional space. Despite the critical role of spatial audio in immersive technologies such as VR/AR, most existing multimodal datasets provide only monaural audio, which limits the development of spatial audio generation and understanding. To address these challenges, we introduce MRSAudio, a large-scale multimodal spatial audio dataset designed to advance research in spatial audio understanding and generation. MRSAudio spans four distinct components: MRSLife, MRSSpeech, MRSMusic, and MRSSing, covering diverse real-world scenarios. The dataset includes synchronized binaural and ambisonic audio, exocentric and egocentric video, motion trajectories, and fine-grained annotations such as transcripts, phoneme boundaries, lyrics, scores, and prompts.To demonstrate the utility and versatility of MRSAudio, we establish five foundational tasks: audio spatialization, and spatial text to speech, spatial singing voice synthesis, spatial music generation and sound event localization and detection. Results show that MRSAudio enables high-quality spatial modeling and supports a broad range of spatial audio research.Demos and dataset access are available at https://mrsaudio.github.io.
Wenxiang Guo, Changhao Pan, Xintong Hu, Yu Zhang 0126, Han Wang 0019, Zongbao Zhang, Hankun Xu, Zhetao Chen, Yanhao Yu, Qiange Huang, Fei Wu 0001, Zhou Zhao 0001
NeurIPS2
2024 TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control
abstract
Zero-shot singing voice synthesis (SVS) with style transfer and style control aims to generate high-quality singing voices with unseen timbres and styles (including singing method, emotion, rhythm, technique, and pronunciation) from audio and text prompts.However, the multifaceted nature of singing styles poses a significant challenge for effective modeling, transfer, and control.Furthermore, current SVS models often fail to generate singing voices rich in stylistic nuances for unseen singers.To address these challenges, we introduce TCSinger, the first zero-shot SVS model for style transfer across cross-lingual speech and singing styles, along with multi-level style control.Specifically, TCSinger proposes three primary modules: 1) the clustering style encoder employs a clustering vector quantization model to stably condense style information into a compact latent space; 2) the Style and Duration Language Model (S&D-LM) concurrently predicts style information and phoneme duration, which benefits both; 3) the style adaptive decoder uses a novel mel-style adaptive normalization method to generate singing voices with enhanced details.Experimental results show that TCSinger outperforms all baseline models in synthesis quality, singer similarity, and style controllability across various tasks, including zero-shot style transfer, multi-level style control, crosslingual style transfer, and speech-to-singing style transfer.Singing voice samples can be accessed at https://tcsinger.github.io/.
Yu Zhang 0126, Ziyue Jiang 0001, Ruiqi Li 0002, Changhao Pan, Jinzheng He, Rongjie Huang 0001, Chuxin Wang, Zhou Zhao 0001
EMNLP4
2024 GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks
abstract
The scarcity of high-quality and multi-task singing datasets significantly hinders the development of diverse controllable and personalized singing tasks, as existing singing datasets suffer from low quality, limited diversity of languages and singers, absence of multi-technique information and realistic music scores, and poor task suitability.To tackle these problems, we present GTSinger, a large Global, multi-Technique, free-to-use, high-quality singing corpus with realistic music scores, designed for all singing tasks, along with its benchmarks.Particularly,(1) we collect 80.59 hours of high-quality singing voices, forming the largest recorded singing dataset;(2) 20 professional singers across nine widely spoken languages offer diverse timbres and styles;(3) we provide controlled comparison and phoneme-level annotations of six commonly used singing techniques, helping technique modeling and control;(4) GTSinger offers realistic music scores, assisting real-world musical composition;(5) singing voices are accompanied by manual phoneme-to-audio alignments, global style labels, and 16.16 hours of paired speech for various singing tasks.Moreover, to facilitate the use of GTSinger, we conduct four benchmark experiments: technique-controllable singing voice synthesis, technique recognition, style transfer, and speech-to-singing conversion.
Yu Zhang 0126, Changhao Pan, Wenxiang Guo, Ruiqi Li 0002, Jingyu Lu 0001, Zhiqing Hong, Chuxin Wang, Jinzheng He, Ziyue Jiang 0001, Jiecheng Zhou, Zhou Zhao 0001
NeurIPS2
2024 Interactive Table Synthesis With Natural Language
abstract
Tables are a ubiquitous data format for insight communication. However, transforming data into consumable tabular views remains a challenging and time-consuming task. To lower the barrier of such a task, research efforts have been devoted to developing interactive approaches for data transformation, but many approaches still presume that their users have considerable knowledge of various data transformation concepts and functions. In this study, we leverage natural language (NL) as the primary interaction modality to improve the accessibility of average users to performing complex data transformation and facilitate intuitive table generation and editing. Designing an NL-driven data transformation approach introduces two challenges: 1) NL-driven synthesis of interpretable pipelines and 2) incremental refinement of synthesized tables. To address these challenges, we present NL2Rigel, an interactive tool that assists users in synthesizing and improving tables from semi-structured text with NL instructions. Based on a large language model and prompting techniques, NL2Rigel can interpret the given NL instructions into a table synthesis pipeline corresponding to Rigel specifications, a declarative language for tabular data transformation. An intuitive interface is designed to visualize the synthesis pipeline and the generated tables, helping users understand the transformation process and refine the results efficiently with targeted NL instructions. The comprehensiveness of NL2Rigel is demonstrated with an example gallery, and we further confirmed NL2Rigel's usability with a comparative user study by showing that the task completion time with NL2Rigel is significantly shorter than that with the original version of Rigel with comparable completion rates.
Yanwei Huang, Yunfan Zhou, Changhao Pan, Xinhuan Shu, Di Weng, Yingcai Wu
IEEE Trans. Vis. Comput. Graph.4