Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Wenxiang Guo

dblp:256/7852 · DBLP profile ↗
← Back
7ranked-venue papers
3as first author
6since 2021 · last 2025
0009-0006-7997-4140ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 4 · 2 first-author · 4 since 2021Graphics, computer vision, multimedia, augmented reality and games · 3 · 1 first-author · 3 since 2021Applied, interdisciplinary, general and emerging computing · 1 · 1 first-author

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Computer graphics and multimedia
6 papers
Audio and music processing · 75% Virtual and augmented reality · 12% Multimedia analysis and retrieval · 9%
Artificial intelligence
3 papers
Generative modeling · 100%

Topics — the 15 heaviest of 17, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Audio and music processing
spatial audio
1.722025
MRSAudio: A Large-Scale Multimodal Recorded Spatial Audio Dataset with Refined Annotations · NeurIPS 2025
A Multimodal Evaluation Framework for Spatial Audio Playback Systems: From Localization to Listener Preference · ACM Multimedia 2025
Audio and music processing › music generation
singing voice synthesis
1.622025
TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching · AAAI 2025
GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks · NeurIPS 2024
Machine learning › Generative modeling
flow matching
1.022025
Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching · NeurIPS 2024
TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching · AAAI 2025
Machine learning › Generative modeling
multimodal generation
0.912025
ISDrama: Immersive Spatial Drama Generation through Multimodal Prompting · ACM Multimedia 2025
Virtual and augmented reality
immersive content generation
0.912025
ISDrama: Immersive Spatial Drama Generation through Multimodal Prompting · ACM Multimedia 2025
Multimedia analysis and retrieval › multimedia dataset construction
multimodal dataset
0.912025
MRSAudio: A Large-Scale Multimodal Recorded Spatial Audio Dataset with Refined Annotations · NeurIPS 2025
Audio and music processing
sound event detection
0.912025
A Multimodal Evaluation Framework for Spatial Audio Playback Systems: From Localization to Listener Preference · ACM Multimedia 2025
Audio and music processing
sound source localization
0.912025
MRSAudio: A Large-Scale Multimodal Recorded Spatial Audio Dataset with Refined Annotations · NeurIPS 2025
Machine learning › Generative modeling › diffusion model
rectified flow
0.812024
Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching · NeurIPS 2024
Audio and music processing › music analysis
singing voice analysis
0.812024
GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks · NeurIPS 2024
Audio and music processing
sound synthesis
0.812024
Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching · NeurIPS 2024
Audio and music processing › sound synthesis
video-to-audio generation
0.812024
Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching · NeurIPS 2024
Machine learning › Generative modeling
audio generation
0.312025
TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching · AAAI 2025
Virtual and augmented reality
immersive audio
0.312025
MRSAudio: A Large-Scale Multimodal Recorded Spatial Audio Dataset with Refined Annotations · NeurIPS 2025
Visual content generation and editing
style transfer
0.212024
GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks · NeurIPS 2024

Methods — techniques the papers use, named apart from their topics

technique detection · 1.7prompt-based prediction · 1.7multimodal prompting · 1.7flow matching · 1.7diffusion model · 1.7two-stage training · 0.9multimodal encoder · 0.9mean-opinion score prediction · 0.9binaural audio · 0.9ambisonic audio · 0.9transformer · 0.8rectified flow matching · 0.8knowledge distillation · 0.8
YearPublicationVenuePosition
2025 TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching
abstract
Singing voice synthesis has made remarkable progress in generating natural and high-quality voices. However, existing methods rarely provide precise control over vocal techniques such as intensity, mixed voice, falsetto, bubble, and breathy tones, thus limiting the expressive potential of synthetic voices. We introduce TechSinger, an advanced system for controllable singing voice synthesis that supports five languages and seven vocal techniques. TechSinger leverages a flow-matching-based generative model to produce singing voices with enhanced expressive control over various techniques. To enhance the diversity of training data, we develop a technique detection model that automatically annotates datasets with phoneme-level technique labels. Additionally, our prompt-based technique prediction model enables users to specify desired vocal attributes through natural language, offering fine-grained control over the synthesized singing. Experimental results demonstrate that TechSinger significantly enhances the expressiveness and realism of synthetic singing voices, outperforming existing methods in terms of audio quality and technique-specific control.
Wenxiang Guo, Yu Zhang 0126, Changhao Pan, Rongjie Huang 0001, Ruiqi Li 0002, Zhiqing Hong, Zhou Zhao 0001
AAAI1
2025 ISDrama: Immersive Spatial Drama Generation through Multimodal Prompting
Yu Zhang 0126, Wenxiang Guo, Changhao Pan, Tao Jin 0004, Zhou Zhao 0001
ACM Multimedia2
2025 A Multimodal Evaluation Framework for Spatial Audio Playback Systems: From Localization to Listener Preference
abstract
Spatial audio playback defines immersive listening. However, objective evaluation methods for perceptual dimensions like sound field and sound image remain underdeveloped, hindered by the lack of fine-grained spatial audio datasets and the neglect of echoes and reverberation in diverse playback conditions. To address these challenges, we propose MESA, a multi-modal evaluation framework for spatial audio systems, and introduce PSA-MOS, a high-quality multi-scene spatial audio dataset. Specifically: 1) PSA-MOS provides 50 hours of high-quality spatial audio recordings spanning 6 playback scenarios and 7 device types, with detailed localization annotations and fine-grained MOS ratings across four perceptual dimensions. 2) We develop SAE-Encoder, a spatial audio encoder that captures both acoustic-spatial cues and fine-grained perceptual patterns. 3) MESA integrates visual scene context to enhance evaluation robustness through echo and reverberation modeling. Experimental results demonstrate that SAE-Encoder achieves superior performance in SELD tasks. With a two-stage training strategy, MESA exhibits strong correlation with human perceptual assessments, effectively guiding spatial audio quality optimization. The demos are available at https://david-pigeon.github.io/mesaDemo.
Changhao Pan, Wenxiang Guo, Yu Zhang 0126, Zhetao Chen, Han Wang 0019, Zhou Zhao 0001
ACM Multimedia2
2025 MRSAudio: A Large-Scale Multimodal Recorded Spatial Audio Dataset with Refined Annotations
abstract
Humans rely on multisensory integration to perceive spatial environments, where auditory cues enable sound source localization in three-dimensional space. Despite the critical role of spatial audio in immersive technologies such as VR/AR, most existing multimodal datasets provide only monaural audio, which limits the development of spatial audio generation and understanding. To address these challenges, we introduce MRSAudio, a large-scale multimodal spatial audio dataset designed to advance research in spatial audio understanding and generation. MRSAudio spans four distinct components: MRSLife, MRSSpeech, MRSMusic, and MRSSing, covering diverse real-world scenarios. The dataset includes synchronized binaural and ambisonic audio, exocentric and egocentric video, motion trajectories, and fine-grained annotations such as transcripts, phoneme boundaries, lyrics, scores, and prompts.To demonstrate the utility and versatility of MRSAudio, we establish five foundational tasks: audio spatialization, and spatial text to speech, spatial singing voice synthesis, spatial music generation and sound event localization and detection. Results show that MRSAudio enables high-quality spatial modeling and supports a broad range of spatial audio research.Demos and dataset access are available at https://mrsaudio.github.io.
Wenxiang Guo, Changhao Pan, Xintong Hu, Yu Zhang 0126, Han Wang 0019, Zongbao Zhang, Hankun Xu, Zhetao Chen, Yanhao Yu, Qiange Huang, Fei Wu 0001, Zhou Zhao 0001
NeurIPS1
2024 Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching
abstract
Video-to-audio (V2A) generation aims to synthesize content-matching audio from silent video, and it remains challenging to build V2A models with high generation quality, efficiency, and visual-audio temporal synchrony. We propose Frieren, a V2A model based on rectified flow matching. Frieren regresses the conditional transport vector field from noise to spectrogram latent with straight paths and conducts sampling by solving ODE, outperforming autoregressive and score-based models in terms of audio quality. By employing a non-autoregressive vector field estimator based on a feed-forward transformer and channel-level cross-modal feature fusion with strong temporal alignment, our model generates audio that is highly synchronized with the input video. Furthermore, through reflow and one-step distillation with guided vector field, our model can generate decent audio in a few, or even only one sampling step. Experiments indicate that Frieren achieves state-of-the-art performance in both generation quality and temporal alignment on VGGSound, with alignment accuracy reaching 97.22\%, and 6.2\% improvement in inception score over the strong diffusion-based baseline. Audio samples and code are available at http://frieren-v2a.github.io.
Wenxiang Guo, Rongjie Huang 0001, Jiawei Huang 0008, Zehan Wang 0001, Fuming You, Ruiqi Li 0002, Zhou Zhao 0001
NeurIPS2
2024 GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks
abstract
The scarcity of high-quality and multi-task singing datasets significantly hinders the development of diverse controllable and personalized singing tasks, as existing singing datasets suffer from low quality, limited diversity of languages and singers, absence of multi-technique information and realistic music scores, and poor task suitability.To tackle these problems, we present GTSinger, a large Global, multi-Technique, free-to-use, high-quality singing corpus with realistic music scores, designed for all singing tasks, along with its benchmarks.Particularly,(1) we collect 80.59 hours of high-quality singing voices, forming the largest recorded singing dataset;(2) 20 professional singers across nine widely spoken languages offer diverse timbres and styles;(3) we provide controlled comparison and phoneme-level annotations of six commonly used singing techniques, helping technique modeling and control;(4) GTSinger offers realistic music scores, assisting real-world musical composition;(5) singing voices are accompanied by manual phoneme-to-audio alignments, global style labels, and 16.16 hours of paired speech for various singing tasks.Moreover, to facilitate the use of GTSinger, we conduct four benchmark experiments: technique-controllable singing voice synthesis, technique recognition, style transfer, and speech-to-singing conversion.
Yu Zhang 0126, Changhao Pan, Wenxiang Guo, Ruiqi Li 0002, Jingyu Lu 0001, Zhiqing Hong, Chuxin Wang, Jinzheng He, Ziyue Jiang 0001, Jiecheng Zhou, Zhou Zhao 0001
NeurIPS3
2020 Anomaly Detection for Time Series Based on the Neural Networks Optimized by the Improved PSO Algorithm
Wenxiang Guo, Xiyu Liu 0001, Laisheng Xiang
ICIC (3)1