Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Pengfei Cai

dblp:135/9745 · DBLP profile ↗
← Back
9ranked-venue papers
3as first author
8since 2021 · last 2026
—ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Graphics, computer vision, multimedia, augmented reality and games · 5 · 3 first-author · 5 since 2021Artificial intelligence and machine learning · 4 · 1 first-author · 4 since 2021Applied, interdisciplinary, general and emerging computing · 1

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Computer graphics and multimedia
2 papers
Audio and music processing · 100%
Artificial intelligence
3 papers
Generative modeling · 82% Vision and language · 18%
Interdisciplinary, comprehensive, and emerging computing
1 paper
Computational science and engineering · 100%

Topics — the 4 heaviest of 6, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Audio and music processing › music generation
song generation
1.012026
SegTune: Structured and Fine-Grained Control for Song Generation · ACL (1) 2026
Machine learning › Generative modeling
flow matching
0.912025
Physics-Constrained Flow Matching: Sampling Generative Models with Hard Constraints · NeurIPS 2025
Audio and music processing
sound event detection
0.912025
Detect Any Sound: Open-Vocabulary Sound Event Detection with Multi-Modal Queries · ACM Multimedia 2025
Machine learning › Generative modeling › diffusion model
controllable generation
0.312026
SegTune: Structured and Fine-Grained Control for Song Generation · ACL (1) 2026

Methods — techniques the papers use, named apart from their topics

structured control · 2.0fine-grained control · 2.0zero-shot inference · 1.7transformer · 1.7physics-based correction · 1.7flow matching · 1.7contrastive audio-language model · 1.7attention masking · 1.7multimodal queries · 0.9multi-modal query · 0.9
YearPublicationVenuePosition
2026 SegTune: Structured and Fine-Grained Control for Song Generation
abstract
Yuejiao Wang, Zihao Ji, Pengfei Cai, Xu Li, Haorui Zheng, Zewen Song, Zhongliang Liu, Chen Zhang, Pengfei Wan. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2026.
Yuejiao Wang, Zihao Ji, Pengfei Cai, Haorui Zheng, Zewen Song, Zhongliang Liu
ACL (1)3
2025 PNP-RKD: A Positive-Negative Pair based Relational Knowledge Distillation Method for Cross-Domain Speaker Verification
abstract
Existing deep embedding learning based speaker verification (SV) methods suffer from performance degradation under domain shift conditions. This can be alleviated through unsupervised domain adaptation (UDA) techniques. While UDA improves global statistical consistency across domains, discriminative information may be overlooked or misaligned in the process. To combat this, we propose PNP-RKD, a relational knowledge distillation method that utilizes positive and negative pairs from both the source and target domains within a multitask learning framework. Two auxiliary tasks are conducted separately in the source and target domains to support PNP-RKD. Embeddings are learned in a supervised fashion from the labeled source domain, providing a robust foundation of prior knowledge. For the unlabeled target domain, we apply contrastive learning based on swapped prediction, a key component that enhances noise robustness and improves the quality of learned prototypes. More importantly, it facilitates reliable sampling in PNP-RKD, thereby enhancing the alignment of discriminative knowledge across domains. Extensive experiments conducted on the NIST SRE16 and SRE18 datasets demonstrate the superior performance of the proposed PNP-RKD method, achieving EERs of 6.83% and 8.28%, respectively.
Qing Gu 0002, Yan Song 0001, Nan Jiang 0022, Pengfei Cai, Ian McLoughlin 0001
ICASSP4
2025 Prototype based Masked Audio Model for Self-Supervised Learning of Sound Event Detection
abstract
A significant challenge in sound event detection (SED) is the effective utilization of unlabeled data, given the limited availability of labeled data due to high annotation costs. Semi-supervised algorithms rely on labeled data to learn from unlabeled data, and the performance is constrained by the quality and size of the former. In this paper, we introduce the Prototype based Masked Audio Model (PMAM) algorithm for self-supervised representation learning in SED, to better exploit unlabeled data. Specifically, semantically rich frame-level pseudo labels are constructed from a Gaussian mixture model (GMM) based prototypical distribution modeling. These pseudo labels supervise the leaning of a Transformer-based masked audio model, in which binary cross-entropy loss is employed instead of the widely used InfoNCE loss, to provide independent loss contributions from different prototypes, which is important in real scenarios in which multiple labels may apply to unsupervised data frames. A final stage of fine-tuning with just a small amount of labeled data yields a very high performing SED model. On like-for-like tests using the DESED task, our method achieves a PSDS1 score of 62.5%, surpassing current state-of-the-art models and demonstrating the superiority of the proposed technique.
Pengfei Cai, Yan Song 0001, Nan Jiang 0022, Qing Gu 0002, Ian McLoughlin 0001
ICASSP1
2025 Detect Any Sound: Open-Vocabulary Sound Event Detection with Multi-Modal Queries
abstract
Most existing sound event detection (SED) algorithms operate under a closed-set assumption, restricting their detection capabilities to predefined classes. While recent efforts have explored language-driven zero-shot SED by exploiting audio-language models, their performance is still far from satisfactory due to the lack of fine-grained alignment and cross-modal feature fusion. In this work, we propose the Detect Any Sound Model (DASM), a query-based framework for open-vocabulary SED guided by multi-modal queries. DASM formulates SED as a frame-level retrieval task, where audio features are matched against query vectors derived from text or audio prompts. To support this formulation, DASM introduces a dual-stream decoder that explicitly decouples event recognition and temporal localization: a cross-modality event decoder performs query-feature fusion and determines the presence of sound events at the clip-level, while a context network models temporal dependencies for frame-level localization. Additionally, an inference-time attention masking strategy is proposed to leverage semantic relations between base and novel classes, substantially enhancing generalization to novel classes. Experiments on the AudioSet Strong dataset demonstrate that DASM effectively balances localization accuracy with generalization to novel classes, outperforming CLAP-based methods in open-vocabulary setting (+ 7.8 PSDS) and the baseline in the closed-set setting (+ 6.9 PSDS). Furthermore, in cross-dataset zero-shot evaluation on DESED, DASM achieves a PSDS1 score of 42.2, even exceeding the supervised CRNN baseline. The project page is available at https://cai525.github.io/Transformer4SED/demo_page/DASM/.
Pengfei Cai, Yan Song 0001, Qing Gu 0002, Nan Jiang 0022, Ian McLoughlin 0001
ACM Multimedia1
2025 Physics-Constrained Flow Matching: Sampling Generative Models with Hard Constraints
abstract
Deep generative models have recently been applied to physical systems governed by partial differential equations (PDEs), offering scalable simulation and uncertainty-aware inference. However, enforcing physical constraints, such as conservation laws (linear and nonlinear) and physical consistencies, remains challenging. Existing methods often rely on soft penalties or architectural biases that fail to guarantee hard constraints. In this work, we propose Physics-Constrained Flow Matching (PCFM), a zero-shot inference framework that enforces arbitrary nonlinear constraints in pretrained flow-based generative models. PCFM continuously guides the sampling process through physics-based corrections applied to intermediate solution states, while remaining aligned with the learned flow and satisfying physical constraints. Empirically, PCFM outperforms both unconstrained and constrained baselines on a range of PDEs, including those with shocks, discontinuities, and sharp features, while ensuring exact constraint satisfaction at the final solution. Our method provides a flexible framework for enforcing hard constraints in both scientific and general-purpose generative models, especially in applications where constraint satisfaction is essential.
Utkarsh Utkarsh, Pengfei Cai, Alan Edelman, Rafael Gómez-Bombarelli, Christopher Rackauckas
NeurIPS2
2025 CMS-net: Edge-aware multimodal MRI feature fusion for brain tumor segmentation
Chunjie Lv, Biyuan Li, Xiuwei Wang, Pengfei Cai, Xuefeng Jia
Image Vis. Comput.4
2025 SG-UNet: Hybrid self-guided transformer and U-Net fusion for CT image segmentation
Chunjie Lv, Biyuan Li, Gaowei Sun, Xiuwei Wang, Pengfei Cai
J. Vis. Commun. Image Represent.5
2024 MAT-SED: A Masked Audio Transformer with Masked-Reconstruction Based Pre-training for Sound Event Detection
Pengfei Cai, Yan Song 0001, Ian McLoughlin 0001
INTERSPEECH1
2014 Expression Profile of the Schistosoma japonicum Degradome Reveals Differential Protease Expression Patterns and Potential Anti-schistosomal Intervention Targets
abstract
Blood fluke proteases play pivotal roles in the processes of invasion, nutrition acquisition, immune evasion, and other host-parasite interactions. Hundreds of genes encoding putative proteases have been identified in the recently published schistosome genomes. However, the expression profiles of these proteases in Schistosoma species have not yet been systematically analyzed. We retrieved and culled the redundant protease sequences of Schistosoma japonicum, Schistosoma mansoni, Echinococcus multilocularis, and Clonorchis sinensis from public databases utilizing bioinformatic approaches. The degradomes of the four parasitic organisms and Homo sapiens were then comparatively analyzed. A total of 262 S. japonicum protease sequences were obtained and the expression profiles generated using whole-genome microarray. Four main clusters of protease genes with different expression patterns were identified: proteases up-regulated in hepatic schistosomula and adult worms, egg-specific or predominantly expressed proteases, cercaria-specific or predominantly expressed proteases, and constantly expressed proteases. A subset of protease genes with different expression patterns were further validated using real-time quantitative PCR. The present study represents the most comprehensive analysis of a degradome in Schistosoma species to date. These results provide a firm foundation for future research on the specific function(s) of individual proteases and may help to refine anti-proteolytic strategies in blood flukes.
Pengfei Cai, Xianyu Piao, Nan Hou, Xiaosu Zhou
PLoS Comput. Biol.2