Demo Data from EDBT 2026 / reviewers in the wild / expert
Muzhi Dai
dblp:401/7486
· DBLP profile ↗
4ranked-venue papers
4as first author
4since 2021 · last 2025
0009-0004-6070-8470ORCID · corroborated
Domains — the database's venue-derived domains; a paper can count in several
Graphics, computer vision, multimedia, augmented reality and games · 3 · 3 first-author · 3 since 2021Artificial intelligence and machine learning · 2 · 2 first-author · 2 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
3 papers |
Reinforcement learning · 42% Language models and text generation · 42% Vision and language · 13% | |
| Interdisciplinary, comprehensive, and emerging computing
1 paper |
Bioinformatics and computational biology · 100% | |
| Network and information security
1 paper |
Security and privacy of machine learning · 100% |
Topics — the 14 heaviest of 15, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Language models and text generation
alignment |
0.9 | 1 | 2025 | From Captions to Rewards (CaReVL): Leveraging Large Language Model Experts for Enhanced Reward Modeling in Large Vision-Language Models · ACM Multimedia 2025 |
Natural language and speech › Language models and text generation › chain-of-thought reasoning
chain-of-thought generation |
0.9 | 1 | 2025 | S-GRPO: Early Exit via Reinforcement Learning in Reasoning Models · NeurIPS 2025 |
Machine learning › Reinforcement learning
policy optimization |
0.9 | 1 | 2025 | S-GRPO: Early Exit via Reinforcement Learning in Reasoning Models · NeurIPS 2025 |
Machine learning › Reinforcement learning › reward learning › reward modeling
preference reward modeling |
0.9 | 1 | 2025 | From Captions to Rewards (CaReVL): Leveraging Large Language Model Experts for Enhanced Reward Modeling in Large Vision-Language Models · ACM Multimedia 2025 |
Natural language and speech › Language models and text generation › large language model
reasoning model |
0.9 | 1 | 2025 | S-GRPO: Early Exit via Reinforcement Learning in Reasoning Models · NeurIPS 2025 |
Machine learning › Reinforcement learning › reward learning
reward modeling |
0.9 | 1 | 2025 | From Captions to Rewards (CaReVL): Leveraging Large Language Model Experts for Enhanced Reward Modeling in Large Vision-Language Models · ACM Multimedia 2025 |
Computer vision › Vision and language › vision-language model
vision-language model alignment |
0.9 | 1 | 2025 | From Captions to Rewards (CaReVL): Leveraging Large Language Model Experts for Enhanced Reward Modeling in Large Vision-Language Models · ACM Multimedia 2025 |
Bioinformatics and computational biology › structural bioinformatics
cryo-EM map analysis |
0.9 | 1 | 2025 | CryoDomain: Sequence-free Protein Domain Identification from Low-resolution Cryo-EM Density Maps · AAAI 2025 |
Bioinformatics and computational biology › protein structure analysis
protein domain identification |
0.9 | 1 | 2025 | CryoDomain: Sequence-free Protein Domain Identification from Low-resolution Cryo-EM Density Maps · AAAI 2025 |
Bioinformatics and computational biology
structural biology |
0.9 | 1 | 2025 | CryoDomain: Sequence-free Protein Domain Identification from Low-resolution Cryo-EM Density Maps · AAAI 2025 |
Security and privacy of machine learning › large language model safety
jailbreak defense |
0.9 | 1 | 2025 | Secure Tug-of-War (SecTOW): Iterative Defense-Attack Training with Reinforcement Learning for Multimodal Model Security · ACM Multimedia 2025 |
Security and privacy of machine learning › large language model security
multimodal large language model security |
0.9 | 1 | 2025 | Secure Tug-of-War (SecTOW): Iterative Defense-Attack Training with Reinforcement Learning for Multimodal Model Security · ACM Multimedia 2025 |
Machine learning › Efficient and distributed learning
inference efficiency |
0.3 | 1 | 2025 | S-GRPO: Early Exit via Reinforcement Learning in Reasoning Models · NeurIPS 2025 |
Natural language and speech › Language models and text generation
large language model |
0.3 | 1 | 2025 | From Captions to Rewards (CaReVL): Leveraging Large Language Model Experts for Enhanced Reward Modeling in Large Vision-Language Models · ACM Multimedia 2025 |
Methods — techniques the papers use, named apart from their topics
reinforcement learning · 2.6GRPO · 2.6supervised fine-tuning · 1.7weak supervision · 0.9transfer learning · 0.9reward shaping · 0.9preference pair construction · 0.9knowledge distillation · 0.9image captioning · 0.9cross-modal alignment · 0.9
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | CryoDomain: Sequence-free Protein Domain Identification from Low-resolution Cryo-EM Density MapsabstractCryo-electron microscopy (cryo-EM) has revolutionized the field of structural biology, determining structures of large protein machines and sharpening the understanding of fundamental biological processes. Despite cryo-EM’s unique capacity to discover novel proteins from unpurified samples and reveal the intricate structures of protein complexes within native cellular environments, the advancement of protein identification methods for cryo-EM lags behind. Without prior knowledge, such as sequence, protein identification from low-resolution density maps remains challenging. Here we introduce CryoDomain, an innovative method for identifying protein domains — conserved constituent units of proteins — from low-resolution cryo-EM density maps without requiring prior knowledge of protein sequences. CryoDomain leverages cross-modal alignment to correlate cryo-EM density maps with atomic structures, transferring the knowledge learned on a large atomic structure dataset to a sparse density map dataset. On two protein domain benchmarks constructed from CATH and SCOPe, CryoDomain significantly outperforms the state-of-the-art methods for domain identification from low-resolution density maps. CryoDomain liberates structural biologists from the tedious tasks of density inspection and database searching during protein identification. It has the potential to extend the border of unbiased structure discovery and cellular landscape investigation using cryo-EM. Muzhi Dai, Zhuoer Dong, Weining Fu, Kui Xu 0004, Qiangfeng Cliff Zhang |
AAAI | 1 |
| 2025 | Secure Tug-of-War (SecTOW): Iterative Defense-Attack Training with Reinforcement Learning for Multimodal Model SecurityabstractThe rapid advancement of multimodal large language models (MLLMs) has led to breakthroughs in various applications, yet their security remains a critical challenge. One pressing issue involves unsafe image-query pairs-jailbreak inputs specifically designed to bypass security constraints and elicit unintended responses from MLLMs. Compared to general multimodal data, such unsafe inputs are relatively sparse, which limits the diversity and richness of training samples available for developing robust defense models. Meanwhile, existing guardrail-type methods rely on external modules to enforce security constraints but fail to address intrinsic vulnerabilities within MLLMs. Traditional supervised fine-tuning (SFT), on the other hand, often over-refuses harmless inputs, compromising general performance. Given these challenges, we propose Secure Tug-of-War (SecTOW), an innovative iterative defense-attack training method to enhance the security of MLLMs. SecTOW consists of two modules: a defender and an auxiliary attacker, both trained iteratively using reinforcement learning (GRPO). During the iterative process, the attacker identifies security vulnerabilities in the defense model and expands jailbreak data. The expanded data are then used to train the defender, enabling it to address identified security vulnerabilities. We also design reward mechanisms used for GRPO to simplify the use of response labels, reducing dependence on complex generative labels and enabling the efficient use of synthetic data. Additionally, a quality monitoring mechanism is used to mitigate the defender's over-refusal of harmless inputs and ensure the diversity of the jailbreak data generated by the attacker. Experimental results on safety-specific and general benchmarks demonstrate that SecTOW significantly improves security while preserving general performance. Warning: This paper contains offensive and unsafe content. Muzhi Dai, Zhiyuan Zhao 0005, Junyu Gao 0001, Hao Sun 0038, Xuelong Li 0001 |
ACM Multimedia | 1 |
| 2025 | From Captions to Rewards (CaReVL): Leveraging Large Language Model Experts for Enhanced Reward Modeling in Large Vision-Language ModelsabstractAligning large vision-language models (LVLMs) with human preferences is challenging due to the scarcity of fine-grained, high-quality, and multimodal preference data without human annotations. Existing methods relying on direct distillation often struggle with low-confidence data, leading to suboptimal performance. To address this, we propose (CaReVL), a novel method for preference reward modeling by reliably using both high- and low-confidence data. First, a cluster of auxiliary expert models (textual reward models) innovatively leverages image captions as weak supervision signals to filter high-confidence data. The high-confidence data are then used to fine-tune the LVLM. Second, low-confidence data are used to generate diverse preference samples using the fine-tuned LVLM. These samples are then scored and selected to construct reliable chosen-rejected pairs for further training. (CaReVL) achieves performance improvements over traditional distillation-based methods on VL-RewardBench and MLLM-as-a-Judge benchmark, demonstrating its effectiveness. Muzhi Dai, Jiashuo Sun, Zhiyuan Zhao 0005, Junyu Gao 0001, Xuelong Li 0001 |
ACM Multimedia | 1 |
| 2025 | S-GRPO: Early Exit via Reinforcement Learning in Reasoning ModelsabstractAs Test-Time Scaling emerges as an active research focus in the large language model community, advanced post-training methods increasingly emphasize extending chain-of-thought (CoT) generation length, thereby enhancing reasoning capabilities to approach Deepseek R1-like reasoning models.
However, recent studies reveal that reasoning models (even Qwen3) consistently exhibit excessive thought redundancy in CoT generation. This overthinking issue arises from the inherent limitations of conventional outcome-reward reinforcement learning, which systematically overlooks the regulation of intermediate reasoning processes. This paper introduces Serial-Group Decaying-Reward Policy Optimization (S-GRPO), a novel reinforcement learning paradigm that enables models to implicitly evaluate the sufficiency of intermediate reasoning steps, thereby facilitating early exit in CoT generation.
Unlike GRPO, which samples multiple possible reasoning paths in parallel (parallel group), S-GRPO only samples one reasoning path and serially selects multiple temporal positions from the path to exit thinking and directly generate answers (serial group). For correct answers within a serial group, rewards gradually decrease based on the exit positions along the reasoning path from front to back. This design encourages the model to produce more accurate and concise thoughts, while also incentivizing early thinking termination when appropriate. Empirical evaluations demonstrate that S-GRPO is compatible with state-of-the-art reasoning models, including Qwen3 and Deepseek-distill. Across diverse benchmarks such as GSM8K, AIME 2024, AMC 2023, MATH-500, and GPQA Diamond, S-GRPO achieves a substantial reduction in sequence length (40.4%~61.1%) while simultaneously improving accuracy (absolute 0.72%~3.92%). Muzhi Dai, Chenxu Yang, Qingyi Si |
NeurIPS | 1 |