Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Junwei Sheng

dblp:439/3639 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2026
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Language models and text generation · 100%

Topics — the 3 heaviest of 3, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Natural language and speech › Language models and text generation
alignment
1.012026
Compatibility-Aware Dynamic Fine-Tuning for Large Language Models · ACL (1) 2026
Natural language and speech › Language models and text generation
large language model
1.012026
Compatibility-Aware Dynamic Fine-Tuning for Large Language Models · ACL (1) 2026
Natural language and speech › Language models and text generation › large language model › large language model adaptation
supervised fine-tuning
1.012026
Compatibility-Aware Dynamic Fine-Tuning for Large Language Models · ACL (1) 2026

Methods — techniques the papers use, named apart from their topics

variance-controlled estimation · 1.0dynamic fine-tuning · 1.0
YearPublicationVenuePosition
2026 Compatibility-Aware Dynamic Fine-Tuning for Large Language Models
abstract
Supervised Fine-Tuning (SFT) is the predominant paradigm for aligning large language models (LLMs), yet it suffers from optimization instability and limited generalization.Recent work attributes this issue to pathological gradient scaling and proposes Dynamic Fine-Tuning (DFT) to correct it at the token level.However, DFT assumes all demonstrations are equally suitable learning targets, an assumption violated by the strong heterogeneity of large-scale instruction data, where demonstration-policy mismatch induces highvariance updates at the sample level.We introduce Compatibility-Aware Dynamic Fine-Tuning (CADFT), a principled extension of DFT that controls sample-level optimization variance.CADFT derives a dynamic, policydependent compatibility signal from model likelihoods to modulate supervised updates, suppressing high-variance gradients from incompatible demonstrations.We further propose a delayed, low-frequency compatibilityguided rewriting strategy to transform persistently incompatible demonstrations into learnable targets.We show that CADFT can be interpreted as a variance-controlled estimator that generalizes token-level stabilization in DFT to the sample level.Extensive experiments demonstrate improved stability, generalization, and cold-start reinforcement learning initialization, while remaining fully supervised and independent of explicit reward modeling.
Yucheng Zhou 0001, Junwei Sheng, Qianning Wang, Jianbing Shen
ACL (1)2