Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Zhenxiang Yan

dblp:99/9281 · DBLP profile ↗
← Back
1ranked-venue papers
0as first author
1since 2021 · last 2026
0009-0003-1648-496XORCID · reported

Domains — the database's venue-derived domains; a paper can count in several

Databases, data management, data science and information retrieval · 1 · 1 since 2021Applied, interdisciplinary, general and emerging computing · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Language models and text generation · 33% Learning paradigms · 33% Efficient and distributed learning · 17%

Topics — the 6 heaviest of 6, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Learning paradigms › continual learning › catastrophic forgetting
catastrophic forgetting mitigation
1.012026
Self-Evolving LLMs via Continual Instruction Tuning · WWW 2026
Natural language and speech › Language models and text generation › instruction tuning
continual instruction tuning
1.012026
Self-Evolving LLMs via Continual Instruction Tuning · WWW 2026
Machine learning › Learning paradigms
continual learning
1.012026
Self-Evolving LLMs via Continual Instruction Tuning · WWW 2026
Natural language and speech › Language models and text generation
instruction tuning
1.012026
Self-Evolving LLMs via Continual Instruction Tuning · WWW 2026
Machine learning › Deep learning architectures and training › mixture of experts
mixture-of-experts adaptation
1.012026
Self-Evolving LLMs via Continual Instruction Tuning · WWW 2026
Machine learning › Efficient and distributed learning
parameter-efficient fine-tuning
1.012026
Self-Evolving LLMs via Continual Instruction Tuning · WWW 2026

Methods — techniques the papers use, named apart from their topics

mixture of experts · 1.0generative adversarial network · 1.0adversarial training · 1.0LoRA · 1.0
YearPublicationVenuePosition
2026 Self-Evolving LLMs via Continual Instruction Tuning
abstract
In real-world industrial scenarios, large language models (LLMs) require Continuous Learning (CL) to adapt to diverse tasks as opera- tional requirements diversify, demanding self-evolution capabilities to autonomously refine their knowledge and adapt to dynamic envi- ronments. However, existing CL approaches, such as replay-based and parameter isolation techniques, struggle with the catastrophic forgetting problem: new task training degrades performance on prior tasks due to the model's adaptation to new data distributions, which weakens its generalization to old tasks. To address this issue, we propose a novel parameter-efficient adversarial MoE framework, MoE-CL, for industrial-scale self-evolving continual instruction tuning of LLMs. Specifically, MoE-CL employs a dual-expert archi- tecture to enable self-evolution: a dedicated LoRA expert for each task to preserve task-specific knowledge, ensuring parameter inde- pendence and mitigating forgetting, and a shared LoRA expert to facilitate cross-task knowledge transfer. Specifically, a task-aware discriminator within a Generative Adversarial Network (GAN) is integrated into the shared expert to suppress task-irrelevant noise, ensuring only task-aligned knowledge is transferred during se- quential task training. Through adversarial training, the shared ex- pert learns generalized representations that mimic the task-aware discriminator, while dedicated experts retain task-specific details, balancing knowledge retention and cross-task generalization—key to the model's self-evolution by autonomously optimizing knowl- edge integration across tasks. Extensive experiments on a public MTL5 benchmark and an industrial Tencent3 benchmark validate MoE-CL's effectiveness in self-evolving continual learning. In real- world A/B testing on content compliance review in the Tencent Video Platform, MoE-CL reduced manual review costs by 15.3%,demonstrating its applicability for large-scale industrial deploy- ment where self-evolution is critical for adapting to evolving op- erational demands. Implementation code is publicly available at https://github.com/BAI-LAB/MoE-CL.
Jiazheng Kang, Cheng Hou, Zhe Zhao 0006, Zhenxiang Yan, Ting Bai 0004
WWW5