Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Lei Liang 0002

dblp:24/1476-2 · DBLP profile ↗
shortlisted ← Back
26ranked-venue papers
0as first author
26since 2021 · last 2026
0009-0000-9700-5809ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 15 · 15 since 2021Databases, data management, data science and information retrieval · 11 · 11 since 2021Graphics, computer vision, multimedia, augmented reality and games · 5 · 5 since 2021Systems, architecture and hardware · 1 · 1 since 2021Applied, interdisciplinary, general and emerging computing · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
17 papers
Language models and text generation · 26% Knowledge representation and reasoning · 23% Efficient and distributed learning · 20%
Databases, data mining, and information retrieval
8 papers
Knowledge graphs · 41% Indexing and storage engines · 26% Information retrieval · 13%
Theoretical computer science
1 paper
Mathematical optimization · 67% Graph algorithms and graph theory · 33%

Topics — the 30 heaviest of 54, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Natural language and speech › Question answering and dialogue systems
question answering over structured data
1.922026
Self-Correction Distillation for Structured Data Question Answering · AAAI 2026
TrustUQA: A Trustful Framework for Unified Structured Data Question Answering · AAAI 2025
Knowledge, reasoning and agents › Knowledge representation and reasoning › knowledge graph
knowledge graph completion
1.722025
Client-Server Co-design with Multi-modal Codebooks Makes Better and Faster Federate Knowledge Sharing · ACM Multimedia 2025
Croppable Knowledge Graph Embedding · ACL (1) 2025
Natural language and speech › Language models and text generation
retrieval-augmented generation
1.722025
MultiRAG: A Knowledge-Guided Framework for Mitigating Hallucination in Multi-Source Retrieval Augmented Generation · ICDE 2025
EventRAG: Enhancing LLM Generation with Event Knowledge Graphs · ACL (1) 2025
Indexing and storage engines
learned index
1.722025
High Performance or Low Memory? An Updatable Learned Index Framework for Time-Space Tradeoff · Proc. ACM Manag. Data 2025
ShapeShifter: Workload-Aware Adaptive Evolving Index Structures Based on Learned Models · WWW 2025
Machine learning › Efficient and distributed learning
distributed training
1.522024
Rethinking Memory and Communication Costs for Efficient Data Parallel Training of Large Language Models · NeurIPS 2024
AntDT: A Self-Adaptive Distributed Training Framework for Leader and Straggler Nodes · ICDE 2024
Knowledge, reasoning and agents › Knowledge representation and reasoning › knowledge graph
hyper-relational knowledge graph
1.012026
UniHR: Hierarchical Representation Learning for Unified Knowledge Graph Link Prediction · AAAI 2026
Machine learning › Efficient and distributed learning › model compression
knowledge distillation
1.012026
Self-Correction Distillation for Structured Data Question Answering · AAAI 2026
Knowledge, reasoning and agents › Knowledge representation and reasoning
knowledge graph
1.012026
UniHR: Hierarchical Representation Learning for Unified Knowledge Graph Link Prediction · AAAI 2026
Natural language and speech › Language models and text generation
large language model
1.012026
Self-Correction Distillation for Structured Data Question Answering · AAAI 2026
Natural language and speech › Language models and text generation
large language model fine-tuning
1.012026
LookAhead Tuning: Safer Language Models via Partial Answer Previews · WSDM 2026
Natural language and speech › Language models and text generation
large language model reasoning
1.012026
Thinker: Training LLMs in Hierarchical Thinking for Deep Search via Multi-Turn Interaction · AAAI 2026
Natural language and speech › Question answering and dialogue systems
retrieval-augmented reasoning
1.012026
Thinker: Training LLMs in Hierarchical Thinking for Deep Search via Multi-Turn Interaction · AAAI 2026
Machine learning › Trustworthy machine learning
robustness
1.012026
LookAhead Tuning: Safer Language Models via Partial Answer Previews · WSDM 2026
Machine learning › Trustworthy machine learning › AI safety › safety alignment
safety alignment preservation
1.012026
LookAhead Tuning: Safer Language Models via Partial Answer Previews · WSDM 2026
Natural language and speech › Language models and text generation › large language model safety
safety fine-tuning
1.012026
LookAhead Tuning: Safer Language Models via Partial Answer Previews · WSDM 2026
Knowledge, reasoning and agents › Knowledge representation and reasoning › knowledge graph
temporal knowledge graph
1.012026
UniHR: Hierarchical Representation Learning for Unified Knowledge Graph Link Prediction · AAAI 2026
Machine learning › Efficient and distributed learning
federated learning
0.912025
Client-Server Co-design with Multi-modal Codebooks Makes Better and Faster Federate Knowledge Sharing · ACM Multimedia 2025
Natural language and speech › Language models and text generation
hallucination mitigation
0.912025
MultiRAG: A Knowledge-Guided Framework for Mitigating Hallucination in Multi-Source Retrieval Augmented Generation · ICDE 2025
Natural language and speech › Question answering and dialogue systems
knowledge base question answering
0.912025
RTQA : Recursive Thinking for Complex Temporal Knowledge Graph Question Answering with Large Language Models · EMNLP 2025
Knowledge, reasoning and agents › Knowledge representation and reasoning › knowledge graph
knowledge graph embedding
0.912025
Croppable Knowledge Graph Embedding · ACL (1) 2025
Machine learning › Efficient and distributed learning › parameter-efficient fine-tuning
low-rank adaptation
0.912025
HiMoLE: Towards OOD-Robust LoRA via Hierarchical Mixture of Experts · NeurIPS 2025
Machine learning › Deep learning architectures and training
mixture of experts
0.912025
HiMoLE: Towards OOD-Robust LoRA via Hierarchical Mixture of Experts · NeurIPS 2025
Machine learning › Trustworthy machine learning
out-of-distribution generalization
0.912025
HiMoLE: Towards OOD-Robust LoRA via Hierarchical Mixture of Experts · NeurIPS 2025
Machine learning › Efficient and distributed learning
parameter-efficient fine-tuning
0.912025
HiMoLE: Towards OOD-Robust LoRA via Hierarchical Mixture of Experts · NeurIPS 2025
Natural language and speech › Question answering and dialogue systems › knowledge base question answering
temporal knowledge graph question answering
0.912025
RTQA : Recursive Thinking for Complex Temporal Knowledge Graph Question Answering with Large Language Models · EMNLP 2025
Knowledge, reasoning and agents › Knowledge representation and reasoning
temporal reasoning
0.912025
RTQA : Recursive Thinking for Complex Temporal Knowledge Graph Question Answering with Large Language Models · EMNLP 2025
Knowledge graphs › temporal knowledge graph
event knowledge graph
0.912025
EventRAG: Enhancing LLM Generation with Event Knowledge Graphs · ACL (1) 2025
Knowledge graphs › knowledge graph querying
knowledge graph question answering
0.912025
TrustUQA: A Trustful Framework for Unified Structured Data Question Answering · AAAI 2025
Machine learning › Efficient and distributed learning › distributed training
data parallel training
0.812024
Rethinking Memory and Communication Costs for Efficient Data Parallel Training of Large Language Models · NeurIPS 2024
Natural language and speech › Language models and text generation
hallucination detection
0.812024
Unified Hallucination Detection for Multimodal Large Language Models · ACL (1) 2024

Methods — techniques the papers use, named apart from their topics

trajectory logging · 2.0multi-model routing · 2.0SIMD-style concurrency · 2.0two-stage distillation · 1.0self-correction distillation · 1.0multi-turn interaction · 1.0message passing · 1.0knowledge boundary determination · 1.0hierarchical thinking · 1.0hierarchical representation learning · 1.0error prompt mechanism · 1.0data-driven fine-tuning · 1.0answer prefix previewing · 1.0multi-hop reasoning · 0.9line graph · 0.9large language model · 0.9knowledge-guided retrieval · 0.9iterative retrieval · 0.9
YearPublicationVenuePosition
2026 UniHR: Hierarchical Representation Learning for Unified Knowledge Graph Link Prediction
abstract
Real-world knowledge graphs (KGs) contain not only standard triple-based facts, but also more complex, heterogeneous types of facts, such as hyper-relational facts with auxiliary key-value pairs, temporal facts with additional timestamps, and nested facts that imply relationships between facts. These richer forms of representation have attracted significant attention due to their enhanced expressiveness and capacity to model complex semantics in real-world scenarios. However, most existing studies suffer from two main limitations: (1) they typically focus on modeling only specific types of facts, thus making it difficult to generalize to real-world scenarios with multiple fact types; and (2) they struggle to achieve generalizable hierarchical (inter-fact and intra-fact) modeling due to the complexity of these representations. To overcome these limitations, we propose UniHR, a Unified Hierarchical Representation learning framework, which consists of a learning-optimized Hierarchical Data Representation (HiDR) module and a unified Hierarchical Structure Learning (HiSL) module. The HiDR module unifies hyper-relational KGs, temporal KGs, and nested factual KGs into triple-based representations. Then HiSL incorporates intra-fact and inter-fact message passing, focusing on enhancing both semantic information within individual facts and enriching the structural information between facts. To go beyond the unified method itself, we further explore the potential of unified representation in complex real-world scenarios. Extensive experiments on 9 datasets across 5 types of KGs demonstrate the effectiveness of UniHR and highlight the strong potential of unified representations.
Yin Hua, Mingyang Chen 0002, Yichi Zhang 0009, Zhuo Chen 0007, Lei Liang 0002, Wen Zhang 0015
AAAI6
2026 Thinker: Training LLMs in Hierarchical Thinking for Deep Search via Multi-Turn Interaction
abstract
Efficient retrieval of external knowledge bases and web pages is crucial for enhancing the reasoning abilities of LLMs. Previous works on training LLMs to leverage external retrievers for solving complex problems have predominantly employed end-to-end reinforcement learning. However, these approaches neglect supervision over the reasoning process, making it difficult to guarantee logical coherence and rigor. To address these limitations, we propose Thinker, a hierarchical thinking model for deep search through multi-turn interaction, making the reasoning process supervisable and verifiable. It decomposes complex problems into independently solvable sub-problems, each dually represented in both natural language and an equivalent logical function to support knowledge base and web searches. Concurrently, dependencies between sub-problems are passed as parameters via these logical functions, enhancing the logical coherence of the problem-solving process. To avoid unnecessary external searches, we perform knowledge boundary determination to check if a sub-problem is within the LLM's intrinsic knowledge, allowing it to answer directly. Experimental results indicate that with as few as several hundred training samples, the performance of Thinker is competitive with established baselines. Furthermore, when scaled to the full training set, Thinker significantly outperforms these methods across various datasets and model sizes.
Jun Xu 0030, Xinkai Du, Yu Ao, Peilong Zhao, Zhongpu Bo, Mengshu Sun, Zhengke Gui, Dalong Zhang, ZhaoYang Wang, Yangyang Hou, ZhiYing Yi, Haofen Wang, Huajun Chen, Lei Liang 0002, Jun Zhou 0011
AAAI19
2026 Self-Correction Distillation for Structured Data Question Answering
abstract
Structured data question answering (QA), including table QA, Knowledge Graph (KG) QA, and temporal KG QA, is a pivotal research area. Advances in large language models (LLMs) have driven significant progress in unified structural QA frameworks like TrustUQA. However, these frameworks face challenges when applied to small-scale LLMs since small-scale LLMs are prone to errors in generating structured queries. To improve the structured data QA ability of small-scale LLMs, we propose a self-correction distillation (SCD) method. In SCD, an error prompt mechanism (EPM) is designed to detect errors and provide customized error messages during inference, and a two-stage distillation strategy is designed to transfer large-scale LLMs' query-generation and error-correction capabilities to small-scale LLM. Experiments across 5 benchmarks with 3 structured data types demonstrate that our SCD achieves the best performance and superior generalization on small-scale LLM (8B) compared to other distillation methods, and closely approaches the performance of GPT4 on some datasets. Furthermore, large-scale LLMs equipped with EPM surpass the state-of-the-art results on most datasets.
Yushan Zhu, Wen Zhang 0015, Mengshu Sun, Juan Li 0010, Lei Liang 0002, Chong Long, Chao Deng 0002, Junlan Feng
AAAI8
2026 C3Flow: SIMD-Style Concurrent Claude Code Workflow for Scaling Deep Research
abstract
Deep research is a retrieval-intensive task that requires iteratively retrieving evidence, reading across sources, and synthesizing source-grounded outputs. In practice, real-world deep research applications are of high workloads that require generating massive reports or conducting large-scale literature surveys. Such applications increasingly require batch processing capabilities, which are missing from traditional chat-oriented agents, limiting throughput when processing large volumes of structurally similar jobs. We introduce C3Flow (Concurrent Claude Code Workflow), a framework that transforms Claude Code from an interactive assistant into a SIMD-style (Single Instruction, Multiple Data) concurrent compute engine. C³Flow treats each agent instance as an isolated, schedulable unit capable of handling declarative multi-step tasks, multi-model routing, and comprehensive trajectory logging. On BrowseComp-zh, C³Flow improves pass@1 from 48.44% to 61.59% and pass@3 from 70.24% to 77.51% compared to standard function calling, while reducing average latency. For multi-hop fact verification, C3Flow achieves a 5.9 speedup over human annotators while maintaining 87.5% accuracy, demonstrating its effectiveness for production-scale deep research pipelines. Code is available at~ https://github.com/RAGenius/C3Flow.
Yijie Zhong 0001, Zhidong Fan, Zhengke Gui, Lei Liang 0002, Yun Xiong, Haofen Wang
SIGIR6
2026 LookAhead Tuning: Safer Language Models via Partial Answer Previews
abstract
Fine-tuning enables large language models (LLMs) to adapt to specific domains, but often compromises their previously established safety alignment. To mitigate the degradation of model safety during fine-tuning, we introduce LookAhead Tuning, a lightweight and effective data-driven approach that preserves safety during fine-tuning. The method introduces two simple strategies that modify training data by previewing partial answer prefixes, thereby minimizing perturbations to the model's initial token distributions and maintaining its built-in safety mechanisms. Comprehensive experiments demonstrate that LookAhead Tuning effectively maintains model safety without sacrificing robust performance on downstream tasks. Our findings position LookAhead Tuning https://github.com/zjunlp/LookAheadTuning as a reliable and efficient solution for the safe and effective adaptation of LLMs.
Kangwei Liu 0002, Mengshu Sun, Lei Liang 0002, Zhiqiang Zhang 0012, Jun Zhou 0011, Bryan Hooi, Shumin Deng
WSDM6
2025 TrustUQA: A Trustful Framework for Unified Structured Data Question Answering
abstract
Natural language question answering (QA) over structured data sources such as tables and knowledge graphs have been widely investigated, especially with Large Language Models (LLMs) in recent years. The main solutions include question to formal query parsing and retrieval-based answer generation. However, current methods of the former often suffer from weak generalization, failing to dealing with multi-types of sources, while the later is limited in trustfulness. In this paper, we propose TrustUQA, a trustful QA framework that can simultaneously support multiple types of structured data in a unified way. To this end, it adopts an LLM-friendly and unified knowledge representation method called Condition Graph (CG), and uses an LLM and demonstration-based two-level method for CG querying. For enhancement, it is also equipped with dynamic demonstration retrieval. We have evaluated TrustUQA with 5 benchmarks covering 3 types of structured data. It outperforms 2 existing unified structured data QA methods. In comparison with the baselines that are specific to one data type, it achieves state-of-the-art on 2 of the datasets. Further more, we have demonstrated the potential of our method for more general QA tasks, QA over mixed structured data and QA across structured data.
Wen Zhang 0015, Yushan Zhu, Jiaoyan Chen 0001, Zhiwei Huang 0006, Yin Hua, Lei Liang 0002, Huajun Chen
AAAI8
2025 EventRAG: Enhancing LLM Generation with Event Knowledge Graphs
abstract
Retrieval-augmented generation (RAG) systems often struggle with narrative-rich documents and event-centric reasoning, particularly when synthesizing information across multiple sources. We present EventRAG, a novel framework that enhances text generation through structured event representations. We first construct an Event Knowledge Graph by extracting events and merging semantically equivalent nodes across documents, while expanding under-connected relationships. We then employ an iterative retrieval and inference strategy that explicitly captures temporal dependencies and logical relationships across events. Experiments on UltraDomain and MultiHopRAG benchmarks show EventRAG’s superiority over baseline RAG systems, with substantial gains in generation effectiveness, logical consistency, and multi-hop reasoning accuracy. Our work advances RAG systems by integrating structured event semantics with iterative inference, particularly benefiting scenarios requiring temporal and logical reasoning across documents.
Zairun Yang, Zhengyan Shi, Lei Liang 0002, Keyan Ding, Emine Yilmaz, Huajun Chen, Qiang Zhang 0026
ACL (1)5
2025 Have We Designed Generalizable Structural Knowledge Promptings? Systematic Evaluation and Rethinking
abstract
Yichi Zhang, Zhuo Chen, Lingbing Guo, Yajing Xu, Shaokai Chen, Mengshu Sun, Binbin Hu, Zhiqiang Zhang, Lei Liang, Wen Zhang, Huajun Chen. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
Yichi Zhang 0009, Zhuo Chen 0007, Lingbing Guo, Shaokai Chen, Mengshu Sun, Binbin Hu, Zhiqiang Zhang 0012, Lei Liang 0002, Wen Zhang 0015, Huajun Chen
ACL (1)9
2025 Croppable Knowledge Graph Embedding
abstract
Knowledge Graph Embedding (KGE) is a common approach for Knowledge Graphs (KGs) in AI tasks. Embedding dimensions depend on application scenarios. Requiring a new dimension means training a new KGE model from scratch, increasing cost and limiting efficiency and flexibility. In this work, we propose a novel KGE training framework MED. It allows one training to obtain a croppable KGE model for multiple scenarios with different dimensional needs. Sub-models of required dimensions can be directly cropped and used without extra training. In MED, we propose a mutual learning mechanism to improve the low-dimensional sub-models and make high-dimensional sub-models retain the low-dimensional sub-models’ capacity, an evolutionary improvement mechanism to promote the high-dimensional sub-models to master the triple that the low-dimensional sub-models can not, and a dynamic loss weight to adaptively balance the multiple losses. Experiments on 4 KGE models across 4 standard KG completion datasets, 3 real-world scenarios using a large-scale KG, and extending MED to the BERT language model demonstrate its effectiveness, high efficiency, and flexible extensibility.
Yushan Zhu, Wen Zhang 0015, Mingyang Chen 0002, Lei Liang 0002, Huajun Chen
ACL (1)5
2025 GoT-R: Enhancing Large Language Models for Complex Question Answering with Graph-of-Thought Guided Reasoning
Peixuan Huang, Bohan Li 0001, Haofen Wang, Mengfei Xu, Lei Liang 0002, Meng Wang 0009
DASFAA (2)7
2025 RTQA : Recursive Thinking for Complex Temporal Knowledge Graph Question Answering with Large Language Models
abstract
Current temporal knowledge graph question answering (TKGQA) methods primarily focus on implicit temporal constraints, lacking the capability of handling more complex temporal queries, and struggle with limited reasoning abilities and error propagation in decomposition frameworks.We propose RTQA, a novel framework to address these challenges by enhancing reasoning over TKGs without requiring training.Following recursive thinking, RTQA recursively decomposes questions into sub-problems, solves them bottom-up using LLMs and TKG knowledge, and employs multi-path answer aggregation to improve fault tolerance.RTQA consists of three core components: the Temporal Question Decomposer, the Recursive Solver, and the Answer Aggregator.Experiments on MultiTQ and TimelineKGQA benchmarks demonstrate significant Hits@1 improvements in "Multiple" and "Complex" categories, outperforming state-of-the-art methods.Our code and data are available at https://github.com/zjukg/RTQA.Historical Facts South Korea hosted a visit from China on 2009-05-12.Stephen W. Bosworth made a visit to China on 2009-05-13.Lawrence Cannon made a visit to China on 2009-05-12.China made a visit to South Korea on 2009-05-12.Abdullah Gül hosted a visit from China on 2009-05-12.Stephen W. Bosworth made a visit to China on 2009-05-08.Kuomintang made a visit to China on 2009-05-27.Lawrence Cannon made a visit to China on 2009-05-13.Stephen W. Bosworth made a visit to China on 2009-05-15.Wen Jiabao made a visit to China on 2009-05-09.Kuomintang made a visit to China on 2009-05-26.China hosted a visit from Iran on 2009-10-15.Wen Jiabao made a visit to China on 2009-05-08.China hosted a visit from France on 2009-05-07.Ma Biao made a visit to China on 2009-07-05.Georgios Papandreou made a visit to China on 2009-05-12.China made a visit to Kazakhstan on 2009-06-12.Abhisit Vejjajiva made a visit to China on 2009-06-15.Wen Jiabao made a visit to China on 2009-05-28.Wu Po-hsiung made a visit to China on 2009-05-25.Eric Chu made a visit to China on 2009-05-17.Barack Obama made a visit to China on 2009-10-12.Abhisit Vejjajiva made a visit to China on 2009-06-25.Xi Jinping made a visit to China on 2009-06-22.China hosted a
Zhaoyan Gong, Juan Li 0010, Lei Liang 0002, Huajun Chen, Wen Zhang 0015
EMNLP4
2025 MultiRAG: A Knowledge-Guided Framework for Mitigating Hallucination in Multi-Source Retrieval Augmented Generation
abstract
Retrieval Augmented Generation (RAG) has emerged as a promising solution to address hallucination issues in Large Language Models (LLMs). However, the integration of multiple retrieval sources, while potentially more informative, introduces new challenges that can paradoxically exacerbate hallucination problems. These challenges manifest primarily in two aspects: the sparse distribution of multi-source data that hinders the capture of logical relationships and the inherent inconsistencies among different sources that lead to information conflicts. To address these challenges, we propose MultiRAG, a novel framework designed to mitigate hallucination in multi-source retrieval-augmented generation through knowledge-guided approaches. Our framework introduces two key innovations: (1) a knowledge construction module that employs multi-source line graphs to efficiently aggregate logical relationships across different knowledge sources, effectively addressing the sparse data distribution issue; and (2) a sophisticated retrieval module that implements a multi-level confidence calculation mechanism, performing both graph-level and node-level assessments to identify and eliminate unreliable information nodes, thereby reducing hallucinations caused by inter-source inconsistencies. Extensive experiments on four multi-domain query datasets and two multi-hop QA datasets demonstrate that MultiRAG significantly enhances the reliability and efficiency of knowledge retrieval in complex multi-source scenarios. Our code is available in https://github.com/wuwenlong123/MultiRAG.
Haofen Wang, Bohan Li 0001, Peixuan Huang, Xinzhe Zhao, Lei Liang 0002
ICDE6
2025 FlexRLHF: A Flexible Placement and Parallelism Framework for Efficient RLHF Training
abstract
Recently, ChatGPT or InstructGPT like large language models (LLM) has made a significant impact in the AI world. Many works have attempted to reproduce the complex InstructGPT's training pipeline, namely Reinforcement Learning with Human Feedback (RLHF). However, the mainstream distributed RLHF training methods typically adopt a fixed model placement strategy, referred to as the All-colocated strategy. This strategy treats all four interdependent models involved in RLHF as a single entity, distributing them across all devices and applying parallelism techniques designed for a single model, regardless of the workload heterogeneity inherent to each model. As a result, this strategy exacerbates memory constraints and generation bottlenecks in RLHF training. To address these issues, we propose a flexible model placement framework that offers two general and agile model placement strategies. The Interleaving strategy helps improve memory utilization and communication efficiency of RLHF training by placing models without dependencies on exclusive devices with careful orchestration. On the other hand, the Disaggregated strategy improves the throughput of model training by separating the training and inference runtime of the RLHF pipeline with additional shadow models. Furthermore, our framework provides a simple user interface and guidelines to easily and flexibly configure these strategies in various training scenarios. Our experiments have shown that our strategy can achieve notable improvements up to$12\times$, compared to Deepspeed-Chat or trlX. The results highlight the effectiveness and adaptability of our methods in accelerating the training of distributed RLHF.
Youshao Xiao, Zhenglei Zhou, Fagui Mao, Weichang Wu, Shangchun Zhao, Lin Ju, Lei Liang 0002, Jun Zhou 0011
IPDPS7
2025 Client-Server Co-design with Multi-modal Codebooks Makes Better and Faster Federate Knowledge Sharing
abstract
Knowledge graphs (KGs) are widely used to store multi-source and heterogeneous structural knowledge, making federated knowledge graph completion (FedKGC) a crucial research topic. FedKGC aims to complete distributed KGs while maintaining privacy and security. Existing FedKGC methods primarily rely on uni-modal structural embedding aggregation for global knowledge sharing, which suffers from the demanding assumption that intersecting entities exist across different clients and are known by the omniscient server. Meanwhile, these uni-modal structure-only methods neglect the exploitation of client-side multi-modal information. In this paper, we propose a new framework MuCo2 to kill two birds with one stone and facilitate client-server co-design through multi-modal codebooks (MuCo). Moving beyond the traditional structure-only paradigm, we introduce multi-modal information of entities as the foundation for KGC modeling and communication. We design a MuCo-based fine-grained KGC model on the client and a MuCo-based communication mechanism on the server, which does not require entity mapping in global aggregation anymore. Comprehensive experiments demonstrate the effectiveness, generalization, reasonability, efficiency, and explainability of MuCo2.
Yichi Zhang 0009, Zhuo Chen 0007, Lingbing Guo, Lei Liang 0002, Wen Zhang 0015, Huajun Chen
ACM Multimedia5
2025 HiMoLE: Towards OOD-Robust LoRA via Hierarchical Mixture of Experts
abstract
Parameter-efficient fine-tuning (PEFT) methods, such as LoRA, have enabled the efficient adaptation of large language models (LLMs) by updating only a small subset of parameters. However, their robustness under out-of-distribution (OOD) conditions remains insufficiently studied. In this paper, we identify the limitations of conventional LoRA in handling distributional shifts and propose $\textbf{HiMoLE}$($\textbf{Hi}$erarchical $\textbf{M}$ixture of $\textbf{L}$oRA $\textbf{E}$xperts), a new framework designed to improve OOD generalization. HiMoLE integrates hierarchical expert modules and hierarchical routing strategies into the LoRA architecture and introduces a two-phase training procedure enhanced by a diversity-driven loss. This design mitigates negative transfer and promotes effective knowledge adaptation across diverse data distributions. We evaluate HiMoLE on three representative tasks in natural language processing. Experimental results evidence that HiMoLE consistently outperforms existing LoRA-based approaches, significantly reducing performance degradation on OOD data while improving in-distribution performance. Our work bridges the gap between parameter efficiency and distributional robustness, advancing the practical deployment of LLMs in real-world applications.
Yinuo Jiang, Keyan Ding, Deng Zhao, Lei Liang 0002, Qiang Zhang 0026, Huajun Chen
NeurIPS5
2025 ShapeShifter: Workload-Aware Adaptive Evolving Index Structures Based on Learned Models
abstract
In real-world tasks like data management and Web search, index operations often exhibit strong skewness, unlike standard benchmarks with uniform data distribution. While learned indexes improve query and update efficiency, they typically fail to address the skewed workload access, often prioritizing a single performance metric at the cost of overall index effectiveness. Additionally, the full reliance on learned models can increase vulnerability to attacks, compromising system stability. To address these challenges, we propose ShapeShifter, an adaptive evolutionary structure based on traditional indexes, capable of dynamically adjusting node structures according to the workload. ShapeShifter introduces a node evolution strategy with workload-skew-aware policies to adaptively adjust and optimize the partial index structure, leveraging a hybrid mechanism that combines traditional and learned structures for robust performance and optimal time-space tradeoff under skewed workloads and extreme data conditions. The evaluation results show that ShapeShifter achieves the optimal tradeoff while maintaining robustness.
Hui Wang 0074, Xin Wang 0030, Jiake Ge, Lei Liang 0002
WWW4
2025 High Performance or Low Memory? An Updatable Learned Index Framework for Time-Space Tradeoff
abstract
The first generation of learned indexes inherently achieved lower space overhead than traditional index structures, establishing this advantage as one of the pivotal research directions in index optimization. However, in their pursuit of peak performance, designers often significantly increase space overhead, which becomes infeasible in scenarios with limited storage space. Furthermore, the design of current learned indexes optimized for time-space tradeoff is flawed, as they collapse catastrophically under prevalent dense or duplicate insertion workloads. To address these challenges, we first quantitatively analyze the time-space correlation characteristics of learned indexes from a theoretical perspective and identify the core influencing factors. Based on this, time-space cost minimization function models are established and an updatable learned index framework, LIFT, is constructed. Furthermore, LIFT incorporates specifically designed structural adjustment mechanisms to effectively counter existing poisoning attacks, significantly enhancing index robustness without increasing time-space cost. Evaluation results demonstrate that LIFT consistently achieves the optimal time-space tradeoff across various workloads and datasets, outperforming all other state-of-the-art indexes.
Hui Wang 0074, Xin Wang 0030, Jiake Ge, Yunpeng Chai, Lei Liang 0002
Proc. ACM Manag. Data5
2024 Unified Hallucination Detection for Multimodal Large Language Models
abstract
Xiang Chen, Chenxi Wang, Yida Xue, Ningyu Zhang, Xiaoyan Yang, Qiang Li, Yue Shen, Lei Liang, Jinjie Gu, Huajun Chen. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.
Xiang Chen 0016, Yida Xue, Ningyu Zhang 0001, Qiang Li 0022, Lei Liang 0002, Jinjie Gu, Huajun Chen
ACL (1)8
2024 Unleashing the Power of Imbalanced Modality Information for Multi-modal Knowledge Graph Completion
abstract
Multi-modal knowledge graph completion (MMKGC) aims to predict the missing triples in the multi-modal knowledge graphs by incorporating structural, visual, and textual information of entities into the discriminant models. The information from different modalities will work together to measure the triple plausibility. Existing MMKGC methods overlook the imbalance problem of modality information among entities, resulting in inadequate modal fusion and inefficient utilization of the raw modality information. To address the mentioned problems, we propose Adaptive Multi-modal Fusion and Modality Adversarial Training (AdaMF-MAT) to unleash the power of imbalanced modality information for MMKGC. AdaMF-MAT achieves multi-modal fusion with adaptive modality weights and further generates adversarial samples by modality-adversarial training to enhance the imbalanced modality information. Our approach is a co-design of the MMKGC model and training strategy which can outperform 19 recent MMKGC methods and achieve new state-of-the-art results on three public MMKGC benchmarks. Our code and data have been released at https://github.com/zjukg/AdaMF-MAT.
Yichi Zhang 0009, Zhuo Chen 0007, Lei Liang 0002, Huajun Chen, Wen Zhang 0015
LREC/COLING3
2024 Prompt-fused Framework for Inductive Logical Query Answering
abstract
Answering logical queries on knowledge graphs (KG) poses a significant challenge for machine reasoning. The primary obstacle in this task stems from the inherent incompleteness of KGs. Existing research has predominantly focused on addressing the issue of missing edges in KGs, thereby neglecting another aspect of incompleteness: the emergence of new entities. Furthermore, most of the existing methods tend to reason over each logical operator separately, rather than comprehensively analyzing the query as a whole during the reasoning process. In this paper, we propose a query-aware prompt-fused framework named Pro-QE, which could incorporate existing query embedding methods and address the embedding of emerging entities through contextual information aggregation. Additionally, a query prompt, which is generated by encoding the symbolic query, is introduced to gather information relevant to the query from a holistic perspective. To evaluate the efficacy of our model in the inductive setting, we introduce two new challenging benchmarks. Experimental results demonstrate that our model successfully handles the issue of unseen entities in logical queries. Furthermore, the ablation study confirms the efficacy of the aggregator and prompt components.
Zezhong Xu, Wen Zhang 0015, Peng Ye 0007, Lei Liang 0002, Huajun Chen
LREC/COLING4
2024 AntDT: A Self-Adaptive Distributed Training Framework for Leader and Straggler Nodes
abstract
Many distributed training techniques like Parameter Server and AllReduce have been proposed to take advantage of the increasingly large data and rich features. However, stragglers frequently occur in distributed training due to resource contention and hardware heterogeneity, which significantly hampers the training efficiency. Previous works only address part of the stragglers and could not adaptively solve various stragglers in practice. Additionally, it is challenging to use a systematic framework to address all stragglers because different stragglers require diverse data allocation and fault-tolerance mechanisms. Therefore, this paper proposes a unified distributed training framework called AntDT (Ant Distributed Training Framework) to adaptively solve the straggler problems. Firstly, the framework consists of four components, including the Stateful Dynamic Data Sharding service, Monitor, Controller, and Agent. These components work collaboratively to efficiently distribute workloads and provide a range of pre-defined straggler mitigation methods with fault tolerance, thereby hiding messy details of data allocation and fault handling. Secondly, the framework provides a high degree of flexibility, allowing for the customization of straggler mitigation solutions based on the specific circumstances of the cluster. Leveraging this flexibility, we introduce two straggler mitigation solutions, namely AntDT-ND for non-dedicated clusters and AntDT-DD for dedicated clusters, as practical examples to resolve various types of stragglers at Ant Group. Justified by our comprehensive experiments and industrial deployment statistics, AntDT outperforms other SOTA methods more than 3 × in terms of training efficiency. Additionally, in Alipay's homepage recommendation scenario, using AntDT reduces the training duration of the ranking model from 27.8 hours to just 5.4 hours.
Youshao Xiao, Lin Ju, Zhenglei Zhou, Zhaoxin Huan, Dalong Zhang, Rujie Jiang, Lin Wang 0098, Lei Liang 0002, Jun Zhou 0011
ICDE10
2024 Efficient and Effective Anchored Densest Subgraph Search: A Convex-programming based Approach
abstract
The quest to identify local dense communities closely connected to predetermined seed nodes is vital across numerous applications. Given the seed nodes R, the R-subgraph density of a subgraph S is defined as traditional graph density of S with penalties on the nodes in S / R. The state-of-the-art (SOTA) anchored densest subgraph model, which is based on R-subgraph density, is designed to address the community search problem. However, it often struggles to efficiently uncover truly dense communities. To eliminate this issue, we propose a novel NR-subgraph density metric, a nuanced measure that identifies communities intimately linked to seed nodes and also exhibiting overall high graph density. We redefine the anchored densest subgraph search problem through the lens of NR-subgraph density and cast it as a Linear Programming (LP) problem. This allows us to transition into a dual problem, tapping into the efficiency and effectiveness of convex programming-based iterative algorithm. To solve this redefined problem, we propose two algorithms: FDP, an iterative method that swiftly attains near-optimal solutions, and FDPE, an exact approach that ensures full convergence. We perform extensive experiments on 12 real-world networks. The results show that our proposed algorithms not only outperform the SOTA methods by 3.6~14.1 times in terms of running time, but also produce subgraphs with superior internal quality.
Rong-Hua Li 0001, Lei Liang 0002, Zhizhen Liu, Longlong Lin, Guoren Wang
KDD3
2024 Rethinking Memory and Communication Costs for Efficient Data Parallel Training of Large Language Models
abstract
Recently, various strategies for distributed training of large language models (LLMs) have been proposed. By categorizing them into basic strategies and composite strategies, we have discovered that existing basic strategies provide limited options in specific scenarios, leaving considerable room for optimization in training speed. In this paper, we rethink the impact of memory and communication costs on the training speed of LLMs, taking into account the impact of intra- and inter-group communication performance disparities, and then propose a new set of basic strategies named the \textbf{Pa}rtial \textbf{R}edundancy \textbf{O}ptimizer (PaRO). PaRO Data Parallelism (PaRO-DP) accelerates LLM training through refined model state partitioning and tailored training procedures. At the same time, PaRO Collective Communications (PaRO-CC) speeds up collective communication operations by rearranging the topology. We also propose a guideline for choosing different DP strategies based on simple quantitative calculations, which yields minimal ranking errors. Our experiments demonstrate that PaRO improves the training speed of LLMs by up to 266\% that of ZeRO-3 as basic DP strategies. Moreover, employing PaRO-CC independently for model parallel strategies, such as Megatron, can also boost the training speed by 17\%.
Lin Ju, Chan Wu, Jinjing Huang, Youshao Xiao, Zhenglei Zhou, Zhiming Fan, Zhaoxin Huan, Fanzhuang Meng, Lei Liang 0002, Jun Zhou 0011
NeurIPS11
2024 InstructIE: A Bilingual Instruction-based Information Extraction Dataset
Honghao Gui, Shuofei Qiao, Jintian Zhang, Hongbin Ye, Mengshu Sun, Lei Liang 0002, Jeff Z. Pan, Huajun Chen, Ningyu Zhang 0001
ISWC (3)6
2024 InBox: Recommendation with Knowledge Graph using Interest Box Embedding
abstract
Knowledge graphs (KGs) have become vitally important in modern recommender systems, effectively improving performance and interpretability. Fundamentally, recommender systems aim to identify user interests based on historical interactions and recommend suitable items. However, existing works overlook two key challenges: (1) an interest corresponds to a potentially large set of related items, and (2) the lack of explicit, fine-grained exploitation of KG information and interest connectivity. This leads to an inability to reflect distinctions between entities and interests when modeling them in a single way. Additionally, the granularity of concepts in the knowledge graphs used for recommendations tends to be coarse, failing to match the fine-grained nature of user interests. This homogenization limits the precise exploitation of knowledge graph data and interest connectivity. To address these limitations, we introduce a novel embedding-based model called InBox. Specifically, various knowledge graph entities and relations are embedded as points or boxes, while user interests are modeled as boxes encompassing interaction history. Representing interests as boxes enables containing collections of item points related to that interest. We further propose that an interest comprises diverse basic concepts, and box intersection naturally supports concept combination. Across three training steps, InBox significantly outperforms state-of-the-art methods like HAKG and KGIN on recommendation tasks. Further analysis provides meaningful insights into the variable value of different KG data for recommendations.
Zezhong Xu, Yincen Qu, Wen Zhang 0015, Lei Liang 0002, Huajun Chen
Proc. VLDB Endow.4
2024 KGFabric: A Scalable Knowledge Graph Warehouse for Enterprise Data Interconnection
abstract
Based on the diversified application scenarios at Ant Group, we built the Ant Knowledge Graph Platform (AKGP). It has constructed numerous domain-specific knowledge graphs related to merchants, companies, accounts, products, and more. AKGP manages trillions of structured knowledge graphs, serving search, recommendation, risk control and other businesses. However, as the demand increasing for various workloads such as graph pattern matching, graph representation learning, and cross-domain knowledge reuse, the existing warehouse systems based on relational DBMS or graph databases are unable to meet the requirements. To address these issues, we propose KGFabric, an industrial-scale knowledge graph management system built on the distributed file system (DFS). KGFabric offers a nearline knowledge storage engine that utilizes a Semantic-enhanced Programmable Graph (SPG) model, which is compatible with the Labeled Property Graph (LPG) model. The data is persistently stored in DFS, such as HDFS, which leverages the POSIX file system API, making it suitable for deployment in multi-cloud environment at low cost. KGFabric provides a native graph-based and hybrid storage format that can serve as a shared backend for parallel graph computing systems, significantly accelerating the analysis of multi-workload. Additionally, KGFabric includes a graph fabric framework that minimizes data duplication and guarantees data security. KGFabric is able to manage Peta-scale data and has supported graph fabric and analysis with over 100 billion relations at Ant Group. We conduct experiments on various datasets to evaluate the performance of KGFabric. Compared with popular relational DBMS and graph databases, the storage space for semantic relations is reduced by over 90%. The performance of graph fabric improves by 21× in real-world workloads. In multi-hop semantic graph analysis, KGFabric enhances performance by 100×.
Lei Liang 0002, Jinye Zhu, Leijie Qiu, Jun Zhou 0011
Proc. VLDB Endow.2