Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Wenrui Huang

dblp:89/7682 · DBLP profile ↗
← Back
3ranked-venue papers
1as first author
2since 2021 · last 2025
—ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 2 · 1 since 2021Databases, data management, data science and information retrieval · 1 · 1 first-author · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Computer architecture, parallel and distributed computing, and storage systems
1 paper
Cloud and datacenter computing · 100%

Topics — the 3 heaviest of 3, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Cloud and datacenter computing
context caching
0.912025
EPIC: Efficient Position-Independent Caching for Serving Large Language Models · ICML 2025
Cloud and datacenter computing
KV cache reuse
0.912025
EPIC: Efficient Position-Independent Caching for Serving Large Language Models · ICML 2025
Cloud and datacenter computing › inference serving
LLM serving
0.912025
EPIC: Efficient Position-Independent Caching for Serving Large Language Models · ICML 2025

Methods — techniques the papers use, named apart from their topics

legolink algorithm · 0.9attention sink mitigation · 0.9
YearPublicationVenuePosition
2025 EPIC: Efficient Position-Independent Caching for Serving Large Language Models
abstract
Large Language Models (LLMs) show great capabilities in a wide range of applications, but serving them efficiently becomes increasingly challenging as requests (prompts) become more complex. Context caching improves serving performance by reusing Key-Value (KV) vectors, the intermediate representations of tokens that are repeated across requests. However, existing context caching requires exact prefix matches across requests, limiting reuse cases in settings such as few-shot learning and retrieval-augmented generation, where immutable content (e.g., documents) remains unchanged across requests but is preceded by varying prefixes. Position-Independent Caching (PIC) addresses this issue by enabling modular reuse of the KV vectors regardless of prefixes. We formalize PIC and advance prior work by introducing EPIC, a serving system incorporating our new LegoLink algorithm, which mitigates the inappropriate “attention sink” effect at every document beginning, to maintain accuracy with minimal computation. Experiments show that EPIC achieves up to 8$\times$ improvements in Time-To-First-Token (TTFT) and 7$\times$ throughput gains over existing systems, with negligible or no accuracy loss.
Wenrui Huang, Haoyi Wang, Tiancheng Hu, Xusheng Chen, Yizhou Shan, Tao Xie 0001
ICML2
2024 OSGraph: A Data Visualization Insight Platform for Open Source Community
Wenrui Huang, Xiaoya Xia, Aoying Zhou, Xuan Zhou 0001, Wei Wang 0011, Shengyu Zhao, Sikang Bian
DASFAA (7)1
2019 Neural network modeling of monthly salinity variations in oyster reef in Apalachicola Bay in response to freshwater inflow and winds
Wenrui Huang, Elijah Johnson
Neural Comput. Appl.2