EDBT 2026 Demo / reviewers in the wild / expert
Lize Shao
dblp:404/6303
· DBLP profile ↗
2ranked-venue papers
0as first author
2since 2021 · last 2025
—ORCID · none
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 1 · 1 since 2021Software engineering, systems software and programming languages · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Language models and text generation · 100% | |
| Computer networks
1 paper |
Internet architecture and protocols · 100% |
Topics — the 5 heaviest of 5, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Language models and text generation
knowledge editing |
0.9 | 1 | 2025 | MQuAKE-Remastered: Multi-Hop Knowledge Editing Can Only Be Advanced with Reliable Evaluations · ICLR 2025 |
Natural language and speech › Language models and text generation › knowledge editing
knowledge editing evaluation |
0.9 | 1 | 2025 | MQuAKE-Remastered: Multi-Hop Knowledge Editing Can Only Be Advanced with Reliable Evaluations · ICLR 2025 |
Natural language and speech › Language models and text generation › knowledge editing
multi-hop knowledge editing |
0.9 | 1 | 2025 | MQuAKE-Remastered: Multi-Hop Knowledge Editing Can Only Be Advanced with Reliable Evaluations · ICLR 2025 |
Internet architecture and protocols
protocol specification |
0.9 | 1 | 2025 | RFCScope: Detecting Logical Ambiguities in Internet Protocol Specifications · ASE 2025 |
Internet architecture and protocols
protocol standardization |
0.3 | 1 | 2025 | RFCScope: Detecting Logical Ambiguities in Internet Protocol Specifications · ASE 2025 |
Methods — techniques the papers use, named apart from their topics
prompt engineering · 0.9large language model · 0.9knowledge editing · 0.9dataset auditing · 0.9
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | MQuAKE-Remastered: Multi-Hop Knowledge Editing Can Only Be Advanced with Reliable EvaluationsabstractLarge language models (LLMs) can give out erroneous answers to factually rooted questions either as a result of undesired training outcomes or simply because the world has moved on after a certain knowledge cutoff date. Under such scenarios, *knowledge editing* often comes to the rescue by delivering efficient patches for such erroneous answers without significantly altering the rest, where many editing methods have seen reasonable success when the editing targets are simple and direct (e.g., *``what club does Lionel Messi currently play for?''*).
However, knowledge fragments like this are often deeply intertwined in the real world, making effectively propagating the editing effect to non-directly related questions a practical challenge (to entertain an extreme example: [*"What car did the wife of the owner of the club that Messi currently plays for used to get to school in the 80s?"*](youtube.com/watch?v=DbwiHC1Fu-E\&t=132s)). Prior arts have coined this task as *multi-hop knowledge editing* with the most popular dataset being MQuAKE, serving as the sole evaluation benchmark for many later proposed editing methods due to the expensive nature of constructing knowledge editing datasets at scale.
In this work, we reveal that **up to 33\% or 76\% of \mquake{}'s questions and ground truth labels are, in fact, corrupted in various fashions due to some unintentional clerical or procedural oversights**. Our work provides a detailed audit of MQuAKE's error pattern and a comprehensive fix without sacrificing its dataset capacity. Additionally, we benchmarked almost all proposed MQuAKE-evaluated editing methods on our post-fix dataset, **MQuAKE-Remastered**. We observe that many methods try to overfit the original MQuAKE by exploiting some dataset idiosyncrasies of MQuAKE. We provide a guideline on how to approach such datasets faithfully and show that a simple, minimally invasive approach — **GWalk** — can offer beyond SOTA editing performance without such exploitation. The MQuAKE-Remastered datasets and utilities are available at [huggingface.co/datasets/henryzhongsc/MQuAKE-Remastered](https://huggingface.co/datasets/henryzhongsc/MQuAKE-Remastered) and [github.com/henryzhongsc/MQuAKE-Remastered](https://github.com/henryzhongsc/MQuAKE-Remastered), respectively. Shaochen Zhong, Lize Shao, Bhargav Bhushanam, Xiaocong Du, Yixin Wan, Daochen Zha, Yiwei Wang 0001, Ninghao Liu 0001, Kaixiong Zhou, Kai-Wei Chang 0001, Louis Feng, Vipin Chaudhary, Xia Ben Hu |
ICLR | 3 |
| 2025 | RFCScope: Detecting Logical Ambiguities in Internet Protocol SpecificationsabstractInternet protocol specifications, published as Requests for Comments (RFCs) by the IETF organization, are essential to ensuring the interoperability, security, and reliability of the Internet. However, ambiguities in these specifications, particularly logical ambiguities such as inconsistencies and under-specifications, can lead to critical misinterpretations and implementation errors. Unfortunately, such ambiguities remain largely overlooked and challenging to detect with existing tools.In this paper, we present the first systematic study of verified technical errata from Standards Track RFCs over the past 11 years, identifying seven distinct subtypes of logical ambiguities. Building on these insights, we introduce RFCScope, the first scalable framework for detecting logical ambiguities in RFCs. RFCScope employs large language models (LLMs) through a modular pipeline that constructs targeted cross-document context, partitions specifications to preserve semantic integrity, applies bug-type-aware prompts for detection, and filters out false positives using structured reasoning validation.RFCScope uncovers 31 new logical ambiguities spanning all seven subtypes across 14 recent RFCs. Eight of these have been confirmed by RFC authors, with three officially verified as technical errata. Our results demonstrate that RFCScope offers a practical solution for improving the clarity, consistency, and reliability of protocol standards through ambiguity detection. Mrigank Pawagi, Lize Shao, Hyeonmin Lee, Yixin Sun 0004 |
ASE | 2 |