Demo Data from EDBT 2026 / reviewers in the wild / expert
Jaisal Patel
dblp:395/1630
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2026
0009-0000-5350-2192ORCID · reported
Domains — the database's venue-derived domains; a paper can count in several
Databases, data management, data science and information retrieval · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Information extraction and text analysis · 44% Knowledge representation and reasoning · 44% Language models and text generation · 13% | |
| Databases, data mining, and information retrieval
1 paper |
Knowledge graphs · 100% |
Topics — the 3 heaviest of 4, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Information extraction and text analysis › document understanding
financial document analysis |
1.0 | 1 | 2026 | FinAuditing: A Financial Taxonomy-Structured Multi-Document Benchmark for Evaluating LLMs · SIGIR 2026 |
Knowledge, reasoning and agents › Knowledge representation and reasoning › knowledge acquisition › knowledge extraction
structured information extraction |
1.0 | 1 | 2026 | FinAuditing: A Financial Taxonomy-Structured Multi-Document Benchmark for Evaluating LLMs · SIGIR 2026 |
Natural language and speech › Language models and text generation
large language model evaluation |
0.3 | 1 | 2026 | FinAuditing: A Financial Taxonomy-Structured Multi-Document Benchmark for Evaluating LLMs · SIGIR 2026 |
Methods — techniques the papers use, named apart from their topics
benchmark construction · 2.0XBRL parsing · 2.0
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | FinAuditing: A Financial Taxonomy-Structured Multi-Document Benchmark for Evaluating LLMsabstractGoing beyond simple text processing, financial auditing requires detecting semantic, structural, and numerical inconsistencies across large-scale disclosures. As financial reports are filed in XBRL, a structured XML format governed by accounting standards, auditing becomes a structured information extraction and reasoning problem involving concept alignment, taxonomy-defined relations, and cross-document consistency. Although large language models (LLMs) show promise on isolated financial tasks, their capability in professional-grade auditing remains unclear. We introduce FinAuditing, a taxonomy-aligned, structure-aware benchmark built from real XBRL filings. It contains 1,102 annotated instances averaging over 33k tokens and defines three tasks: Financial Semantic Matching (FinSM), Financial Relationship Extraction (FinRE), and Financial Mathematical Reasoning (FinMR). Evaluations of 13 state-of-the-art LLMs reveal substantial gaps in concept retrieval, taxonomy-aware relation modeling, and consistent cross-document reasoning. These findings highlight the need for realistic, structure-aware benchmarks. We release the evaluation code1 and dataset2 publicly, and the task currently serves as the official benchmark of an ongoing public evaluation contest3. Yan Wang 0015, Jaisal Patel, Jeff Zhao, Fengran Mo, Xueqing Peng, Lingfei Qian, Yankai Chen 0001, Víctor Gutiérrez-Basulto, Jimin Huang, Guojun Xiong, Xiao-Yang Liu, Jian-Yun Nie |
SIGIR | 4 |