Demo Data from SIGIR 2026 / reviewers in the wild / expert
Hidenori Shoji
dblp:425/4364
· DBLP profile ↗
1ranked-venue papers
0as first author
1since 2021 · last 2025
0009-0004-8506-2442ORCID · reported
Domains — the database's venue-derived domains; a paper can count in several
Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Vision and language · 100% | |
| Databases, data mining, and information retrieval
1 paper |
Information retrieval · 100% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Computer vision › Vision and language › vision-language model
multimodal large language model |
0.9 | 1 | 2025 | LAVA Grand Challenge 2025: Benchmarking Japanese-English Document Understanding with Large Vision-Language Models · ACM Multimedia 2025 |
Computer vision › Vision and language
visual question answering |
0.9 | 1 | 2025 | LAVA Grand Challenge 2025: Benchmarking Japanese-English Document Understanding with Large Vision-Language Models · ACM Multimedia 2025 |
Information retrieval › document processing › document analysis
document understanding |
0.3 | 1 | 2025 | LAVA Grand Challenge 2025: Benchmarking Japanese-English Document Understanding with Large Vision-Language Models · ACM Multimedia 2025 |
Methods — techniques the papers use, named apart from their topics
benchmark construction · 1.7annotation and filtering · 1.7
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | LAVA Grand Challenge 2025: Benchmarking Japanese-English Document Understanding with Large Vision-Language ModelsabstractThe advent of Large Vision-Language Models (LVLMs) has demonstrated significant capabilities in multimodal understanding. However, their application to complex, multi-page documents, particularly in non-English languages like Japanese, remains a significant challenge due to the scarcity of suitable benchmarks. To address this gap, we organized the ''Large Vision---Language Model Learning and Applications (LAVA) Grand Challenge'' at ACM MultiMedia 2025. We present an overview of the competition. We designed a novel, challenging task: a 10-way multiple-choice Visual Question Answering (VQA) task on multi-page Japanese PDF documents. The task demands that models integrate information across multiple pages, text, and figures. We detail the dataset construction, including an annotation and filtering process designed to ensure questions are visually grounded and non-trivial. We also present the competition results, including an analysis of the leaderboard, and discuss the baseline performance of representative models. The LAVA Grand Challenge highlighted both the current capabilities and limitations of LVLMs in practical document understanding scenarios, thereby stimulating future research and providing a robust benchmark in this important domain. Daichi Sato, Duc Minh Vo, Khan Md. Anwarus Salam, Hidenori Shoji, Yuma Matsuoka, Takara Taniguchi, Kaito Baba, Hideki Nakayama |
ACM Multimedia | 4 |