Demo Data from SIGIR 2026 / reviewers in the wild / expert
Hyunmin Song
dblp:400/5246
· DBLP profile ↗
2ranked-venue papers
0as first author
2since 2021 · last 2025
0009-0008-6863-0830ORCID · reported
Domains — the database's venue-derived domains; a paper can count in several
Artificial intelligence and machine learning · 2 · 2 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021
Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.
| Artificial intelligence
1 paper |
Vision and language · 50% Information extraction and text analysis · 50% | |
| Human-computer interaction and pervasive computing
1 paper |
Learning and educational technologies · 100% |
Topics — the 3 heaviest of 3, each with the papers that count most for it
| Topic | Weight | Papers | Last | Evidence papers |
|---|---|---|---|---|
Natural language and speech › Information extraction and text analysis › document AI
mathematical expression understanding |
0.9 | 1 | 2025 | VEHME: A Vision-Language Model For Evaluating Handwritten Mathematics Expressions · EMNLP 2025 |
Computer vision › Vision and language
multimodal reasoning |
0.9 | 1 | 2025 | VEHME: A Vision-Language Model For Evaluating Handwritten Mathematics Expressions · EMNLP 2025 |
Learning and educational technologies › educational assessment
automated assessment |
0.9 | 1 | 2025 | VEHME: A Vision-Language Model For Evaluating Handwritten Mathematics Expressions · EMNLP 2025 |
Methods — techniques the papers use, named apart from their topics
visual prompting · 1.7vision-language model · 1.7supervised fine-tuning · 1.7reinforcement learning · 1.7
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2025 | VEHME: A Vision-Language Model For Evaluating Handwritten Mathematics ExpressionsabstractAutomatically assessing handwritten mathematical solutions is an important problem in educational technology with practical applications, but it remains a significant challenge due to the diverse formats, unstructured layouts, and symbolic complexity of student work.To address this challenge, we introduce VEHME-a Vision-Language Model for Evaluating Handwritten Mathematics Expressions-designed to assess open-form handwritten math responses with high accuracy and interpretable reasoning traces.VEHME integrates a two-phase training pipeline: (i) supervised fine-tuning using structured reasoning data, and (ii) reinforcement learning that aligns model outputs with multi-dimensional grading objectives, including correctness, reasoning depth, and error localization.To enhance spatial understanding, we propose an Expression-Aware Visual Prompting Module, trained on our synthesized multi-line math expressions dataset to robustly guide attention in visually heterogeneous inputs.Evaluated on AIHub and FERMAT datasets, VEHME achieves state-of-the-art performance among open-source models and approaches the accuracy of proprietary systems, demonstrating its potential as a scalable and accessible tool for automated math assessment.Our training and experiment code is publicly available at our GitHub repository. Thu Phuong Nguyen, Duc M. Nguyen, Hyotaek Jeon, Hyunwook Lee, Hyunmin Song, Sungahn Ko |
EMNLP | 5 |
| 2025 | Towards Human-like Multimodal Conversational Agent by Generating Engaging SpeechabstractHuman conversation involves language, speech, and visual cues, with each medium providing complementary information. For instance, speech conveys a vibe or tone not fully captured by text alone. While multimodal LLMs focus on generating text responses from diverse inputs, less attention has been paid to generating natural and engaging speech. We propose a human-like agent that generates speech responses based on conversation mood and responsive style information. To achieve this, we build a novel MultiSensory Conversation dataset focused on speech to enable agents to generate natural speech. We then propose a multimodal LLM-based model for generating text responses and voice descriptions, which are used to generate speech covering paralinguistic information. Experimental results demonstrate the effectiveness of utilizing both visual and audio modalities in conversation to generate engaging speech. The source code is available in https://github.com/kimtaesu24/MSenC Taesoo Kim, Yongsik Jo, Hyunmin Song |
INTERSPEECH | 3 |