Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Hongyeob Kim

dblp:353/2292 · DBLP profile ↗
← Back
4ranked-venue papers
1as first author
4since 2021 · last 2025
0009-0009-5890-4102ORCID · corroborated

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 3 · 1 first-author · 3 since 2021Graphics, computer vision, multimedia, augmented reality and games · 3 · 1 first-author · 3 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
4 papers
Vision and language · 38% Deep learning architectures and training · 14% Transfer learning and domain adaptation · 14%
Databases, data mining, and information retrieval
1 paper
Information retrieval · 100%

Topics — the 10 heaviest of 11, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Computer vision › Vision and language › visual question answering
audio-visual question answering
0.912025
Question-Aware Gaussian Experts for Audio-Visual Question Answering · CVPR 2025
Machine learning › Probabilistic and Bayesian machine learning
probabilistic inference
0.912025
Backpropagation-Free Test-Time Adaptation via Probabilistic Gaussian Alignment · NeurIPS 2025
Computer vision › Vision and language
temporal grounding
0.912025
Question-Aware Gaussian Experts for Audio-Visual Question Answering · CVPR 2025
Machine learning › Transfer learning and domain adaptation
test-time adaptation
0.912025
Backpropagation-Free Test-Time Adaptation via Probabilistic Gaussian Alignment · NeurIPS 2025
Robotics › Robot manipulation › tactile sensing › tactile perception
visuo-tactile perception
0.912025
RA-Touch: Retrieval-Augmented Touch Understanding with Enriched Visual Data · ACM Multimedia 2025
Machine learning › Deep learning architectures and training
data augmentation
0.712023
TextManiA: Enriching Visual Feature by Text-driven Manifold Augmentation · ICCV 2023
Computer vision › Vision and language › multimodal representation
text-guided visual representation
0.712023
TextManiA: Enriching Visual Feature by Text-driven Manifold Augmentation · ICCV 2023
Machine learning › Deep learning architectures and training
mixture of experts
0.312025
Question-Aware Gaussian Experts for Audio-Visual Question Answering · CVPR 2025
Machine learning › Trustworthy machine learning › robustness › distribution shift
robustness to distribution shift
0.312025
Backpropagation-Free Test-Time Adaptation via Probabilistic Gaussian Alignment · NeurIPS 2025
Information retrieval
retrieval-augmented generation
0.312025
RA-Touch: Retrieval-Augmented Touch Understanding with Enriched Visual Data · ACM Multimedia 2025

Methods — techniques the papers use, named apart from their topics

visual-textual representation alignment · 1.7retrieval augmentation · 1.7progressive refinement · 0.9probabilistic inference · 0.9mixture of experts · 0.9gaussian modeling · 0.9covariance modeling · 0.9CLIP · 0.9text representation transfer · 0.7manifold augmentation · 0.7
YearPublicationVenuePosition
2025 Question-Aware Gaussian Experts for Audio-Visual Question Answering
abstract
Audio-Visual Question Answering (AVQA) requires not only question-based multimodal reasoning but also precise temporal grounding to capture subtle dynamics for accurate prediction. However, existing methods mainly use question information implicitly, limiting focus on question-specific details. Furthermore, most studies rely on uniform frame sampling, which can miss key question-relevant frames. Although recent Top-K frame selection methods aim to address this, their discrete nature still overlooks fine-grained temporal details. This paper proposes QA-TIGER, a novel framework that explicitly incorporates question information and models continuous temporal dynamics. Our key idea is to use Gaussian-based modeling to adaptively focus on both consecutive and non-consecutive frames based on the question, while explicitly injecting question information and applying progressive refinement. We leverage a Mixture of Experts (MoE) to flexibly implement multiple Gaussian models, activating temporal experts specifically tailored to the question. Extensive experiments on multiple AVQA benchmarks show that QA-TIGER consistently achieves state-of-the-art performance. Code is available at https://aim-skku.github.io/QA-TIGER/
Hongyeob Kim, Inyoung Jung, Dayoon Suh, Youjia Zhang, Sangmin Lee 0001, Sungeun Hong
CVPR1
2025 RA-Touch: Retrieval-Augmented Touch Understanding with Enriched Visual Data
abstract
Visuo-tactile perception aims to understand an object's tactile properties. However, the field remains underexplored due to the high cost of data collection. We observe that visually distinct objects can exhibit similar surface textures or material properties. For example, a leather sofa and a leather jacket can share similar tactile properties. This implies that tactile understanding can be guided by material cues in visual data, even without direct tactile supervision. In this paper, we introduce RA-Touch, a retrieval-augmented framework that improves visuo-tactile perception by leveraging visual data enriched with tactile semantics. We carefully recaption a large-scale visual dataset with tactile-focused descriptions, enabling the model to access tactile semantics typically absent from conventional visual datasets. A key challenge remains in effectively utilizing these tactile-aware external descriptions. RA-Touch addresses this by retrieving visual-textual representations aligned with tactile inputs and integrating them to focus on relevant textural and material properties. By outperforming prior methods, we demonstrate the potential of retrieval-based visual reuse for tactile understanding. Code is available at https://aim-skku.github.io/RA-Touch.
Yoorhim Cho, Hongyeob Kim, Youjia Zhang, Yunseok Choi, Sungeun Hong
ACM Multimedia2
2025 Backpropagation-Free Test-Time Adaptation via Probabilistic Gaussian Alignment
abstract
Test-time adaptation (TTA) enhances the zero-shot robustness under distribution shifts by leveraging unlabeled test data during inference. Despite notable advances, several challenges still limit its broader applicability. First, most methods rely on backpropagation or iterative optimization, which limits scalability and hinders real-time deployment. Second, they lack explicit modeling of class-conditional feature distributions. This modeling is crucial for producing reliable decision boundaries and calibrated predictions, but it remains underexplored due to the lack of both source data and supervision at test time. In this paper, we propose ADAPT, an Advanced Distribution-Aware and backPropagation-free Test-time adaptation method. We reframe TTA as a probabilistic inference task by modeling class-conditional likelihoods using gradually updated class means and a shared covariance matrix. This enables closed-form, training-free inference. To correct potential likelihood bias, we introduce lightweight regularization guided by CLIP priors and a historical knowledge bank. ADAPT requires no source data, no gradient updates, and no full access to target data, supporting both online and transductive settings. Extensive experiments across diverse benchmarks demonstrate that our method achieves state-of-the-art performance under a wide range of distribution shifts with superior scalability and robustness.
Youjia Zhang, Youngeun Kim, Young-Geun Choi, Hongyeob Kim, Huiling Liu 0001, Sungeun Hong
NeurIPS4
2023 TextManiA: Enriching Visual Feature by Text-driven Manifold Augmentation
abstract
We propose TextManiA, a text-driven manifold augmentation method that semantically enriches visual feature spaces, regardless of class distribution. TextManiA augments visual data with intra-class semantic perturbation by exploiting easy-to-understand visually mimetic words, i.e., attributes. This work is built on an interesting hypothesis that general language models, e.g., BERT and GPT, encompass visual information to some extent, even without training on visual training data. Given the hypothesis, TextManiA transfers pre-trained text representation obtained from a well-established large language encoder to a target visual feature space being learned. Our extensive analysis hints that the language encoder indeed encompasses visual information at least useful to augment visual representation. Our experiments demonstrate that TextManiA is particularly powerful in scarce samples with class imbalance as well as even distribution. We also show compatibility with the label mix-based approaches in evenly distributed scarce data.
Moon Ye-Bin, Jisoo Kim 0006, Hongyeob Kim, Kilho Son, Tae-Hyun Oh
ICCV3