Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Haotian Ni

dblp:352/3108 · DBLP profile ↗
← Back
5ranked-venue papers
3as first author
5since 2021 · last 2025
—ORCID · none

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 5 · 3 first-author · 5 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
1 paper
Deep learning architectures and training · 75% Vision and language · 25%

Topics — the 4 heaviest of 4, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Deep learning architectures and training
attention mechanism
0.912025
RollingQ: Reviving the Cooperation Dynamics in Multimodal Transformer · ICML 2025
Computer vision › Vision and language
multimodal fusion
0.912025
RollingQ: Reviving the Cooperation Dynamics in Multimodal Transformer · ICML 2025
Machine learning › Deep learning architectures and training › transformer
multimodal transformer
0.912025
RollingQ: Reviving the Cooperation Dynamics in Multimodal Transformer · ICML 2025
Machine learning › Deep learning architectures and training › attention mechanism
self-attention
0.912025
RollingQ: Reviving the Cooperation Dynamics in Multimodal Transformer · ICML 2025

Methods — techniques the papers use, named apart from their topics

multimodal learning · 0.9attention mechanism · 0.9
YearPublicationVenuePosition
2025 RollingQ: Reviving the Cooperation Dynamics in Multimodal Transformer
abstract
Multimodal learning faces challenges in effectively fusing information from diverse modalities, especially when modality quality varies across samples. Dynamic fusion strategies, such as attention mechanism in Transformers, aim to address such challenge by adaptively emphasizing modalities based on the characteristics of input data. However, through amounts of carefully designed experiments, we surprisingly observed that the dynamic adaptability of widely-used self-attention models diminishes. Model tends to prefer one modality regardless of data characteristics. This bias triggers a self-reinforcing cycle that progressively overemphasizes the favored modality, widening the distribution gap in attention keys across modalities and deactivating attention mechanism’s dynamic properties. To revive adaptability, we propose a simple yet effective method Rolling Query (RollingQ), which balances attention allocation by rotating the query to break the self-reinforcing cycle and mitigate the key distribution gap. Extensive experiments on various multimodal scenarios validate the effectiveness of RollingQ and the restoration of cooperation dynamics is pivotal for enhancing the broader capabilities of widely deployed multimodal Transformers. The source code is available at https://github.com/GeWu-Lab/RollingQ_ICML2025.
Haotian Ni, Yake Wei, Di Hu 0001
ICML1
2025 Gradient-based causal discovery with latent variables
Haotian Ni, Tian-Zuo Wang, Xiuqi Huang, Chenping Hou
Mach. Learn.1
2025 Debiasing weighted multi-view k-means clustering based on causal regularization
Xiuqi Huang, Haotian Ni, Chenping Hou
Pattern Recognit.3
2024 Feature incremental learning with causality
Haotian Ni, Shilin Gu, Ruidong Fan, Chenping Hou
Pattern Recognit.1
2023 Decorrelated spectral regression: An unsupervised dimension reduction method under data selection bias
Xiuqi Huang, Haotian Ni, Tingjin Luo, Chenping Hou
Neurocomputing2