Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Zhiyuan Han

dblp:03/7212 · DBLP profile ↗
← Back
9ranked-venue papers
2as first author
7since 2021 · last 2026
—ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 5 · 1 first-author · 4 since 2021Graphics, computer vision, multimedia, augmented reality and games · 4 · 1 first-author · 4 since 2021Databases, data management, data science and information retrieval · 1Applied, interdisciplinary, general and emerging computing · 1

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
4 papers
3D vision · 31% Trustworthy machine learning · 21% Vision and language · 14%
Computer graphics and multimedia
1 paper
Multimedia analysis and retrieval · 100%

Topics — the 11 heaviest of 12, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Computer vision › 3D vision › 3d scene understanding
3d visual grounding
0.912025
AugRefer: Advancing 3D Visual Grounding via Cross-Modal Augmentation and Spatial Relation-based Referring · AAAI 2025
Computer vision › 3D vision › 3d scene understanding
contextual relationship modeling
0.912025
A Hypergraph Based Contextual Relationship Modeling Method for Multimodal Emotion Recognition in Conversation · IEEE Trans. Multim. 2025
Computer vision › 3D vision
cross-modal data augmentation
0.912025
AugRefer: Advancing 3D Visual Grounding via Cross-Modal Augmentation and Spatial Relation-based Referring · AAAI 2025
Natural language and speech › Information extraction and text analysis
emotion recognition
0.912025
Benchmarking and Bridging Emotion Conflicts for Multimodal Emotion Reasoning · ACM Multimedia 2025
Machine learning › Graph learning › hypergraph
hypergraph modeling
0.912025
A Hypergraph Based Contextual Relationship Modeling Method for Multimodal Emotion Recognition in Conversation · IEEE Trans. Multim. 2025
Computer vision › Face, body and person analysis › facial expression analysis › facial expression recognition
micro-expression recognition
0.912025
Emotion-Qwen-VL: A Fully Fine-Tuned Multimodal Large Language Model for Micro-Expression Visual Question Answering · ACM Multimedia 2025
Machine learning › Trustworthy machine learning
modality conflict
0.912025
Benchmarking and Bridging Emotion Conflicts for Multimodal Emotion Reasoning · ACM Multimedia 2025
Machine learning › Trustworthy machine learning
robustness
0.912025
Benchmarking and Bridging Emotion Conflicts for Multimodal Emotion Reasoning · ACM Multimedia 2025
Computer vision › Vision and language
visual question answering
0.912025
Emotion-Qwen-VL: A Fully Fine-Tuned Multimodal Large Language Model for Micro-Expression Visual Question Answering · ACM Multimedia 2025
Computer vision › Vision and language › multimodal reasoning
language-spatial reasoning
0.312025
AugRefer: Advancing 3D Visual Grounding via Cross-Modal Augmentation and Spatial Relation-based Referring · AAAI 2025
Natural language and speech › Language models and text generation › large language model fine-tuning
multimodal large language model fine-tuning
0.312025
Emotion-Qwen-VL: A Fully Fine-Tuned Multimodal Large Language Model for Micro-Expression Visual Question Answering · ACM Multimedia 2025

Methods — techniques the papers use, named apart from their topics

hypergraph convolution · 1.7graph neural network · 1.7parameter-efficient fine-tuning · 0.9multimodal feature concatenation · 0.9mixture of experts · 0.9language-spatial adaptive decoder · 0.9instruction-based QA dataset construction · 0.9full-parameter fine-tuning · 0.9foundation model · 0.9cross-modal augmentation · 0.9attention reallocation · 0.9
YearPublicationVenuePosition
2026 DUASNet: A dynamic unified adaptive segmentation network for multi-task domain generalization in medical imaging
Zhiyuan Han, Xiaoli Li 0011, Kang Wang 0003, Guoju Zhang
Knowl. Based Syst.1
2025 AugRefer: Advancing 3D Visual Grounding via Cross-Modal Augmentation and Spatial Relation-based Referring
abstract
3D visual grounding (3DVG), which aims to correlate a natural language description with the target object within a 3D scene, is a significant yet challenging task. Despite recent advancements in this domain, existing approaches commonly encounter a shortage: a limited amount and diversity of text-3D pairs available for training. Moreover, they fall short in effectively leveraging different contextual clues (e.g., rich spatial relations within the 3D visual space) for grounding. To address these limitations, we propose AugRefer, a novel approach for advancing 3D visual grounding. AugRefer introduces cross-modal augmentation designed to extensively generate diverse text-3D pairs by placing objects into 3D scenes and creating accurate and semantically rich descriptions using foundation models. Notably, the resulting pairs can be utilized by any existing 3DVG methods for enriching their training data. Besides, AugRefer presents a language-spatial adaptive decoder that effectively adapts the potential referring objects based on the language description and various 3D spatial relations. Extensive experiments on three benchmark datasets clearly validate the effectiveness of AugRefer.
Na Zhao 0004, Zhiyuan Han, Dan Guo 0001, Xun Yang 0001
AAAI3
2025 Benchmarking and Bridging Emotion Conflicts for Multimodal Emotion Reasoning
abstract
Despite their strong performance in multimodal emotion reasoning, existing Multimodal Large Language Models (MLLMs) often overlook the scenarios involving emotion conflicts, where emotional cues from different modalities are inconsistent. To fill this gap, we first introduce CA-MER, a new benchmark designed to examine MLLMs under realistic emotion conflicts. It consists of three subsets: video-aligned, audio-aligned, and consistent, where only one or all modalities reflect the true emotion. However, evaluations on our CA-MER reveal that current state-of-the-art emotion MLLMs systematically over-rely on audio signal during emotion conflicts, neglecting critical cues from visual modality. To mitigate this bias, we propose MoSEAR, a parameter-efficient framework that promotes balanced modality integration. MoSEAR consists of two modules: (1)MoSE, modality-specific experts with a regularized gating mechanism that reduces modality bias in the fine-tuning heads; and (2)AR, an attention reallocation mechanism that rebalances modality contributions in frozen backbones during inference. Our framework offers two key advantages: it mitigates emotion conflicts and improves performance on consistent samples-without incurring a trade-off between audio and visual modalities. Experiments on multiple benchmarks-including MER2023, EMER, DFEW, and our CA-MER-demonstrate that MoSEAR achieves state-of-the-art performance, particularly under modality conflict conditions.
Zhiyuan Han, Beier Zhu, Yanlong Xu, Peipei Song, Xun Yang 0001
ACM Multimedia1
2025 Emotion-Qwen-VL: A Fully Fine-Tuned Multimodal Large Language Model for Micro-Expression Visual Question Answering
abstract
This paper presents our solution for the Micro-Expression Visual Question Answering (ME-VQA) task in the 2025 Facial Micro-Expression Grand Challenge (MEGC). To address the limitations of traditional micro-expression recognition (MER) methods in dynamic modeling, semantic interpretation, and natural language interaction, we propose Emotion-Qwen-VL, a fully fine-tuned multimodal large language model tailored for micro-expression understanding. Specifically, we construct a structured, instruction-based QA dataset that reformulates emotion categories and action unit (AU) annotations into natural language QA pairs, covering classification, AU detection, and causal reasoning. We then adopt a full-parameter fine-tuning strategy to guide Qwen2.5-VL in learning fine-grained temporal facial dynamics and their emotional semantics. Experimental results on the MEGC 2025 test set demonstrate that Emotion-Qwen-VL outperforms strong baselines such as Qwen2.5-VL and QVQ across multiple dimensions, including coarse-grained macro-expression classification, fine-grained micro-expression classification, and language generation. Our results highlight the effectiveness, interpretability, and adaptation potential of large models in micro-expression understanding. The code is available at: https://github.com/2308623956/MEGC2025.
Ruotong Fang, Zhiyuan Han, Xiaoqing Lin, Yuhao Shan, Tong Chen 0008
ACM Multimedia4
2025 A Hypergraph Based Contextual Relationship Modeling Method for Multimodal Emotion Recognition in Conversation
abstract
Emotion Recognition in Conversation (ERC) has gained considerable attention due to its importance in human-computer interaction. In ERC task, the combination of multimodal information and contextual information is necessary since it can help the model understand emotional changes in the context from multiple perspectives. As Graph Neural Networks (GNNs) have shown the superiority in relation modeling, many graph-based methods have been proposed to improve the performance of emotion recognition by utilizing the edges to mine the contextual relationship and multimodal relationship in a conversation. However, the existence of numerous redundant edges and excessively complex modality interaction in the graph hinders the model from capturing the truly effective dependency information for emotion recognition. In this paper, we propose a Hypergraph based Contextual Relationship Modeling Method (HyperCRM) to carry out the ERC task. HyperCRM models a conversation as a hypergraph instead of a graph, which defines two types of hyperedges, namely speaker-level hyperedge and sequence-level hyperedge, to represent the contextual relationship within the same speaker and the local sequence of the conversation, respectively. Multimodal information is leveraged here as the node feature representation by the feature concatenation. In addition, an improved hypergraph convolution method is designed to capture the long-range contextual information by three-stage information propagation in the hypergraph, including node-hyperedge, hyperedge-hyperedge and node-hyperedge. The extensive experiments on two public datasets shows the new State-Of-The-Art (SOTA) results, to further demonstrate that the proposed method can simply make use of the multimodal information and effectively model the complex contextual relationships in the conversation.
Nannan Lu, Zhiyuan Han
IEEE Trans. Multim.2
2024 A novel attLSTM framework combining the attention mechanism and bidirectional LSTM for demand forecasting
Ligang Cui, Ying-Cong Chen, Zhiyuan Han
Expert Syst. Appl.4
2023 TRFN: Triple-Receptive-Field Network for Regional-Texture and Holistic-Structure Image Inpainting
Qingguo Xiao, Zhiyuan Han, Zhaodong Liu, Guangyuan Pan, Yanpeng Zheng
ICONIP (14)2
2018 Review on flexible photonics/electronics integrated devices and fabrication strategy
Shisheng Cai, Zhiyuan Han, Fengle Wang, Kunwei Zheng, Yinji Ma
Sci. China Inf. Sci.2
2009 Investigation of Damage Identification of 16Mn Steel Based on Artificial Neural Networks and Data Fusion Techniques in Tensile Test
Hongyun Luo, Zhiyuan Han, Qunpeng Zhong
ADMA3