Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data.

Han Zhang 0035

dblp:26/4189-35 · DBLP profile ↗
← Back
8ranked-venue papers
2as first author
8since 2021 · last 2026
0000-0003-1109-4738ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 4 · 4 since 2021Graphics, computer vision, multimedia, augmented reality and games · 3 · 1 first-author · 3 since 2021Applied, interdisciplinary, general and emerging computing · 2 · 1 first-author · 2 since 2021Databases, data management, data science and information retrieval · 1 · 1 first-author · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
5 papers
Deep learning architectures and training · 57% Question answering and dialogue systems · 32% Efficient and distributed learning · 11%
Computer architecture, parallel and distributed computing, and storage systems
2 papers
Emerging computing paradigms · 93% Energy-efficient computing · 7%
Human-computer interaction and pervasive computing
2 papers
Human-AI interaction · 77% Collaborative and social computing · 23%
Interdisciplinary, comprehensive, and emerging computing
1 paper
Medical and health informatics · 100%

Topics — the 15 heaviest of 15, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Machine learning › Deep learning architectures and training
transformer
2.032026
Spikingformer: A Key Foundation Model for Spiking Neural Networks · AAAI 2026
QKFormer: Hierarchical Spiking Transformer using Q-K Attention · NeurIPS 2024
S$^2$M-Former: Spiking Symmetric Mixing Branchformer for Brain Auditory Attention Detection · NeurIPS 2025
Emerging computing paradigms
neuromorphic computing
1.822026
Spikingformer: A Key Foundation Model for Spiking Neural Networks · AAAI 2026
QKFormer: Hierarchical Spiking Transformer using Q-K Attention · NeurIPS 2024
Emerging computing paradigms › neuromorphic computing
spiking neural network
1.822026
Spikingformer: A Key Foundation Model for Spiking Neural Networks · AAAI 2026
QKFormer: Hierarchical Spiking Transformer using Q-K Attention · NeurIPS 2024
Machine learning › Deep learning architectures and training › spiking neural network
spiking transformer
1.012026
Spikingformer: A Key Foundation Model for Spiking Neural Networks · AAAI 2026
Natural language and speech › Question answering and dialogue systems › conversational agents
empathetic dialogue systems
0.912025
The ACM Multimedia 2025 Grand Challenge of Avatar-based Multimodal Empathetic Conversation · ACM Multimedia 2025
Natural language and speech › Question answering and dialogue systems › dialogue generation
empathetic response generation
0.912025
Towards Multimodal Empathetic Response Generation: A Rich Text-Speech-Vision Avatar-based Benchmark · WWW 2025
Machine learning › Efficient and distributed learning
energy-efficient learning
0.912025
S$^2$M-Former: Spiking Symmetric Mixing Branchformer for Brain Auditory Attention Detection · NeurIPS 2025
Natural language and speech › Question answering and dialogue systems
multimodal dialogue system
0.912025
Towards Multimodal Empathetic Response Generation: A Rich Text-Speech-Vision Avatar-based Benchmark · WWW 2025
Machine learning › Deep learning architectures and training
spiking neural network
0.912025
S$^2$M-Former: Spiking Symmetric Mixing Branchformer for Brain Auditory Attention Detection · NeurIPS 2025
Medical and health informatics
brain-computer interface
0.912025
S$^2$M-Former: Spiking Symmetric Mixing Branchformer for Brain Auditory Attention Detection · NeurIPS 2025
Human-AI interaction
affective computing
0.912025
The ACM Multimedia 2025 Grand Challenge of Avatar-based Multimodal Empathetic Conversation · ACM Multimedia 2025
Machine learning › Deep learning architectures and training
attention mechanism
0.812024
QKFormer: Hierarchical Spiking Transformer using Q-K Attention · NeurIPS 2024
Emerging computing paradigms › neuromorphic computing › spiking neural network
spiking transformer
0.812024
QKFormer: Hierarchical Spiking Transformer using Q-K Attention · NeurIPS 2024
Energy-efficient computing
energy-efficient machine learning
0.312026
Spikingformer: A Key Foundation Model for Spiking Neural Networks · AAAI 2026
Collaborative and social computing › computer-mediated communication › virtual communication
avatar-mediated communication
0.312025
Towards Multimodal Empathetic Response Generation: A Rich Text-Speech-Vision Avatar-based Benchmark · WWW 2025

Methods — techniques the papers use, named apart from their topics

self-attention · 2.0residual connections · 2.0token-channel mixer · 1.7talking-face video generation · 1.7symmetric branch architecture · 1.7spiking neural network · 1.7multimodal response generation · 1.7multimodal large language model · 1.7chain-of-empathetic reasoning · 1.7q-k attention · 1.5spiking patch embedding · 0.8
YearPublicationVenuePosition
2026 Spikingformer: A Key Foundation Model for Spiking Neural Networks
abstract
Spiking neural networks (SNNs) offer a promising energy-efficient alternative to artificial neural networks, due to their event-driven spiking computation. However, some foundation SNN backbones (including Spikformer and SEW ResNet) suffer from non-spike computations (integer-float multiplications) caused by the structure of their residual connections. These non-spike computations increase SNNs' power consumption and make them unsuitable for deployment on mainstream neuromorphic hardware. In this paper, we analyze the spike-driven behavior of the residual connection methods in SNNs. We then present Spikingformer, a novel spiking transformer backbone that merges the MS Residual connection with Self-Attention in a biologically plausible way to address the non-spike computation challenge in Spikformer while maintaining global modeling capabilities. We evaluate Spikingformer across 13 datasets spanning large static images, neuromorphic data, and natural language tasks, and demonstrate the effectiveness and universality of Spikingformer, setting a vital benchmark for spiking neural networks. In addition, with the spike-driven features and global modeling capabilities, Spikingformer is expected to become a more efficient general-purpose SNN backbone towards energy-efficient artificial intelligence.
Chenlin Zhou, Liutao Yu, Zhaokun Zhou, Han Zhang 0035, Jiaqi Wang 0003, Zhengyu Ma, Yonghong Tian 0001
AAAI4
2026 Efficient speech command recognition leveraging spiking neural networks and progressive time-scaled curriculum distillation
Jiaqi Wang 0003, Liutao Yu, Liwei Huang, Chenlin Zhou, Han Zhang 0035, Zhenxi Song, Honghai Liu 0001, Min Zhang 0005, Zhengyu Ma, Zhiguo Zhang 0001
Neural Networks5
2025 The ACM Multimedia 2025 Grand Challenge of Avatar-based Multimodal Empathetic Conversation
abstract
The Ava-MERG Challenge at ACM Multimedia 2025 explores avatar-based multimodal empathetic response generation by advancing dialogue systems that respond with emotional awareness across text, speech, and talking-face video. To support this goal, we constructed a high-quality dataset featuring aligned multimodal responses in diverse conversational scenarios. The challenge comprises two progressively complex subtasks centering around multimodal-aware empathetic response generation. We aim to promote research in empathetic AI and affective computing.
Han Zhang 0035, Hao Fei 0001, Hong Han 0001, Lizi Liao, Erik Cambria, Min Zhang 0005
ACM Multimedia1
2025 S$^2$M-Former: Spiking Symmetric Mixing Branchformer for Brain Auditory Attention Detection
abstract
Auditory attention detection (AAD) aims to decode listeners' focus in complex auditory environments from electroencephalography (EEG) recordings, which is crucial for developing neuro-steered hearing devices. Despite recent advancements, EEG-based AAD remains hindered by the absence of synergistic frameworks that can fully leverage complementary EEG features under energy-efficiency constraints. We propose ***S$^2$M-Former***, a novel ***s***piking ***s***ymmetric ***m***ixing framework to address this limitation through two key innovations: i) Presenting a spike-driven symmetric architecture composed of parallel spatial and frequency branches with mirrored modular design, leveraging biologically plausible token-channel mixers to enhance complementary learning across branches; ii) Introducing lightweight 1D token sequences to replace conventional 3D operations, reducing parameters by 14.7$\times$. The brain-inspired spiking architecture further reduces power consumption, achieving a 5.8$\times$ energy reduction compared to recent ANN methods, while also surpassing existing SNN baselines in terms of parameter efficiency and performance. Comprehensive experiments on three AAD benchmarks (KUL, DTU and AV-GC-AAD) across three settings (within-trial, cross-trial and cross-subject) demonstrate that S$^2$M-Former achieves comparable state-of-the-art (SOTA) decoding accuracy, making it a promising low-power, high-performance solution for AAD tasks. Code is available at https://github.com/JackieWang9811/S2M-Former.
Jiaqi Wang 0003, Zhengyu Ma, Xiongri Shen, Chenlin Zhou, Han Zhang 0035, Zhenxi Song, Zhiguo Zhang 0001
NeurIPS6
2025 Towards Multimodal Empathetic Response Generation: A Rich Text-Speech-Vision Avatar-based Benchmark
abstract
Empathetic Response Generation (ERG) is one of the key tasks of the affective computing area, which aims to produce emotionally nuanced and compassionate responses to user's queries. However, existing ERG research is predominantly confined to the singleton text modality, limiting its effectiveness since human emotions are inherently conveyed through multiple modalities. To combat this, we introduce an avatar-based Multimodal ERG (MERG) task, entailing rich text, speech, and facial vision information. We first present a large-scale high-quality benchmark dataset, AvaMERG, which extends traditional text ERG by incorporating authentic human speech audio and dynamic talking-face avatar videos, encompassing a diverse range of avatar profiles and broadly covering various topics of real-world scenarios. Further, we deliberately tailor a system, named Empatheia, for MERG. Built upon a Multimodal Large Language Model (MLLM) with multimodal encoder, speech and avatar generators, Empatheia performs end-to-end MERG, with Chain-of-Empathetic reasoning mechanism integrated for enhanced empathy understanding and reasoning.Finally, we devise a list of empathetic-enhanced tuning strategies, strengthening the capabilities of emotional accuracy and content, avatar-profile consistency across modalities. Experimental results on AvaMERG data demonstrate that Empatheia consistently shows superior performance than baseline methods on both textual ERG and MERG. All data and code are open at https://AvaMERG.github.io/.
Han Zhang 0035, Zixiang Meng, Meng Luo 0010, Hong Han 0001, Lizi Liao, Erik Cambria, Hao Fei 0001
WWW1
2024 QKFormer: Hierarchical Spiking Transformer using Q-K Attention
abstract
Spiking Transformers, which integrate Spiking Neural Networks (SNNs) with Transformer architectures, have attracted significant attention due to their potential for low energy consumption and high performance. However, there remains a substantial gap in performance between SNNs and Artificial Neural Networks (ANNs). To narrow this gap, we have developed QKFormer, a direct training spiking transformer with the following features: i) _Linear complexity and high energy efficiency_, the novel spike-form Q-K attention module efficiently models the token or channel attention through binary vectors and enables the construction of larger models. ii) _Multi-scale spiking representation_, achieved by a hierarchical structure with the different numbers of tokens across blocks. iii) _Spiking Patch Embedding with Deformed Shortcut (SPEDS)_, enhances spiking information transmission and integration, thus improving overall performance. It is shown that QKFormer achieves significantly superior performance over existing state-of-the-art SNN models on various mainstream datasets. Notably, with comparable size to Spikformer (66.34 M, 74.81\%), QKFormer (64.96 M) achieves a groundbreaking top-1 accuracy of **85.65\%** on ImageNet-1k, substantially outperforming Spikformer by **10.84\%**. To our best knowledge, this is the first time that directly training SNNs have exceeded 85\% accuracy on ImageNet-1K.
Chenlin Zhou, Han Zhang 0035, Zhaokun Zhou, Liutao Yu, Liwei Huang, Xiaopeng Fan 0001, Li Yuan 0007, Zhengyu Ma, Yonghong Tian 0001
NeurIPS2
2021 Adaptive Spatiotemporal Graph Convolutional Networks for Motor Imagery Classification
abstract
Classification of electroencephalogram-based motor imagery (MI-EEG) tasks is crucial in brain computer interfaces (BCI). In view of the characteristics of non-stationarity, time-variability and individual diversity of EEG signals, a novel framework based on graph neural network is proposed for MI-EEG classification. First, an adaptive graph convolutional layer (AGCL) is constructed, by which the electrode channel information are integrated dynamically. We further propose an adaptive spatiotemporal graph convolutional network (ASTGCN), which fully exploits the characteristics of EEG signals in time domain and the channel correlations in spatial domain simultaneously. We execute the experiments using EEG signals recorded at motor imagery scenarios, where twenty-five healthy subjects performed MI movements of the right hand and feet to generate motor commands. Experimental results reveal that the proposed method outperforms state-of-the-art methods in terms of both classification quality and robustness. The advantages of ASTGCN include high accuracy, high efficiency, and robustness to cross-trial and cross-subject variations, making it an ideal candidate for long-term MI-EEG applications.
Biao Sun 0003, Han Zhang 0035, Zexu Wu, Yunyan Zhang, Ting Li 0012
IEEE Signal Process. Lett.2
2021 EEG Motor Imagery Classification With Sparse Spectrotemporal Decomposition and Deep Learning
abstract
Classification of electroencephalogram-based motor imagery (MI-EEG) tasks raises a big challenge in the design and development of brain-computer interfaces (BCIs). In view of the characteristics of nonstationarity, time-variability, and individual diversity of EEG signals, a deep learning framework termed SSD-SE-convolutional neural network (CNN) is proposed for MI-EEG classification. The framework consists of three parts: 1) the sparse spectrotemporal decomposition (SSD) algorithm is proposed for feature extraction, overcoming the drawbacks of conventional time-frequency analysis methods and enhancing the robustness to noise; 2) a CNN is constructed to fully exploit the time-frequency features, thus outperforming traditional classification methods both in terms of accuracy and kappa value; and 3) the squeeze-and-excitation (SE) blocks are adopted to adaptively recalibrate channelwise feature responses, which further improves the overall performance and offers a compelling classification solution for MI-EEG applications. Experimental results on two datasets reveal that the proposed framework outperforms state-of-the-art methods in terms of both classification quality and robustness. The advantages of SSD-SE-CNN include high accuracy, high efficiency, and robustness to cross-trial and cross-session variations, making it an ideal candidate for long-term MI-EEG applications.
Biao Sun 0003, Han Zhang 0035, Ruifeng Bai, Ting Li 0012
IEEE Trans Autom. Sci. Eng.3