Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data.

Hao Yang 0066

dblp:54/4089-66 · DBLP profile ↗
← Back
8ranked-venue papers
5as first author
8since 2021 · last 2026
0000-0002-8138-7387ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 4 · 1 first-author · 4 since 2021Graphics, computer vision, multimedia, augmented reality and games · 3 · 2 first-author · 3 since 2021Applied, interdisciplinary, general and emerging computing · 2 · 2 first-author · 2 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Artificial intelligence
5 papers
Information extraction and text analysis · 38% Question answering and dialogue systems · 32% Vision and language · 18%
Human-computer interaction and pervasive computing
2 papers
Human-AI interaction · 59% Health and well-being technologies · 41%
Interdisciplinary, comprehensive, and emerging computing
1 paper
Medical and health informatics · 87% Computational social science and digital humanities · 13%
Computer graphics and multimedia
1 paper
Multimedia analysis and retrieval · 100%

Topics — the 19 heaviest of 21, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Natural language and speech › Information extraction and text analysis › sentiment analysis
multimodal sentiment analysis
1.122025
Large language models meet text-centric multimodal sentiment analysis: a survey · Sci. China Inf. Sci. 2025
From unimodal to multimodal: a framework for generating high-quality multimodal emotional chit-chat dialogue · Sci. China Inf. Sci. 2025
Human-AI interaction › large language models
large language model evaluation
1.012026
CARE-Bench: A Benchmark of Diverse Client Simulations Guided by Expert Principles for Evaluating LLMs in Psychological Counseling · AAAI 2026
Health and well-being technologies › mental health › mental healthcare
mental health counseling
1.012026
CARE-Bench: A Benchmark of Diverse Client Simulations Guided by Expert Principles for Evaluating LLMs in Psychological Counseling · AAAI 2026
Natural language and speech › Question answering and dialogue systems › open-domain dialogue
emotional support conversation
0.912025
Look Beyond Feeling: Unveiling Latent Needs from Implicit Expressions for Proactive Emotional Support · EMNLP 2025
Computer vision › Vision and language
multimodal dialogue
0.912025
Ensuring Responses Contain Appropriate Images: Timing Judgment for Multimodal Responses · ACM Multimedia 2025
Natural language and speech › Question answering and dialogue systems › dialogue generation
multimodal dialogue generation
0.912025
From unimodal to multimodal: a framework for generating high-quality multimodal emotional chit-chat dialogue · Sci. China Inf. Sci. 2025
Natural language and speech › Question answering and dialogue systems › dialogue generation
multimodal response generation
0.912025
Ensuring Responses Contain Appropriate Images: Timing Judgment for Multimodal Responses · ACM Multimedia 2025
Medical and health informatics › mental health informatics
depression detection
0.912025
End-to-End Learnable Psychiatric Scale Guided Risky Post Screening for Depression Detection on Social Media · EMNLP 2025
Medical and health informatics
mental health
0.912025
End-to-End Learnable Psychiatric Scale Guided Risky Post Screening for Depression Detection on Social Media · EMNLP 2025
Natural language and speech › Information extraction and text analysis
sentiment analysis
0.822025
Face-Sensitive Image-to-Emotional-Text Cross-modal Translation for Multimodal Aspect-based Sentiment Analysis · EMNLP 2022
Large language models meet text-centric multimodal sentiment analysis: a survey · Sci. China Inf. Sci. 2025
Natural language and speech › Information extraction and text analysis › sentiment analysis
aspect-based sentiment analysis
0.612022
Face-Sensitive Image-to-Emotional-Text Cross-modal Translation for Multimodal Aspect-based Sentiment Analysis · EMNLP 2022
Machine learning › Generative modeling › cross-modal generation
cross-modal translation
0.612022
Face-Sensitive Image-to-Emotional-Text Cross-modal Translation for Multimodal Aspect-based Sentiment Analysis · EMNLP 2022
Natural language and speech › Information extraction and text analysis › sentiment analysis › aspect-based sentiment analysis
multimodal aspect-based sentiment analysis
0.612022
Face-Sensitive Image-to-Emotional-Text Cross-modal Translation for Multimodal Aspect-based Sentiment Analysis · EMNLP 2022
Computer vision › Vision and language › vision-language generation
vision-to-language translation
0.612022
Face-Sensitive Image-to-Emotional-Text Cross-modal Translation for Multimodal Aspect-based Sentiment Analysis · EMNLP 2022
Health and well-being technologies
mental health technology
0.312026
CARE-Bench: A Benchmark of Diverse Client Simulations Guided by Expert Principles for Evaluating LLMs in Psychological Counseling · AAAI 2026
Computational social science and digital humanities
social media analysis
0.312025
End-to-End Learnable Psychiatric Scale Guided Risky Post Screening for Depression Detection on Social Media · EMNLP 2025
Multimedia analysis and retrieval
semantic coherence
0.312025
Ensuring Responses Contain Appropriate Images: Timing Judgment for Multimodal Responses · ACM Multimedia 2025
Multimedia analysis and retrieval › cross-modal alignment
text-image alignment
0.312025
Ensuring Responses Contain Appropriate Images: Timing Judgment for Multimodal Responses · ACM Multimedia 2025
Computer vision › Face, body and person analysis
facial expression analysis
0.212022
Face-Sensitive Image-to-Emotional-Text Cross-modal Translation for Multimodal Aspect-based Sentiment Analysis · EMNLP 2022

Methods — techniques the papers use, named apart from their topics

large language model · 1.9psychological scales · 1.7multimodal large language model · 1.7multi-stage data curation · 1.7fine-tuning · 1.7active listening · 1.7expert-guided benchmark · 1.0client simulation · 1.0straight-through estimator · 0.9psychiatric scale guidance · 0.9end-to-end learnable screening · 0.9multimodal fusion · 0.6contrastive learning · 0.6
YearPublicationVenuePosition
2026 CARE-Bench: A Benchmark of Diverse Client Simulations Guided by Expert Principles for Evaluating LLMs in Psychological Counseling
abstract
The mismatch between the growing demand for psychological counseling and the limited availability of services has motivated research into the application of Large Language Models (LLMs) in this domain. Consequently, there is a need for a robust and unified benchmark to assess the counseling competence of various LLMs. Existing works, however, are limited by unprofessional client simulation, static question-and-answer evaluation formats, and unidimensional metrics. These limitations hinder their effectiveness in assessing a model's comprehensive ability to handle diverse and complex clients. To address this gap, we introduce CARE-Bench, a dynamic and interactive automated benchmark. It is built upon diverse client profiles derived from real-world counseling cases and simulated according to expert guidelines. CARE-Bench provides a multidimensional performance evaluation grounded in established psychological scales. Using CARE-Bench, we evaluate several general-purpose LLMs and specialized counseling models, revealing their current limitations. In collaboration with psychologists, we conduct a detailed analysis of the reasons for LLMs' failures when interacting with clients of different types, which provides directions for developing more comprehensive, universal, and effective counseling models.
Bichen Wang, Yixin Sun 0002, Hao Yang 0066, Si Wei, Shijin Wang 0001, Bing Qin 0001
AAAI4
2025 Look Beyond Feeling: Unveiling Latent Needs from Implicit Expressions for Proactive Emotional Support
abstract
In recent years, Large Language Models (LLMs) have made significant progress in emotional support dialogue.However, there are two major challenges for LLM-based support systems.First, users may be hesitant to fully disclose their emotions at the outset.Second, direct probing or excessive questioning can induce discomfort or even resistance.To bridge this gap, we propose COCOON, a proactive emotional support framework that leverages principles of active listening to uncover implicit user needs.We design a multi-stage data curation pipeline and an annotation mechanism for support strategies.Based on this framework, we build COCOON-Llama3, a fine-tuned large language model, and evaluate it using both standard metrics and psychological scales.Experimental results indicate that our model more effectively elicits implicit emotional needs and delivers empathetic support compared to existing baselines, suggesting its utility for building more inclusive emotional support dialogue systems.
Bichen Wang, Hao Yang 0066, Bing Qin 0001
EMNLP4
2025 End-to-End Learnable Psychiatric Scale Guided Risky Post Screening for Depression Detection on Social Media
abstract
Detecting depression through users’ social media posting history is crucial for enabling timely intervention; however, irrelevant content within these posts negatively impacts detection performance. Thus, it is crucial to extract pertinent content from users’ complex posting history. Current methods utilize frozen screening models, which can miss critical information and limit overall performance due to isolated screening and detection processes. To address these limitations, we propose E2-LPS End-to-End Learnable Psychiatric Scale Guided Risky Post Screening Model) for jointly training our screening model, guided by psychiatric scales, alongside the detection model. We employ a straight-through estimator to enable a learnable end-to-end screening process and avoid the non-differentiability of the screening process. Experimental results show that E2-LPS outperforms several strong baseline methods, and qualitative analysis confirms that it better captures users’ mental states than others.
Bichen Wang, Yuzhe Zi, Yixin Sun 0002, Hao Yang 0066, Bing Qin 0001
EMNLP4
2025 Ensuring Responses Contain Appropriate Images: Timing Judgment for Multimodal Responses
abstract
The integration of multimodal information, particularly visual content, into dialogue systems has primarily focused on interpreting user-provided inputs, while comparatively little attention has been given to the proactive use of such content to enhance responses. In this paper, we explore a new research direction that addresses this gap by enabling dialogue systems to autonomously determine when and how to supplement textual responses with relevant images, based on conversational context and user intent. To support this goal, we propose AMI (Automated Multimodal Insertion), a novel framework for dynamic, context-aware multimodal supplementation in dialogue. We also introduce RID (Response with Appropriate Image Dataset), a bilingual (Chinese-English) multimodal multi-turn dialogue dataset designed to train and evaluate systems on this capability. RID features fine-grained annotations on image insertion timing and rationale, along with carefully aligned image-text pairs to ensure semantic coherence. Our experiments demonstrate that models trained with RID not only generate more informative and engaging responses, but also exhibit a stronger ability to leverage visual content when it is truly beneficial. These findings highlight the potential of proactive multimodal supplementation and offer new insights for advancing the development of intelligent, human-like dialogue systems. Code and data are available at: https://github.com/Tanthen/SCIR-AMI.
Hao Yang 0066, Bing Qin 0001
ACM Multimedia1
2025 Large language models meet text-centric multimodal sentiment analysis: a survey
Hao Yang 0066, Yang Wu 0010, Shilong Wang 0003, Zongyang Ma, Wanxiang Che, Shijin Wang 0001, Si Wei, Bing Qin 0001
Sci. China Inf. Sci.1
2025 From unimodal to multimodal: a framework for generating high-quality multimodal emotional chit-chat dialogue
Hao Yang 0066, Yang Wu 0010, Jianhua Yuan, Wanxiang Che, Shijin Wang 0001, Si Wei, Bing Qin 0001
Sci. China Inf. Sci.1
2024 MACSA: A multimodal aspect-category sentiment analysis dataset with multimodal fine-grained aligned annotations
Hao Yang 0066, Zhengming Si, Yang Wu 0010, Bing Qin 0001
Multim. Tools Appl.1
2022 Face-Sensitive Image-to-Emotional-Text Cross-modal Translation for Multimodal Aspect-based Sentiment Analysis
abstract
Aspect-level multimodal sentiment analysis, which aims to identify the sentiment of the target aspect from multimodal data, recently has attracted extensive attention in the community of multimedia and natural language processing.Despite the recent success in textual aspect-based sentiment analysis, existing models mainly focused on utilizing the object-level semantic information in the image but ignore explicitly using the visual emotional cues, especially the facial emotions.How to distill visual emotional cues and align them with the textual content remains a key challenge to solve the problem.In this work, we introduce a facesensitive image-to-emotional-text translation (FITE) method, which focuses on capturing visual sentiment cues through facial expressions and selectively matching and fusing with the target aspect in textual modality.To the best of our knowledge, we are the first that explicitly utilize the emotional information from images in the multimodal aspect-based sentiment analysis task.Experiment results show that our method achieves state-of-the-art results on the Twitter-2015 and Twitter-2017 datasets.The improvement demonstrates the superiority of our model in capturing aspect-level sentiment in multimodal data with facial expressions 1 .
Hao Yang 0066, Bing Qin 0001
EMNLP1