Demonstration venue · read-only. Every page can be browsed; the buttons that would change it are switched off. Create an account to run TaxoReview on your own data. A simulation from public publication records: the people listed were not invited and did not agree to review.
? Tutorial for this page

Shoujin Wang

dblp:16/8492 · DBLP profile ↗
← Back
94ranked-venue papers
15as first author
80since 2021 · last 2026
—ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Databases, data management, data science and information retrieval · 50 · 7 first-author · 45 since 2021Artificial intelligence and machine learning · 44 · 10 first-author · 35 since 2021Applied, interdisciplinary, general and emerging computing · 15 · 1 first-author · 15 since 2021Graphics, computer vision, multimedia, augmented reality and games · 14 · 6 first-author · 8 since 2021Computer networks · 3 · 3 since 2021Theory of computation · 3 · 3 since 2021Human-computer interaction and ubiquitous computing · 2 · 1 first-author · 1 since 2021Systems, architecture and hardware · 1 · 1 since 2021Security and privacy · 1 · 1 since 2021

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Databases, data mining, and information retrieval
34 papers
Recommender systems · 83% Information retrieval · 6% Web and social media mining · 6%
Artificial intelligence
20 papers
Trustworthy machine learning · 15% Transfer learning and domain adaptation · 12% Question answering and dialogue systems · 9%
Network and information security
2 papers
Security and privacy of machine learning · 100%

Topics — the 30 heaviest of 88, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Recommender systems
sequential recommendation
6.2112026
DTRec: Learning Dynamic Reasoning Trajectories for Sequential Recommendation · WWW 2026
When Large Vision Language Models Meet Multimodal Sequential Recommendation: An Empirical Study · WWW 2025
Unleashing the Potential of Diffusion Models Towards Diversified Sequential Recommendations · SIGIR 2025
Machine learning › Trustworthy machine learning
fairness
2.452026
Towards Fair Large Language Model-based Recommender Systems without Costly Retraining · WWW 2026
Learning Informative Representation for Fairness-Aware Multivariate Time-Series Forecasting: A Group-Based Perspective · IEEE Trans. Knowl. Data Eng. 2024
Generating with Fairness: A Modality-Diffused Counterfactual Framework for Incomplete Multimodal Recommendations · WWW 2025
Recommender systems
session-based recommendation
2.242025
Semantic Relation Guided Dual-view Contrastive Learning for Session-based Recommendations · ACM Trans. Inf. Syst. 2025
A Counterfactual Collaborative Session-based Recommender System · WWW 2023
Modeling Multi-Purpose Sessions for Next-Item Recommendations via Mixture-Channel Purpose Routing Networks · IJCAI 2019
Recommender systems
cross-domain recommendation
1.922026
A Multi-Modal Prompt-Tuning Framework for Non-Overlapping Multi-Domain Recommendation · IEEE Trans. Multim. 2026
Federated User Preference Modeling for Privacy-Preserving Cross-Domain Recommendation · IEEE Trans. Multim. 2025
Recommender systems
multimodal recommendation
1.922026
Structural and Disentangled Adaptation of Large Vision Language Models for Multimodal Recommendation · SIGIR 2026
Generating with Fairness: A Modality-Diffused Counterfactual Framework for Incomplete Multimodal Recommendations · WWW 2025
Web and social media mining › misinformation detection
fake news detection
1.622025
A Macro- and Micro-Hierarchical Transfer Learning Framework for Cross-Domain Fake News Detection · WWW 2025
MSynFD: Multi-hop Syntax Aware Fake News Detection · WWW 2024
Recommender systems › sequential recommendation
next-item recommendation
1.632025
Semantic Relation Guided Dual-view Contrastive Learning for Session-based Recommendations · ACM Trans. Inf. Syst. 2025
Modeling Multi-Purpose Sessions for Next-Item Recommendations via Mixture-Channel Purpose Routing Networks · IJCAI 2019
Attention-Based Transactional Context Embedding for Next-Item Recommendation · AAAI 2018
Recommender systems › representation learning for recommendation
contrastive learning for recommendation
1.522025
Semantic Relation Guided Dual-view Contrastive Learning for Session-based Recommendations · ACM Trans. Inf. Syst. 2025
Dual Contrastive Transformer for Hierarchical Preference Modeling in Sequential Recommendation · SIGIR 2023
Recommender systems › session-based recommendation
next-basket recommendation
1.532023
Modeling User Demand Evolution for Next-Basket Prediction · IEEE Trans. Knowl. Data Eng. 2023
Intention2Basket: A Neural Intention-driven Approach for Dynamic Next-basket Planning · IJCAI 2020
Intention Nets: Psychology-Inspired User Choice Behavior Modeling for Next-Basket Prediction · AAAI 2020
Recommender systems
news recommendation
1.322024
A Hierarchical and Disentangling Interest Learning Framework for Unbiased and True News Recommendation · KDD 2024
Veracity-aware and Event-driven Personalized News Recommendation for Fake News Mitigation · WWW 2022
Recommender systems
interactive recommendation
1.322023
WSDM 2023 Workshop on Interactive Recommender Systems · WSDM 2023
Session-based Interactive Recommendation via Deep Reinforcement Learning · ICDM 2023
Machine learning › Generative modeling
diffusion model
1.022025
NeuroClips: Towards High-fidelity and Smooth fMRI-to-Video Reconstruction · NeurIPS 2024
Unleashing the Potential of Diffusion Models Towards Diversified Sequential Recommendations · SIGIR 2025
Natural language and speech › Question answering and dialogue systems
knowledge base question answering
1.012026
SAR: A Structure-Aligned Reasoning Framework for Temporal Knowledge Graph Question Answering · AAAI 2026
Natural language and speech › Language models and text generation
large language model reasoning
1.012026
DTRec: Learning Dynamic Reasoning Trajectories for Sequential Recommendation · WWW 2026
Machine learning › Transfer learning and domain adaptation
model adaptation
1.012026
Structural and Disentangled Adaptation of Large Vision Language Models for Multimodal Recommendation · SIGIR 2026
Machine learning › Efficient and distributed learning
parameter-efficient fine-tuning
1.012026
Structural and Disentangled Adaptation of Large Vision Language Models for Multimodal Recommendation · SIGIR 2026
Natural language and speech › Language models and text generation
prompt tuning
1.012026
A Multi-Modal Prompt-Tuning Framework for Non-Overlapping Multi-Domain Recommendation · IEEE Trans. Multim. 2026
Machine learning › Trustworthy machine learning › fairness › ranking fairness
recommendation fairness
1.012026
Towards Fair Large Language Model-based Recommender Systems without Costly Retraining · WWW 2026
Natural language and speech › Question answering and dialogue systems › knowledge base question answering
temporal knowledge graph question answering
1.012026
SAR: A Structure-Aligned Reasoning Framework for Temporal Knowledge Graph Question Answering · AAAI 2026
Medical and health informatics › clinical decision support
medication recommendation
1.012026
RES-MR: Risk-Aware Reasoning for Explainable and Safe Medication Recommendation · SIGIR 2026
Recommender systems
fairness-aware recommendation
1.012026
Towards Fair Large Language Model-based Recommender Systems without Costly Retraining · WWW 2026
Recommender systems
large language model-based recommendation
1.012026
Towards Fair Large Language Model-based Recommender Systems without Costly Retraining · WWW 2026
Machine learning › Probabilistic and Bayesian machine learning › causal inference
causal discovery
0.912025
Revealing Multimodal Causality with Large Language Models · NeurIPS 2025
Knowledge, reasoning and agents › Knowledge representation and reasoning
causal reasoning
0.912025
Revealing Multimodal Causality with Large Language Models · NeurIPS 2025
Machine learning › Transfer learning and domain adaptation
cross-domain transfer
0.912025
A Macro- and Micro-Hierarchical Transfer Learning Framework for Cross-Domain Fake News Detection · WWW 2025
Machine learning › Transfer learning and domain adaptation › knowledge transfer
hierarchical transfer learning
0.912025
A Macro- and Micro-Hierarchical Transfer Learning Framework for Cross-Domain Fake News Detection · WWW 2025
Computer vision › Vision and language › vision-language model
multimodal large language model
0.912025
Revealing Multimodal Causality with Large Language Models · NeurIPS 2025
Machine learning › Time series and sequential data
time series analysis
0.912025
A Survey on Deep Learning based Time Series Analysis with Frequency Transformation · KDD (2) 2025
Medical and health informatics
mental health informatics
0.912025
DiGrI: Distorted Greedy Approach for Human-Assisted Online Suicide Ideation Detection · WWW 2025
Recommender systems › sequential recommendation › generative sequential recommendation
diffusion-based sequential recommendation
0.912025
Unleashing the Potential of Diffusion Models Towards Diversified Sequential Recommendations · SIGIR 2025

Methods — techniques the papers use, named apart from their topics

large language model · 5.7contrastive learning · 4.7diffusion model · 4.2attention mechanism · 3.1large vision-language model · 2.9retrieval-augmented generation · 2.0react-style reasoning · 2.0prompt tuning · 2.0multimodal representation learning · 2.0cross-modal structural alignment · 2.0counterfactual reasoning · 1.7tensor fusion network · 1.3graph convolutional network · 1.3reasoning · 1.0explainability · 1.0selective prediction · 0.9multi-classifier · 0.9federated learning · 0.9
YearPublicationVenuePosition
2026 SAR: A Structure-Aligned Reasoning Framework for Temporal Knowledge Graph Question Answering
abstract
Large language models (LLMs) augmented with retrieval have shown impressive performance in open-domain question answering, yet struggle significantly with temporal knowledge graph question answering (TKGQA). The core issue lies in structural misalignment: treating structured, temporally sensitive graph queries as plain text often causes LLMs to retrieve or reason with semantically similar but structurally incorrect facts, resulting in critical inaccuracies. To address this, we introduce SAR (Structure-Aligned Reasoning), a novel TKGQA framework that integrates LLM reasoning tightly with the explicit subject–predicate–object–time schema inherent in knowledge graphs. SAR employs an LLM agent to first decompose natural language questions into structured queries, clearly delineating entities, relationships, and temporal constraints. It then conducts schema-consistent, time-aware retrieval from the knowledge graph to acquire candidate quadruples, which guide a subsequent iterative ReAct-style reasoning process by the LLM. A final verification stage ensures that proposed answers strictly adhere to temporal conditions, reinforcing accuracy and temporal coherence. Experiments on two benchmark datasets, MultiTQ and CronQuestions, demonstrate SAR’s effectiveness, achieving the best results. Specifically, with GPT-4.1, SAR achieves 78.2% Hits@1 on MultiTQ, significantly outperforming existing methods, and similarly establishes a new performance record on CronQuestions. Our results underscore the critical importance of structural alignment in temporal reasoning tasks, particularly in handling complex queries involving multiple temporal constraints and multi-hop reasoning.
Qianyi Hu, Jiaxue Liu, Xinhui Tu, Shoujin Wang
AAAI4
2026 Structural and Disentangled Adaptation of Large Vision Language Models for Multimodal Recommendation
abstract
Multimodal recommendation enhances accuracy by leveraging visual and textual signals, and its success largely depends on learning high-quality cross-modal representations. Recent advances in Large Vision-Language Models (LVLMs) offer unified multimodal representation learning, making them a promising backbone. However, applying LVLMs to recommendation remains challenging due to ( i ) representation misalignment, where gaps between specific domain data and general pre-training lead to unaligned embedding spaces, and ( ii ) gradient conflicts during fine-tuning, where shared adapters cause interference and a lack of discriminative power. To address this, we propose SDA, a lightweight framework for Structural and Disentangled Adaptation, which integrates two components: Cross-Modal Structural Alignment (CMSA) and Modality-Disentangled Adaptation (MoDA). CMSA aligns embeddings using intra-modal structures as a soft teacher, while MoDA mitigates gradient conflicts via expertized, gated low-rank paths to disentangle gradient flows. Experiments on three public Amazon datasets show SDA integrates seamlessly with existing multimodal and sequential recommenders, yielding average gains of 6.15% in Hit@10 and 8.64% in NDCG@10. It also achieves up to 12.83% and 18.70% gains on long-tail items. Our code and full experimental results are available at https://github.com/RaoZhongtao/SDA.
Zhongtao Rao, Peilin Zhou, Dading Chong, Shoujin Wang, Nan Tang 0001
SIGIR5
2026 RES-MR: Risk-Aware Reasoning for Explainable and Safe Medication Recommendation
Jin Li 0028, Shoujin Wang, Yishuo Li, Huilin Gu, Wenpeng Lu
SIGIR3
2026 Towards Fair Large Language Model-based Recommender Systems without Costly Retraining
Jin Li 0028, Huilin Gu, Shoujin Wang, Qi Zhang 0020, Shui Yu 0001, Chen Wang 0008, Xiwei Xu 0001, Fang Chen 0001
WWW3
2026 DTRec: Learning Dynamic Reasoning Trajectories for Sequential Recommendation
abstract
Inspired by advances in LLMs, reasoning-enhanced sequential recommendation performs multi-step deliberation before making final predictions, unlocking greater potential for capturing user preferences. However, current methods are constrained by static reasoning trajectories that are ill-suited for the diverse complexity of user behaviors. They suffer from two key limitations: (1) a static reasoning direction, which uses flat supervision signals misaligned with human-like hierarchical reasoning, and (2) a fixed reasoning depth, which inefficiently applies the same computational effort to all users, regardless of pattern complexity. These rigidity lead to suboptimal performance and significant computational waste. To overcome these challenges, we propose DTRec, a novel and effective framework that explores the Dynamic reasoning Trajectory for Sequential Recommendation along both direction and depth. To guide the direction, we develop Hierarchical Process Supervision (HPS), which provides coarse-to-fine supervisory signals to emulate the natural, progressive refinement of human cognitive processes. To optimize the depth, we introduce the Adaptive Reasoning Halting (ARH) mechanism that dynamically adjusts the number of reasoning steps by jointly monitoring three indicators. Extensive experiments on three real-world datasets demonstrate the superiority of our approach, achieving up to a 24.5% performance improvement over strong baselines while simultaneously reducing computational cost by up to 41.6%.
Yifan Shao, Peilin Zhou, Shoujin Wang, Weizhi Zhang 0001, Sung Hun Kim 0003
WWW3
2026 Medication mapping and diagnosis enhancement for fine-grained medication recommendation
Yishuo Li, Qi Zhang 0020, Shoujin Wang, Weiyu Zhang 0001, Jiasheng Si, Wenpeng Lu
Inf. Sci.3
2026 Knowledge-Enhanced Multi-Level Session Graph Model for Interactive Recommendation through Deep Reinforcement Learning
abstract
Deep reinforcement learning (DRL), has shown promise in solving intractable challenges in interactive recommendation systems (IRS). In DRL-based interactive recommendation, state modeling is vital for well-capturing users’ continuous interaction behaviors with recommendation systems. To effectively capture the behavior of users, existing works for state modeling have evolved from sequential-based modeling to session-based modeling. However, existing session-based state modeling works in IRS are still not fully explored with premature session models and insufficient fusion for different session features. As a result, they cannot capture complicated session patterns during interaction, leading to significant information loss. In this article, we propose a Knowledge-enhanced Multi-Level Session Graph (KMSG) model for interactive recommendation to address the above challenge. KMSG models the user’s interactive data into multi-level session graphs and effectively encodes the states via graph neural networks. Specifically, a novel 3-level item transition graph is designed to capture the common session patterns and intra-session item transitions. We further utilize the information from the knowledge graph to enhance the item relations in KMSG. We then design an attention-based graph neural network to propagate the information in KMSG. Extensive experiments on four real-world benchmark datasets demonstrate the superiority of KMSG over state-of-the-art baselines and the rationality of our design in KMSG.
Longxiang Shi, Shoujin Wang, Qi Zhang 0020, Kui Su, Shijian Li
ACM Trans. Knowl. Discov. Data4
2026 A Multi-Modal Prompt-Tuning Framework for Non-Overlapping Multi-Domain Recommendation
abstract
Cross-domain recommendation (CDR) aims to enhance recommendation accuracy in data-sparse domains by transferring knowledge from data-rich domains. Most existing CDR methods conduct knowledge transfer based on overlapping users or items to address the user cold-start problems, including few-shot (i.e., users with sparse interactions) and zero-shot (i.e., users with no interactions) scenarios. However, in real-world scenarios, such overlap is often sparse or non-existent, limiting the effectiveness of these approaches. To overcome this challenge, we propose a novelMulti-modalPrompt-tuningFramework forNon-overlappingMulti-DomainRecommendation (MPF-NMDR). MPF-NMDR transfers knowledge across non-overlapping domains, enhancing recommendation performance in both few-shot and zero-shot scenarios. Specifically, we first pre-train the MPF-NMDR framework on data from all domains to capture users' generalized cross-domain preferences, which are learned through the generalized multi-modal interest mining module. We then conduct prompt-tuning with domain, user, and item prompts in the target domain to capture distinctions among various domains, users, and items. In this process, only the prompt parameters are fine-tuned, while all other parameters remain frozen, enabling the model to capture the distinctions among domains, users, and items while preserving the cross-domain knowledge. Extensive experiments on Amazon and Douban review datasets validate the superior performance of MPF-NMDR compared to SOTA baselines. We release our code athttps://github.com/Lili1013/MPF_NMDR.
Li Wang 0064, Shoujin Wang, Qiang Wu 0001, Min Xu 0001
IEEE Trans. Multim.2
2026 Misinformation Unlearning for Responsible Content Recommendation
abstract
Content recommender systems (RSs), which recommend content (e.g., news, videos) to users, can inadvertently facilitate the spread of misinformation (e.g., fake news, inaccurate content) due to their ignorance of content credibility. The widespread misinformation can lead to serious consequences, including public confusion and social unrest. Despite the pressing need to mitigate misinformation in content RSs, only a few studies have attempted to tackle this. Moreover, they generally require retraining the entire model from scratch, which is time-consuming and impractical for real-world applications. To this end, we propose MisEraser , a novel misinformation unlearning framework that effectively mitigates misinformation in content RSs without retraining. Specifically, MisEraser consists of three key components: (1) A misinformation disentanglement network , which effectively separates misinformation-specific information from item content while preserving misinformation-free information to maintain recommendation accuracy; (2) A misinformation fusion network , which fuses misinformation-specific signals from both users’ interaction sequences and the entire misinformation item set to enhance the comprehensiveness of misinformation unlearning; and (3) A misinformation erasing network , which effectively removes the fused misinformation-specific signals from trained recommendation models, enabling them to generate misinformation-suppressed and more responsible recommendations. Extensive experiments demonstrate the effectiveness of MisEraser in mitigating misinformation while maintaining high recommendation accuracy and efficiency.
Zhuo Cai 0003, Shoujin Wang, Peilin Zhou, Yan Wang 0002, Xiao Liu 0004, Lianyong Qi, Julian J. McAuley, Dietmar Jannach
ACM Trans. Inf. Syst.2
2026 Introduction to the Special Issue on Deep Reinforcement Learning for Recommender Systems
abstract
Deep Reinforcement Learning (DRL) has garnered significant attention as a promising approach for developing intelligent and adaptive recommender systems. This paradigm is especially well-suited for recommendation scenarios characterized by dynamic user environments, temporally delayed feedback signals, and continuously shifting user preferences. However, deploying DRL within recommendation scenarios introduces a range of intricate challenges. These include the design of meaningful and task-aligned reward functions, effective navigation of vast and complex action spaces, and the need to maintain sample efficiency in data-sparse environments. Ensuring robust and stable training dynamics adds further difficulty. This special issue brings together a diverse collection of cutting-edge research that addresses these pressing challenges, showcasing advances that move the field toward more adaptive, robust, and personalized recommendation systems grounded in reinforcement learning.
Lianyong Qi, Shoujin Wang, Victor S. Sheng, Lina Yao 0001
Trans. Recomm. Syst.2
2025 A Survey on Deep Learning based Time Series Analysis with Frequency Transformation
abstract
Recently, frequency transformation (FT) has been increasingly incorporated into deep learning models to significantly enhance state-of-the-art accuracy and efficiency in time series analysis. The advantages of FT, such as high efficiency and a global view, have been rapidly explored and exploited in various time series tasks and applications, demonstrating the promising potential of FT as a new deep learning paradigm for time series analysis. Despite the growing attention and the proliferation of research in this emerging field, there is currently a lack of a systematic review and in-depth analysis of deep learning-based time series models with FT. It is also unclear why FT can enhance time series analysis and what its limitations are in the field. To address these gaps, we present a comprehensive review that systematically investigates and summarizes the recent research advancements in deep learning-based time series analysis with FT. Specifically, we explore the primary approaches used in current models that incorporate FT, the types of neural networks that leverage FT, and the representative FT-equipped models in deep time series analysis. We propose a novel taxonomy to categorize the existing methods in this field, providing a structured overview of the diverse approaches employed in incorporating FT into deep learning models for time series analysis. Finally, we highlight the advantages and limitations of FT for time series modeling and identify potential future research directions that can further contribute to the community of time series analysis.
Kun Yi 0001, Qi Zhang 0020, Wei Fan 0010, Longbing Cao, Shoujin Wang, Guodong Long, Liang Hu 0004, Qingsong Wen, Hui Xiong 0001
KDD (2)5
2025 Revealing Multimodal Causality with Large Language Models
abstract
Uncovering cause-and-effect mechanisms from data is fundamental to scientific progress. While large language models (LLMs) show promise for enhancing causal discovery (CD) from unstructured data, their application to the increasingly prevalent multimodal setting remains a critical challenge. Even with the advent of multimodal LLMs (MLLMs), their efficacy in multimodal CD is hindered by two primary limitations: (1) difficulty in exploring intra- and inter-modal interactions for comprehensive causal variable identification; and (2) insufficiency to handle structural ambiguities with purely observational data. To address these challenges, we propose MLLM-CD, a novel framework for multimodal causal discovery from unstructured data. It consists of three key components: (1) a novel contrastive factor discovery module to identify genuine multimodal factors based on the interactions explored from contrastive sample pairs; (2) a statistical causal structure discovery module to infer causal relationships among discovered factors; and (3) an iterative multimodal counterfactual reasoning module to refine the discovery outcomes iteratively by incorporating the world knowledge and reasoning capabilities of MLLMs. Extensive experiments on both synthetic and real-world datasets demonstrate the effectiveness of the proposed MLLM-CD in revealing genuine factors and causal relationships among them from multimodal unstructured data. The implementation code and data are available at https://github.com/JinLi-i/MLLM-CD.
Jin Li 0002, Shoujin Wang, Qi Zhang 0020, Feng Liu 0003, Tongliang Liu, Longbing Cao, Shui Yu 0001, Fang Chen 0001
NeurIPS2
2025 A Survey on Enhancing Causal Reasoning Ability of Large Language Models
Zhuo Cai 0003, Shoujin Wang, Kun Yu 0001, Fang Chen 0001
PAKDD (4)3
2025 Unleashing the Potential of Diffusion Models Towards Diversified Sequential Recommendations
abstract
Sequential recommender systems (SRSs) aim to recommend the next items to well match users' preferences. In addition to recommendation accuracy, diversity is another critical aspect in evaluating SRSs. Recently, the emerging diffusion models (DMs) have been widely adopted in SRSs. Their employed learning-to-generate paradigm allows them to cover a much broader range of users' preferences and thus generate more diversified items. However, existing DM-based SRSs still face two significant gaps that prevent them from further improving the recommendation diversity: (1) they often rely on non-diversified users' preferences as guidance to direct the training of diffusion networks, restricting networks' ability to generate diverse items; and (2) they are based on a homogeneous diffusion inference mechanism to generate the next items and thus can only accommodate users' major preferences. Such a practice neglects users' heterogeneous preferences towards various types of items, further limiting recommendation diversity. To bridge these two critical gaps and to further unleash the potential of DMs in enhancing the recommendation diversity of SRSs, we propose a novel diversity-guided diffusion model for sequential recommendations, called DiffDiv for short. To be specific, first, a new diversity-aware guidance learning mechanism is devised to direct the training of DMs to effectively capture users' diversified preferences from their historical interactions. Then, a novel heterogeneous diffusion inference mechanism is designed to generate diversified items to accommodate users' heterogeneous preferences, further boosting the recommendation diversity. Extensive experiments on real-world datasets validate the effectiveness of DiffDiv in terms of both recommendation accuracy and diversity.
Zhuo Cai 0003, Shoujin Wang, Victor W. Chu, Usman Naseem, Yang Wang 0002, Fang Chen 0001
SIGIR2
2025 Generating with Fairness: A Modality-Diffused Counterfactual Framework for Incomplete Multimodal Recommendations
abstract
Incomplete scenario is a prevalent, practical, yet challenging setting in Multimodal Recommendations (MMRec), where some item modalities are missing due to various factors. Recently, a few efforts have sought to improve the recommendation accuracy by exploring generic structures from incomplete data. However, two significant gaps persist: 1) the difficulty in accurately generating missing data due to the limited ability to capture modality distributions; and 2) the critical but overlooked visibility bias, where items with missing modalities are more likely to be disregarded due to the prioritization of items' multimodal data over user preference alignment. This bias raises serious concerns about the fair treatment of items. To bridge these two gaps, we propose a novel Modality-Diffused Counterfactual (MoDiCF) framework for incomplete multimodal recommendations. MoDiCF features two key modules: a novel modality-diffused data completion module and a new counterfactual multimodal recommendation module. The former, equipped with a particularly designed multimodal generative framework, accurately generates and iteratively refines missing data from learned modality-specific distribution spaces. The latter, grounded in the causal perspective, effectively mitigates the negative causal effects of visibility bias and thus assures fairness in recommendations. Both modules work collaboratively to address the two aforementioned significant gaps for generating more accurate and fair results. Extensive experiments on three real-world datasets demonstrate the superior performance of MoDiCF in terms of both recommendation accuracy and fairness. The code and processed datasets are released at https://github.com/JinLi-i/MoDiCF.
Jin Li 0002, Shoujin Wang, Qi Zhang 0020, Shui Yu 0001, Fang Chen 0001
WWW2
2025 DiGrI: Distorted Greedy Approach for Human-Assisted Online Suicide Ideation Detection
abstract
User-generated content on social media platforms provides a valuable resource for developing automated computational methods to detect mental health issues online leading to suicidal thoughts automatically. Although current fully automated methods show promise, they may produce uncertain predictions, leading to flawed conclusions. To address this, we propose a novel model called DiGrI, or Distorted Greedy Approach for Human-Assisted Online Suicide Ideation Detection, which reformulates suicide ideation assessment as a selective, prioritized prediction problem. The model incorporates a novel multi-classifier distorted greedy model that is optimized to operate under various levels of automation and abstains from making uncertain predictions with theoretical guarantees. Our results show that DiGrI outperforms strong comparative models including large language models in detecting mental health issues on a publicly available Reddit dataset. We discuss the empirical and practical implications, including the ethical considerations of using DiGrI for online automatic suicide ideation detection involving humans, if it were to be translated for use in clinical and public health practice.
Usman Naseem, Liang Hu 0008, Qi Zhang 0020, Shoujin Wang, Shoaib Jameel
WWW4
2025 A Macro- and Micro-Hierarchical Transfer Learning Framework for Cross-Domain Fake News Detection
abstract
Cross-domain fake news detection aims to mitigate domain shift and improve detection performance by transferring knowledge across domains. Existing approaches transfer knowledge based on news content and user engagements from a source domain to a target domain. However, these approaches face two main limitations, hindering effective knowledge transfer and optimal fake news detection performance. Firstly, from a micro perspective, they neglect the negative impact of veracity-irrelevant features in news content when transferring domain-shared features across domains. Secondly, from a macro perspective, existing approaches ignore the relationship between user engagement and news content, which reveals shared behaviors of common users across domains and can facilitate more effective knowledge transfer. To address these limitations, we propose a novel macro- and micro- hierarchical transfer learning framework (MMHT) for cross-domain fake news detection. Firstly, we propose a micro-hierarchical disentangling module to disentangle veracity-relevant and veracity-irrelevant features from news content in the source domain for improving fake news detection performance in the target domain. Secondly, we propose a macro-hierarchical transfer learning module to generate engagement features based on common users' shared behaviors in different domains for improving effectiveness of knowledge transfer. Extensive experiments on real-world datasets demonstrate that our framework significantly outperforms the state-of-the-art baselines.
Xuankai Yang 0001, Yan Wang 0002, Xiuzhen Zhang 0001, Shoujin Wang, Huaxiong Wang, Kwok-Yan Lam
WWW4
2025 When Large Vision Language Models Meet Multimodal Sequential Recommendation: An Empirical Study
abstract
As multimedia content continues to grow on the web, the integration of visual and textual data has become a crucial challenge for web applications, particularly in recommendation systems. Large Vision Language Models (LVLMs) have demonstrated considerable potential in addressing this challenge across various tasks that require such multimodal integration. However, their application in multimodal sequential recommendation (MSR) has not been extensively studied. To bridge this gap, we introduce MSRBench, the first comprehensive benchmark designed to systematically evaluate different LVLM integration strategies in web-based recommendation scenarios. We benchmark three state-of-the-art LVLMs, i.e., GPT-4 Vision, GPT-4o, and Claude-3-Opus, on the next item prediction task using the constructed Amazon Review Plus dataset, which includes additional item descriptions generated by LVLMs. Our evaluation examines five integration strategies: using LVLMs as recommender, item enhancer, reranker, and various combinations of these roles. The benchmark results reveal that 1) using LVLMs as rerankers is the most effective strategy, significantly outperforming others that rely on LVLMs to directly generate recommendations or only enhance items; 2) GPT-4o consistently achieves the best performance across most scenarios, particularly when employed as a reranker; 3) the computational inefficiency of LVLMs presents a major barrier to their widespread adoption in real-time multimodal recommendation systems. Our code and datasets are available at https://github.com/PALIN2018/MSRBench.
Peilin Zhou, Chao Liu 0001, Jing Ren 0010, Xinfeng Zhou, Yueqi Xie, Meng Cao 0002, Zhongtao Rao, You-Liang Huang, Dading Chong, Junling Liu, Jae Boum Kim, Shoujin Wang, Raymond Chi-Wing Wong, Sunghun Kim 0001
WWW12
2025 Modeling information propagation for target user groups in online social networks based on guidance and incentive strategies
Lei Meng 0002, Shoujin Wang
Inf. Sci.4
2025 Federated User Preference Modeling for Privacy-Preserving Cross-Domain Recommendation
abstract
Cross-domain recommendation (CDR) aims to address the data-sparsity problem by transferring knowledge across domains. Existing CDR methods generally assume that the user-item interaction data is shareable between domains, which leads to privacy leakage. Recently, some privacy-preserving CDR (PPCDR) models have been proposed to solve this problem. However, they primarily transfer simple representations learned only from user-item interaction histories, overlooking other useful side information, leading to inaccurate user preferences. Additionally, they transfer differentially private user-item interaction matrices or embeddings across domains to protect privacy. However, these methods offer limited privacy protection, as attackers may exploit external information to infer the original data. To address these challenges, we propose a novel Federated User Preference Modeling (FUPM) framework. In FUPM, first, a novel comprehensive preference exploration module is proposed to learn users' comprehensive preferences from both interaction data and additional data including review texts and potentially positive items. Next, a private preference transfer module is designed to first learn differentially private local and global prototypes, and then privately transfer the global prototypes using a federated learning strategy. These prototypes are generalized representations of user groups, making it difficult for attackers to infer individual information. Extensive experiments on four CDR tasks conducted on the Amazon and Douban datasets validate the superiority of FUPM over SOTA baselines.
Li Wang 0064, Shoujin Wang, Quangui Zhang, Qiang Wu 0001, Min Xu 0001
IEEE Trans. Multim.2
2025 Robust Multivariate Time Series Forecasting Against Intraseries and Interseries Transitional Shift
abstract
The nonstationary nature of real-world multivariate time series (MTS) data presents forecasting models with a formidable challenge of the time-variant distribution of time series, referred to as distribution shift. Existing studies on the distribution shift mostly adhere to adaptive normalization techniques for alleviating temporal mean and covariance shifts or time-variant modeling for capturing temporal shifts. Despite improving model generalization, these normalization-based methods often assume a time-invariant transition between outputs and inputs but disregard specific intraseries/interseries correlations, while time-variant models overlook the intrinsic causes of the distribution shift. This limits the model's expressiveness and interpretability in tackling the distribution shift for MTS forecasting. To mitigate such a dilemma, we present a unified Probabilistic Graphical Model to Jointly capture intraseries/interseries correlations and model the time-variant transitional distribution and instantiate a neural framework called JointPGM for nonstationary MTS forecasting. Specifically, JointPGM first employs multiple Fourier basis functions to learn dynamic time factors and designs two distinct learners: intraseries and interseries learners. The intraseries learner effectively captures temporal dynamics by utilizing temporal gates, while the interseries learner explicitly models spatial dynamics through multihop propagation, incorporating Gumbel-softmax sampling. These two types of series dynamics are subsequently fused into a latent variable, which is inversely employed to infer time factors, generate a final prediction, and perform the reconstruction. We validate the effectiveness and efficiency of JointPGM through extensive experiments on six highly nonstationary MTS datasets, achieving state-of-the-art (SOTA) forecasting performance of MTS forecasting.
Qi Zhang 0020, Kun Yi 0001, Xiaojun Xue, Shoujin Wang, Liang Hu 0004, Longbing Cao
IEEE Trans. Neural Networks Learn. Syst.5
2025 Semantic Relation Guided Dual-view Contrastive Learning for Session-based Recommendations
abstract
Session-based Recommender Systems (SBRSs) aim to recommend the next item to users based on their historical interactions with items within or between sessions. A session is constituted by a sequence of interactions between the user and items within a continuous period. Existing SBRSs often focus on modeling co-occurrence-based inter-item transitions within or between sessions only. They generally overlook intrinsic inter-item semantic relations. Specifically, in practice, many items are substitutable or complementary to each other. Such relations provide significant signals to guide user interaction behaviors as well as the next-item recommendations. Moreover, existing works overlook the fact that user behaviors are driven simultaneously by both user intent and item attributes, failing to consider the implicit item characteristics embedded within. Such practice leads to entangled user intent and latent item characteristics, bringing unnecessary interference between these two aspects, impeding accurate modeling of each aspect, ultimately significantly impeding recommendation performance. To bridge these gaps, we propose a novel framework called S emantic relation guided dual-view C ontrastive L earning for S ession-based R ecommendations (SCL-SR). SCL-SR introduces a novel semantic relation-guided contrastive learning module to capture additional supervision signals from both user intent view and item attribute view to guide the next-item prediction better. Then, we propose a novel intent-attribute disentangler to effectively mitigate the interference between user intent and latent item characteristics for further improving the recommendation performance. Extensive experiments on three real-world datasets demonstrate the significant superiority of SCL-SR over the state-of-the-art approaches, including achieving substantial improvements ranging from 7.10% to 12.82% on the Tmall dataset. Our source code and datasets are available at https://github.com/Nishikata97/SCL-SR .
Qian Zhang 0070, Shoujin Wang, Longbing Cao, Defu Lian, Haibo Zhang 0001, Wenpeng Lu
ACM Trans. Inf. Syst.2
2024 Structural Representation Learning and Disentanglement for Evidential Chinese Patent Approval Prediction
abstract
Automatic Chinese patent approval prediction is an emerging and valuable task in patent analysis. However, it involves a rigorous and transparent decision-making process that includes patent comparison and examination to assess its innovation and correctness. This resultant necessity of decision evidentiality, coupled with intricate patent comprehension presents significant challenges and obstacles for the patent analysis community. Consequently, few existing studies are addressing this task. This paper presents the pioneering effort on this task using a retrieval-based classification approach. We propose a novel framework called DiSPat, which focuses on structural representation learning and disentanglement to predict the approval of Chinese patents and offer decision-making evidence. DiSPat comprises three main components: base reference retrieval to retrieve the Top-k most similar patents as a reference base; structural patent representation to exploit the inherent claim hierarchy in patents for learning a structural patent representation; disentangled representation learning to learn disentangled patent representations that enable the establishment of an evidential decision-making process. To ensure a thorough evaluation, we have meticulously constructed three datasets of Chinese patents. Extensive experiments on these datasets unequivocally demonstrate our DiSPat surpasses state-of-the-art baselines on patent approval prediction, while also exhibiting enhanced evidentiality.
Jinzhi Shan, Qi Zhang 0020, Chongyang Shi 0001, Mengting Gui, Shoujin Wang, Usman Naseem
CIKM5
2024 Time-Series Representation Learning via Dual Reference Contrasting
abstract
The inherent complexity of real-world time series data, combined with the cost and infeasibility of manual labeling, presents considerable challenges to time series representation learning. Most existing studies tend to utilize data augmentation techniques to construct positive and negative samples and leverage a comparative learning framework to generate time series representations. However, they typically employ simple data augmentation techniques, such as jitter and cropping, to construct positive samples while randomly selecting irrelevant samples as negative ones, which are easily distinguished and unable to guide comparative learning to capture subtle discriminative features. Furthermore, they usually employ only a single positive sample for comparative learning, which is insufficient to model the diversity and hurts the robustness. To address these issues, this paper proposes a Time Series representation learning framework via Dual Reference Contrasting (TS-DRC). Specifically, we first utilize Markov transition field or Gramian angular field to transform the anchor sample of time series into image representations, which are adopted as positive samples. Then, we incorporate two positive samples (dual references) and one negative sample into the comparative learning framework, and devise a novel optimization objective to guide the model to capture more discriminate features, mitigate overfitting, and enhance the robustness. Extensive experiments conducted on four public real-world datasets demonstrate that our TS-DRC outperforms other state-of-the-art baselines.Our code is available at: https://github.com/yurui12138/TS-DRC.
Rui Yu 0005, Yongshun Gong, Shoujin Wang, Jiasheng Si, Xueping Peng, Wenpeng Lu
CIKM3
2024 Medical Entity Disambiguation with Medical Mention Relation and Fine-grained Entity Knowledge
abstract
Medical entity disambiguation (MED) plays a crucial role in natural language processing and biomedical domains, which is the task of mapping ambiguous medical mentions to structured candidate medical entities from knowledge bases (KBs). However, existing methods for MED often fail to fully utilize the knowledge within medical KBs and overlook essential interactions between medical mentions and candidate entities, resulting in knowledge- and interaction-inefficient modeling and suboptimal disambiguation performance. To address these limitations, this paper proposes a novel approach, MED with Medical Mention Relation and Fine-grained Entity Knowledge (MMR-FEK). Specifically, MMR-FEK incorporates a mention relation fusion module and an entity knowledge fusion module, followed by an interaction module. The former employs a relation graph convolutional network to fuse mention relation information between medical mentions to enhance mention representations, while the latter leverages an attention mechanism to fuse synonym and type information of candidate entities to enhance entity representations. Afterwards, an interaction module is designed to employ a bidirectional attention mechanism to capture interactions between mentions and entities to generate the matching representation. Extensive experiments on two publicly available real-world datasets demonstrate MMR-FEK’s superiority over state-of-the-art(SOTA) MED baselines across all metrics. Our source code is publicly available.
Wenpeng Lu, Guobiao Zhang, Xueping Peng, Hongjiao Guan, Shoujin Wang
LREC/COLING5
2024 Significance-aware Medication Recommendation with Medication Representation Learning
abstract
The goal of medication recommendation system is to recommend appropriate pharmaceutical interventions based on a patient’s diagnosis. Most of existing approaches often formulate these recommendations use data on diagnoses, procedures, and prescriptions accumulated in the electronic health records (EHR), and despite the great successes, they seem to have limitations on modelling the significance of medication to a patient’s current visit and mining fine-grained medication representation information. To address these issues, we propose a novel Significanceaware Medication Recommendation (SMRec) framework built on significance of medication to patients and fine-grained medication representation learning. Specifically, we first design a encoding mechanism to compute significance information of medications for each patient’s visit. Then, we utilize the set-level medication co-occurrence graph based on patients’ medical history which integrates temporal dependency to learn fine-grained medication representations. Experimental results on the publicly available MIMIC-III dataset demonstrate the superior effectiveness of our model compared to other approaches1.
Yishuo Li, Zhufeng Shao, Shoujin Wang, Yuehan Du, Wenpeng Lu
CSCWD4
2024 UPDATE: Mining User-News Engagement Patterns for Dual-Target Cross-Domain Fake News Detection
abstract
Transfer of knowledge across domains is the focus for cross-domain and multi-domain fake news detection. However, most of the existing methods based on cross-domain knowledge transfer have two issues: (1) they usually ignore domain-specific features; (2) they are less effective in handling the imbalanced data distribution across domains. Targeting these two issues, we focus on how to effectively leverage user-news engagements in both data-richer and data-sparser domains. This is because not only users' engagement characteristics closely relate to the veracity of the engaged news, but also there are consistent patterns in common users' engagements with news across domains. Considering these two insights, this work aims to perform dual-target cross-domain fake news detection via well modeling users' engagement patterns. In particular, it aims to transfer knowledge based on user-news engagements for handling the imbalanced data distribution across domains, which is novel but challenging. To this end, in this paper, we propose a novel framework to mine User-news engagement Patterns for DuAl-TargEt cross-domain fake news detection (UPDATE). In UPDATE, we first mine user-news engagement patterns as the key auxiliary information for cross-domain knowledge transfer. In such a way, it avoids the necessity to remove the domain-specific news information, and thereby, better preserve useful news information. Then, we combine engagement features of common users in both data-richer and data-sparser domains. By doing so, UPDATE improves the information richness in each of the two domains, thus improving detection performance in both domains when detecting news from domains with imbalanced data distribution. Extensive experiments conducted on real-world datasets demonstrate that UPDATE significantly outperforms state-of-the-art cross-domain and multi-domain methods as well as large language models (LLMs), such as GPT-3.5-turbo in terms of AUC and Fl-score for fake news detection.
Xuankai Yang 0001, Yan Wang 0002, Xiuzhen Zhang 0001, Shoujin Wang, Huaxiong Wang, Kwok-Yan Lam
DSAA4
2024 Filter-Enhanced Hypergraph Transformer for Multi-Behavior Sequential Recommendation
abstract
Sequential recommendation has been developed to predict the next item in which users are most interested by capturing user behavior patterns embedded in their historical interaction sequences. However, most existing methods appear to exhibit limitations in modeling fine-grained dependencies embedded in users’ various periodic behavior patterns and heterogeneous dependencies across multi-behaviors. Towards this end, we propose a Filter-enhanced Hypergraph Transformer framework for Multi-Behavior Sequential Recommendation (FHT-MB) to address the above challenges. Specifically, a multi-scale filter layer equipped with multi-learnable filters is devised to encode behavior-aware sequential patterns emerging from different periodic trends (e.g., daily or weekly routines), and then a hypergraph structure is devised to extract heterogeneous dependencies across users’ multiple types of behaviors. Extensive experiments on two real-world e-commerce datasets show the superiority of our proposed FHT-MB over various state-of-the-art methods.1
Zhufeng Shao, Shoujin Wang, Wenpeng Lu, Weiyu Zhang 0001, Hongjiao Guan, Long Zhao 0002
ICASSP2
2024 Fourier Graph Convolution Transformer for Financial Multivariate Time Series Forecasting
abstract
Financial Multivariate Time Series (Fin-MTS) forecasting is increasingly critical in the financial market. Unlike other Multivariate Time Series (MTS) data, Fin-MTS exhibits particular characteristics, including non-linearity, volatility, and hidden periodicities, which thus introduce great challenges for modelling it well. Existing state-of-the-art models for Fin-MTS forecasting often overlook hidden periodic characteristics, such as credit and monetary policy cycles. More importantly, these models usually show limited capability in well capturing the intra-series and inter-series dynamic information during the modelling process, resulting in significant information loss in quantitative finance modelling and thus limited forecasting performance. To this end, in this paper, we introduce a novel model called Fourier Graph Convolution Transformer (FreTransformer) for Fin-MTS modelling and forecasting. FreTransformer is not only able to well model both the intra- and inter-series dynamic dependencies, but also well capture the important hidden periodicities embedded in Fin-MTS data. FreTransformer first maps the original time domain data into the frequency domain to disclose the hidden periodicities and then employs a novel Fourier Graph Convolution Network to well capture the complex intra- and inter-series dependencies within Fin-MTS. Extensive experiments on real-world US market data across 12 phases demonstrate that our method outperforms current state-of-the-art models. Our source code is publicly available at this repository: https://github.com/AmsonntagChow/FreTransformer
Junxian Zhou, Shoujin Wang, Yuming Ou
IJCNN2
2024 A Hierarchical and Disentangling Interest Learning Framework for Unbiased and True News Recommendation
abstract
In the era of information explosion, news recommender systems are crucial for users to effectively and efficiently discover their interested news. However, most of the existing news recommender systems face two major issues, hampering recommendation quality. Firstly, they often oversimplify users' reading interests, neglecting their hierarchical nature, spanning from high-level event (e.g., US Election) related interests to low-level news article-specifc interests. Secondly, existing work often assumes a simplistic context, disregarding the prevalence of fake news and political bias under the real-world context. This oversight leads to recommendations of biased or fake news, posing risks to individuals and society. To this end, this paper addresses these gaps by introducing a novel framework, the Hierarchical and Disentangling Interest learning framework (HDInt). HDInt incorporates a hierarchical interest learning module and a disentangling interest learning module. The former captures users' high- and low-level interests, enhancing next-news recommendation accuracy. The latter effectively separates polarity and veracity information from news contents and model them more specifcally, promoting fairness- and truth-aware reading interest learning for unbiased and true news recommendations. Extensive experiments on two real-world datasets demonstrate HDInt's superiority over state-of-the-art news recommender systems in delivering accurate, unbiased, and true news recommendations.
Shoujin Wang, Xiuzhen Zhang 0001, Yan Wang 0002, Huan Liu 0001, Fang Chen 0001
KDD1
2024 NeuroClips: Towards High-fidelity and Smooth fMRI-to-Video Reconstruction
abstract
Reconstruction of static visual stimuli from non-invasion brain activity fMRI achieves great success, owning to advanced deep learning models such as CLIP and Stable Diffusion. However, the research on fMRI-to-video reconstruction remains limited since decoding the spatiotemporal perception of continuous visual experiences is formidably challenging. We contend that the key to addressing these challenges lies in accurately decoding both high-level semantics and low-level perception flows, as perceived by the brain in response to video stimuli. To the end, we propose NeuroClips, an innovative framework to decode high-fidelity and smooth video from fMRI. NeuroClips utilizes a semantics reconstructor to reconstruct video keyframes, guiding semantic accuracy and consistency, and employs a perception reconstructor to capture low-level perceptual details, ensuring video smoothness. During inference, it adopts a pre-trained T2V diffusion model injected with both keyframes and low-level perception flows for video reconstruction. Evaluated on a publicly available fMRI-video dataset, NeuroClips achieves smooth high-fidelity video reconstruction of up to 6s at 8FPS, gaining significant improvements over state-of-the-art models in various metrics, e.g., a 128% improvement in SSIM and an 81% improvement in spatiotemporal metrics. Our project is available at https://github.com/gongzix/NeuroClips.
Zixuan Gong, Guangyin Bao, Qi Zhang 0020, Zhongwei Wan, Duoqian Miao 0001, Shoujin Wang, Lei Zhu 0003, Changwei Wang 0001, Rongtao Xu, Liang Hu 0004, Yu Zhang 0133
NeurIPS6
2024 MSynFD: Multi-hop Syntax Aware Fake News Detection
abstract
The proliferation of social media platforms has fueled the rapid dissemination of fake news, posing threats to our real-life society. Existing methods use multimodal data or contextual information to enhance the detection of fake news by analyzing news content and/or its social context. However, these methods often overlook essential textual news content (articles) and heavily rely on sequential modeling and global attention to extract semantic information. These existing methods fail to handle the complex, subtle twists1 in news articles, such as syntax-semantics mismatches and prior biases, leading to lower performance and potential failure when modalities or social context are missing. To bridge these significant gaps, we propose a novel multi-hop syntax aware fake news detection (MSynFD) method, which incorporates complementary syntax information to deal with subtle twists in fake news. Specifically, we introduce a syntactical dependency graph and design a multi-hop subgraph aggregation mechanism to capture multi-hop syntax. It extends the effect of word perception, leading to effective noise filtering and adjacent relation enhancement. Subsequently, a sequential relative position-aware Transformer is designed to capture the sequential information, together with an elaborate keyword debiasing module to mitigate the prior bias. Extensive experimental results on two public benchmark datasets verify the effectiveness and superior performance of our proposed MSynFD over state-of-the-art detection models.
Liang Xiao 0010, Qi Zhang 0020, Chongyang Shi 0001, Shoujin Wang, Usman Naseem, Liang Hu 0004
WWW4
2024 Is Contrastive Learning Necessary? A Study of Data Augmentation vs Contrastive Learning in Sequential Recommendation
abstract
Sequential recommender systems (SRS) are designed to predict users' future behaviors based on their historical interaction data. Recent research has increasingly utilized contrastive learning (CL) to leverage unsupervised signals to alleviate the data sparsity issue in SRS. In general, CL-based SRS first augments the raw sequential interaction data by using data augmentation strategies and employs a contrastive training scheme to enforce the representations of those sequences from the same raw interaction data to be similar. Despite the growing popularity of CL, data augmentation, as a basic component of CL, has not received sufficient attention. This raises the question: Is it possible to achieve superior recommendation results solely through data augmentation? To answer this question, we benchmark eight widely used data augmentation strategies, as well as state-of-the-art CL-based SRS methods, on four real-world datasets under both warm- and cold-start settings. Intriguingly, the conclusion drawn from our study is that, certain data augmentation strategies can achieve similar or even superior performance compared with some CL-based methods, demonstrating the potential to significantly alleviate the data sparsity issue with fewer computational overhead. We hope that our study can further inspire more fundamental studies on the key functional components of complex CL techniques. Our processed datasets and codes are available at https://github.com/AIM-SE/DA4Rec.
Peilin Zhou, You-Liang Huang, Yueqi Xie, Jingqi Gao, Shoujin Wang, Jae Boum Kim, Sunghun Kim 0001
WWW5
2024 Graph learning with label attention and hyperbolic embedding for temporal event prediction in healthcare
abstract
The digitization of healthcare systems has led to the proliferation of electronic health records (EHRs), serving as comprehensive repositories of patient information. However, the vast volume and complexity of EHR data present challenges in extracting meaningful insights. This paper addresses the need for automated analysis of EHRs by proposing a novel graph learning model with label attention (GLLA) for temporal event prediction. GLLA utilizes graph neural networks to capture intricate relationships between medical codes and patients, incorporating hierarchical structures and shared risk factors. Furthermore, it introduces the Label Attention and Attention-based Transformer (LAAT) algorithm to analyze unstructured clinical notes as a multi-label classification problem. Evaluation on the widely-used MIMIC III dataset demonstrates the efficacy of GLLA in enhancing diagnostic prediction performance. The contributions of this research include a comprehensive analysis of existing models, the identification of limitations, and the development of innovative approaches to improve the accuracy and effectiveness of EHR analysis. Ultimately, GLLA aims to advance healthcare decision-making, disease management strategies, and patient outcomes.
Usman Naseem, Surendrabikram Thapa, Qi Zhang 0020, Shoujin Wang, Junaid Rashid, Liang Hu 0004, Amir Hussain 0001
Neurocomputing4
2024 Medical Question Summarization with Entity-driven Contrastive Learning
abstract
By summarizing longer consumer health questions into shorter and essential ones, medical question-answering systems can more accurately understand consumer intentions and retrieve suitable answers. However, medical question summarization is very challenging due to obvious distinctions in health trouble descriptions from patients and doctors. Although deep learning has been applied to successfully address the medical question summarization (MQS) task, two challenges remain: how to correctly capture question focus to model its semantic intention, and how to obtain reliable datasets to fairly evaluate performance. To address these challenges, this article proposes a novel medical question summarization framework based on e ntity-driven c ontrastive l earning (ECL). ECL employs medical entities present in frequently asked questions (FAQs) as focuses and devises an effective mechanism to generate hard negative samples. This approach compels models to focus on essential information and consequently generate more accurate question summaries. Furthermore, we have discovered that some MQS datasets, such as the iCliniq dataset with a 33% duplicate rate, have significant data leakage issues. To ensure an impartial evaluation of the related methods, this article carefully examines leaked samples to reorganize more reasonable datasets. Extensive experiments demonstrate that our ECL method outperforms the existing methods and achieves new state-of-the-art performance, i.e., 52.85, 43.16, 41.31, 43.52 in terms of ROUGE-1 metric on MeQSum, CHQ-Summ, iCliniq, HealthCareMagic dataset, respectively. The code and datasets are available at https://github.com/yrbobo/MQS-ECL
Wenpeng Lu, Sibo Wei, Xueping Peng, Usman Naseem, Shoujin Wang
ACM Trans. Asian Low Resour. Lang. Inf. Process.6
2024 Fuzzy Federated Learning for Privacy-Preserving Detection of Adolescent Idiopathic Scoliosis
abstract
As a distributed intelligent paradigm, fuzzy federated learning (FuzzyFL) can reduce the uncertainty and noise of biomedical data and is suited to enhance the accurate detection of adolescent idiopathic scoliosis (AIS). The advanced paradigm requires the hospitals to share the gradient of the fuzzy deep neural network (FDNN) rather than biomedical data. Not only that, the recent research works have been devoted to privacy-preserving FuzzyFL for secure AIS detection that adds differential privacy-based noise to the gradients against membership inference attack, attribute inference attack. However, a novel reconstruction attack called gradient leakage attack (GLA) on inferring biomedical data over the gradient brings the security challenges to FuzzyFL and, thus, has a negative influence on AIS detection. It is natural to ask a fundamental question: Can differentially private FuzzyFL for AIS detection over biomedical data defend GLA? In this article, we construct a privacy-preserving FuzzyFL framework calledPrivateFuzzyFLthat offers a great opportunity to present the systematic evaluation of the private FDNN threatened by the GLAs. In our experiments on a set of chest X-ray images and four FDNNs, we compare more than ten private fuzzy federated optimization algorithms in terms of the defense effect and the utility cost and derive that, first, the existing private FDNNs in FuzzyFL can offer a certain amount of privacy protection for biomedical data against the GLA; and second, the perturbation algorithm with better defense effect usually causes the worse AIS detection of the FDNN.
Xiaotong Wu, Xiaokang Zhou, Yanwei Xu 0003, Shoujin Wang, Xiaolong Xu 0001, Lianyong Qi
IEEE Trans. Fuzzy Syst.5
2024 Trustworthy Recommender Systems
abstract
Recommender systems (RSs) aim at helping users to effectively retrieve items of their interests from a large catalogue. For a quite long time, researchers and practitioners have been focusing on developing accurate RSs. Recent years have witnessed an increasing number of threats to RSs, coming from attacks, system and user generated noise, and various types of biases. As a result, it has become clear that the focus on RS accuracy is too narrow, and the research must consider other important factors, particularly trustworthiness. A trustworthy recommender system (TRS) should not only be accurate but also transparent, unbiased, fair, and robust to noise and attacks. These observations actually led to a paradigm shift of the research on RSs: from accuracy-oriented RSs to TRSs. However, there is a lack of a systematic overview and discussion of the literature in this novel and fast-developing field of TRSs. To this end, in this article, we provide an overview of TRSs, including a discussion of the motivation and basic concepts of TRSs, a presentation of the challenges in building TRSs, and a perspective on the future directions in this area. We also provide a novel conceptual framework to support the construction of TRSs.
Shoujin Wang, Xiuzhen Zhang 0001, Yan Wang 0002, Francesco Ricci 0001
ACM Trans. Intell. Syst. Technol.1
2024 Learning Informative Representation for Fairness-Aware Multivariate Time-Series Forecasting: A Group-Based Perspective
abstract
Multivariate time series (MTS) forecasting penetrates various aspects of our economy and society, whose roles become increasingly recognized. However, often MTS forecasting is unfair, not only degrading their practical benefits but even incurring potential risk. Unfair MTS forecasting may be attributed to disparities relating to advantaged and disadvantaged variables, which has rarely been studied in the MTS forecasting. In this work, we formulate the MTS fairness modeling problem as learning informative representations attending to both advantaged and disadvantaged variables. Accordingly, we propose a novel framework, namedFairFor, for fairness-aware MTS forecasting, i.e.,fair MTS forecasting.FairForuses adversarial learning to generate both group-irrelevant and -relevant representations for downstream forecasting.FairForfirst adopts recurrent graph convolution to capture spatio-temporal variable correlations and to group variables by leveraging a spectral relaxation of the K-means objective. Then, it utilizes a novel filtering$\&$fusion module to filter group-relevant information and generate group-irrelevant representations by orthogonality regularization. The group-irrelevant and -relevant representations form highly informative representations, facilitating to share the knowledge from advantaged variables to disadvantaged variables and guarantee the fairness of forecasting. Extensive experiments on four public datasets demonstrate theFairForeffectiveness for fair forecasting and significant performance improvement.
Qi Zhang 0020, Shoujin Wang, Kun Yi 0001, Zhendong Niu, Longbing Cao
IEEE Trans. Knowl. Data Eng.3
2024 Rumor Detection With Hierarchical Representation on Bipartite Ad Hoc Event Trees
abstract
The rapid growth of social media has caused tremendous effects on information propagation, raising extreme challenges in detecting rumors. Existing rumor detection methods typically exploit the reposting propagation of a rumor candidate for detection by regarding all reposts to a rumor candidate as a temporal sequence and learning semantics representations of the repost sequence. However, extracting informative support from the topological structure of propagation and the influence of reposting authors for debunking rumors is crucial, which generally has not been well addressed by existing methods. In this article, we organize a claim post in circulation as an ad hoc event tree, extract event elements, and convert it into bipartite ad hoc event trees in terms of both posts and authors, i.e., author tree and post tree. Accordingly, we propose a novel rumor detection model with hierarchical representation on the bipartite ad hoc event trees called BAET. Specifically, we introduce word embedding and feature encoder for the author and post tree, respectively, and design a root-aware attention module to perform node representation. Then we adopt the tree-like RNN model to capture the structural correlations and propose a tree-aware attention module to learn tree representation for the author tree and post tree, respectively. Extensive experimental results on two public Twitter datasets demonstrate the effectiveness of BAET in exploring and exploiting the rumor propagation structure and the superior detection performance of BAET over state-of-the-art baseline methods.
Qi Zhang 0020, Yayi Yang, Chongyang Shi 0001, An Lao, Liang Hu 0008, Shoujin Wang, Usman Naseem
IEEE Trans. Neural Networks Learn. Syst.6
2024 A Blockchain-enabled decentralized settlement model for IoT data exchange services
Wenmin Lin, Shoujin Wang, Mohammad Reza Khosravi
Wirel. Networks3
2023 Attention Calibration for Transformer-based Sequential Recommendation
abstract
Transformer-based sequential recommendation (SR) has been booming in recent years, with the self-attention mechanism as its key component. Self-attention has been widely believed to be able to effectively select those informative and relevant items from a sequence of interacted items for next-item prediction via learning larger attention weights for these items. However, this may not always be true in reality. Our empirical analysis of some representative Transformer-based SR models reveals that it is not uncommon for large attention weights to be assigned to less relevant items, which can result in inaccurate recommendations. Through further in-depth analysis, we find two factors that may contribute to such inaccurate assignment of attention weights:sub-optimal position encoding andnoisy input. To this end, in this paper, we aim to address this significant yet challenging gap in existing works. To be specific, we propose a simple yet effective framework called Attention Calibration for Transformer-based Sequential Recommendation (AC-TSR). In AC-TSR, a novel spatial calibrator and adversarial calibrator are designed respectively to directly calibrates those incorrectly assigned attention weights. The former is devised to explicitly capture the spatial relationships (i.e., order and distance) among items for more precise calculation of attention weights. The latter aims to redistribute the attention weights based on each item's contribution to the next-item prediction. AC-TSR is readily adaptable and can be seamlessly integrated into various existing transformer-based SR models. Extensive experimental results on four benchmark real-world datasets demonstrate the superiority of our proposed AC-TSR via significant recommendation performance enhancements. The source code is available at https://github.com/AIM-SE/AC-TSR.
Peilin Zhou, Qichen Ye, Yueqi Xie, Jingqi Gao, Shoujin Wang, Jae Boum Kim, Chenyu You, Sunghun Kim 0001
CIKM5
2023 Intention-Aware User Modeling for Personalized News Recommendation
Rongyao Wang, Shoujin Wang, Wenpeng Lu, Xueping Peng, Weiyu Zhang 0001, Chaoqun Zheng, Xinxiao Qiao
DASFAA (2)2
2023 Session-based Interactive Recommendation via Deep Reinforcement Learning
abstract
Deep reinforcement learning (DRL), has shown promise in solving intractable challenges in interactive recommendation systems. In DRL-based interactive recommendation, state modeling is crucial for well-capturing users’ continuous interaction behaviors with shopping systems. A user’s multiple continuous interactions in a given time period (e.g., the time from login to log out) naturally constitute a session. However, existing studies often overlook such valuable session structure and characteristics and instead simply treat them as sequences. As a result, they are not able to capture the complex transitions over users’ interactions within or between sessions, leading to significant information loss. To bridge this significant gap, in this paper, we propose Session-based Interactive Recommendation with Graph Neural Networks (SIR-GNN). SIR-GNN models interaction data as sessions and employs novel graph neural networks to capture rich transition patterns among interactions. Specifically, a novel 3-level transition module is well designed to effectively capture common patterns from all sessions, intra-session transitions, and adjacent-item transitions respectively, followed by an attention-based gated graph neural network to model the state representation for SIR well. Extensive experiments on 3 real-world benchmark datasets demonstrate the superiority of SIR-GNN over state-of-the-art baselines and the rationality of our design in SIR-GNN.
Longxiang Shi, Shoujin Wang, Qi Zhang 0020, Shijian Li
ICDM3
2023 All You See Is the Tip of the Iceberg: Distilling Latent Interactions Can Help You Find Treasures
Zhuo Cai 0002, Guan Yuan, Xiaobao Zhuang, Rui Bing, Shoujin Wang
ICONIP (14)6
2023 Frequency-domain MLPs are More Effective Learners in Time Series Forecasting
abstract
Time series forecasting has played the key role in different industrial, including finance, traffic, energy, and healthcare domains. While existing literatures have designed many sophisticated architectures based on RNNs, GNNs, or Transformers, another kind of approaches based on multi-layer perceptrons (MLPs) are proposed with simple structure, low complexity, and superior performance. However, most MLP-based forecasting methods suffer from the point-wise mappings and information bottleneck, which largely hinders the forecasting performance. To overcome this problem, we explore a novel direction of applying MLPs in the frequency domain for time series forecasting. We investigate the learned patterns of frequency-domain MLPs and discover their two inherent characteristic benefiting forecasting, (i) global view: frequency spectrum makes MLPs own a complete view for signals and learn global dependencies more easily, and (ii) energy compaction: frequency-domain MLPs concentrate on smaller key part of frequency components with compact signal energy. Then, we propose FreTS, a simple yet effective architecture built upon Frequency-domain MLPs for Time Series forecasting. FreTS mainly involves two stages, (i) Domain Conversion, that transforms time-domain signals into complex numbers of frequency domain; (ii) Frequency Learning, that performs our redesigned MLPs for the learning of real and imaginary part of frequency components. The above stages operated on both inter-series and intra-series scales further contribute to channel-wise and time-wise dependency learning. Extensive experiments on 13 real-world benchmarks (including 7 benchmarks for short-term forecasting and 6 benchmarks for long-term forecasting) demonstrate our consistent superiority over state-of-the-art methods. Code is available at this repository: https://github.com/aikunyi/FreTS.
Kun Yi 0001, Qi Zhang 0020, Wei Fan 0010, Shoujin Wang, Pengyang Wang, Ning An 0001, Defu Lian, Longbing Cao, Zhendong Niu
NeurIPS4
2023 News Recommendation via Jointly Modeling Event Matching and Style Matching
Shoujin Wang, Wenpeng Lu, Xueping Peng, Weiyu Zhang 0001, Chaoqun Zheng, Yonggang Huang 0001
ECML/PKDD (4)2
2023 Equivariant Contrastive Learning for Sequential Recommendation
abstract
Contrastive learning (CL) benefits the training of sequential recommendation models with informative self-supervision signals. Existing solutions apply general sequential data augmentation strategies to generate positive pairs and encourage their representations to be invariant. However, due to the inherent properties of user behavior sequences, some augmentation strategies, such as item substitution, can lead to changes in user intent. Learning indiscriminately invariant representations for all augmentation strategies might be sub-optimal. Therefore, we propose Equivariant Contrastive Learning for Sequential Recommendation (ECL-SR), which endows SR models with great discriminative power, making the learned user behavior representations sensitive to invasive augmentations (e.g., item substitution) and insensitive to mild augmentations (e.g., feature-level dropout masking). In detail, we use the conditional discriminator to capture differences in behavior due to item substitution, which encourages the user behavior encoder to be equivariant to invasive augmentations. Comprehensive experiments on four benchmark datasets show that the proposed ECL-SR framework achieves competitive performance compared to state-of-the-art SR models. The source code is available at https://github.com/Tokkiu/ECL.
Peilin Zhou, Jingqi Gao, Yueqi Xie, Qichen Ye, Yining Hua, Jae Boum Kim, Shoujin Wang, Sunghun Kim 0001
RecSys7
2023 Dual Contrastive Transformer for Hierarchical Preference Modeling in Sequential Recommendation
abstract
Sequential recommender systems (SRSs) aim to predict the subsequent items which may interest users via comprehensively modeling users' complex preference embedded in the sequence of user-item interactions. However, most of existing SRSs often model users' single low-level preference based on item ID information while ignoring the high-level preference revealed by item attribute information, such as item category. Furthermore, they often utilize limited sequence context information to predict the next item while overlooking richer inter-item semantic relations. To this end, in this paper, we proposed a novel hierarchical preference modeling framework to substantially model the complex low- and high-level preference dynamics for accurate sequential recommendation. Specifically, in the framework, a novel dual-transformer module and a novel dual contrastive learning scheme have been designed to discriminatively learn users' low- and high-level preference and to effectively enhance both low- and high-level preference learning respectively. In addition, a novel semantics-enhanced context embedding module has been devised to generate more informative context embedding for further improving the recommendation performance. Extensive experiments on six real-world datasets have demonstrated both the superiority of our proposed method over the state-of-the-art ones and the rationality of our design.
Chengkai Huang, Shoujin Wang, Xianzhi Wang 0001, Lina Yao 0001
SIGIR2
2023 WSDM 2023 Workshop on Interactive Recommender Systems
abstract
Interactive recommender systems have attracted increasingly research attentions from both academia and industry. This workshop is a half-day event, which provides a forum for researchers and practitioners to discuss recent research progress and novel research directions about interactive recommender systems. The program will include two keynotes and 6 to 8 research paper presentations. The objective of this workshop is to consolidate the recent technical progresses about interactive recommendation, which will be a promising research and development direction for future recommendation technologies. This workshop will attract the attention of researchers from both academia and industry. It aligns with WSDM's spirit of promoting the collaborations between academia and industry.
Yong Liu 0020, Hao Zhang 0048, Zhu Sun 0001, Shoujin Wang, Jie Zhang 0002
WSDM4
2023 Modeling Temporal Positive and Negative Excitation for Sequential Recommendation
abstract
Sequential recommendation aims to predict the next item which interests users via modeling their interest in items over time. Most of the existing works on sequential recommendation model users’ dynamic interest in specific items while overlooking users’ static interest revealed by some static attribute information of items, e.g., category, brand. Moreover, existing works often only consider the positive excitation of a user’s historical interactions on his/her next choice on candidate items while ignoring the commonly existing negative excitation, resulting in insufficiently modeling dynamic interest. The overlook of static interest and negative excitation will lead to incomplete interest modeling and thus impedes the recommendation performance. To this end, in this paper, we propose modeling both static interest and negative excitation for dynamic interest to further improve the recommendation performance. Accordingly, we design a novel Static-Dynamic Interest Learning (SDIL) framework featured with a novel Temporal Positive and Negative Excitation Modeling (TPNE) module for accurate sequential recommendation. TPNE is specially designed for comprehensively modeling dynamic interest based on temporal positive and negative excitation learning. Extensive experiments on three real-world datasets show that SDIL can effectively capture both static and dynamic interest and outperforms state-of-the-art baselines.
Chengkai Huang, Shoujin Wang, Xianzhi Wang 0001, Lina Yao 0001
WWW2
2023 A Counterfactual Collaborative Session-based Recommender System
abstract
Most session-based recommender systems (SBRSs) focus on extracting information from the observed items in the current session of a user to predict a next item, ignoring the causes outside the session (called outer-session causes, OSCs) that influence the user’s selection of items. However, these causes widely exist in the real world, and few studies have investigated their role in SBRSs. In this work, we analyze the causalities and correlations of the OSCs in SBRSs from the perspective of causal inference. We find that the OSCs are essentially the confounders in SBRSs, which leads to spurious correlations in the data used to train SBRS models. To address this problem, we propose a novel SBRS framework named COCO-SBRS (COunterfactual COllaborative Session-Based Recommender Systems) to learn the causality between OSCs and user-item interactions in SBRSs. COCO-SBRS first adopts a self-supervised approach to pre-train a recommendation model by designing pseudo-labels of causes for each user’s selection of the item in data to guide the training process. Next, COCO-SBRS adopts counterfactual inference to recommend items based on the outputs of the pre-trained recommendation model considering the causalities to alleviate the data sparsity problem. As a result, COCO-SBRS can learn the causalities in data, preventing the model from learning spurious correlations. The experimental results of our extensive experiments conducted on three real-world datasets demonstrate the superiority of our proposed framework over ten representative SBRSs.
Wenzhuo Song, Shoujin Wang, Yan Wang 0002, Kunpeng Liu 0001, Xueyan Liu 0001, Minghao Yin
WWW2
2023 Cluster-aware attentive convolutional recurrent network for multivariate time-series forecasting
abstract
Multivariate time-series (MTS) forecasting plays a crucial role in various real-world applications, but the complex dependencies between time-series variables (i.e., inter-series dependencies) make this task extremely challenging. While most existing studies focus on modeling intra-series (temporal) dependencies by capturing long- and short-term patterns, they fail to explore and exploit the inter-series dependencies to enhance MTS forecasting. In this paper, we propose a Cluster-aware Attentive Convolutional Recurrent Network (CACRN) to capture both inter-series and intra-series dependencies in MTS data. Specifically, CACRN first introduces a cluster-aware variable representation module that separates irrelevant variables and captures the interaction between relevant variables to learn cluster-aware variable representations. Then, CACRN feeds these representations into parallel convolutional recurrent neural networks (CRNNs) to capture the short- and long-term temporal dependencies in a cluster-wise manner. Next, a cluster-aware attention mechanism is introduced to attend to temporal information in each cluster and co-attend all cluster information jointly to capture intra-cluster and inter-cluster dependencies for the downstream forecasting task. Our extensive experiments on six real-world datasets demonstrate that CACRN is effective and outperforms representative and state-of-the-art baselines. Our proposed method is suitable for a wide range of real-world data collections, especially those with clear dependencies of variables.
Simeng Bai, Qi Zhang 0020, Liang Hu 0004, Shoujin Wang, Zhendong Niu
Neurocomputing5
2023 MbSRS: A multi-behavior streaming recommender system
abstract
Streaming Recommender Systems (SRSs) have emerged to deliver recommendations based on pervasive data streams, which are a sequence of user-item interactions with multiple behavior types (e.g., purchase, add-to-cart, and view). However, existing SRSs all rely on a single behavior type (e.g., purchase) to make streaming recommendations, and commonly suffer from the data sparsity problem. To address this issue, the relatively more abundant multi-behavior interactions (i.e., interactions with multiple behavior types) could be well leveraged for more accurate streaming recommendations. However, it remains a challenge on how to effectively leverage the commonly-existing and complex multi-behavior interactions for improving the accuracy of streaming recommendations. Targeting at this challenge, we propose the first Multi-behavior Streaming Recommender System in the literature, called MbSRS, to elaborately exploit multi-behavior interactions for delivering accurate recommendations in streaming scenarios. In MbSRS, we first learn instant user preferences and unified item characteristics collaboratively from multi-behavior interactions. Then, we attentively learn long-term user preferences from the historical items interacted by the corresponding users. After that, we wisely fuse the learned instant and long-term user preferences via a gate mechanism. Finally, a novel multi-behavior-specific training process is devised for more effectively learning user preferences towards items from multi-behavior interactions. Extensive experiments on three real-world datasets demonstrate that the proposed MbSRS significantly outperforms the state-of-the-art baselines.
Shoujin Wang, Yan Wang 0002, Hongwei Liu 0002
Inf. Sci.2
2023 Beyond CNNs: Exploiting Further Inherent Symmetries in Medical Image Segmentation
abstract
Automatic tumor or lesion segmentation is a crucial step in medical image analysis for computer-aided diagnosis. Although the existing methods based on convolutional neural networks (CNNs) have achieved the state-of-the-art performance, many challenges still remain in medical tumor segmentation. This is because, although the human visual system can detect symmetries in 2-D images effectively, regular CNNs can only exploit translation invariance, overlooking further inherent symmetries existing in medical images, such as rotations and reflections. To solve this problem, we propose a novel group equivariant segmentation framework by encoding those inherent symmetries for learning more precise representations. First, kernel-based equivariant operations are devised on each orientation, which allows it to effectively address the gaps of learning symmetries in existing approaches. Then, to keep segmentation networks globally equivariant, we design distinctive group layers with layer-wise symmetry constraints. Finally, based on our novel framework, extensive experiments conducted on real-world clinical data demonstrate that a group equivariant Res-UNet (called GER-UNet) outperforms its regular CNN-based counterpart and the state-of-the-art segmentation methods in the tasks of hepatic tumor segmentation, COVID-19 lung infection segmentation, and retinal vessel detection. More importantly, the newly built GER-UNet also shows potential in reducing the sample complexity and the redundancy of filters, upgrading current segmentation CNNs, and delineating organs on other medical imaging modalities.
Shuchao Pang, Anan Du, Mehmet A. Orgun, Yan Wang 0002, Quan Z. Sheng, Shoujin Wang, Xiaoshui Huang, Zhenmei Yu
IEEE Trans. Cybern.6
2023 Modality Coupling for Privacy Image Classification
abstract
Privacy image classification (PIC) has attracted increasing attention as it can help people make appropriate privacy decisions when sharing images. Most recently, some pioneer research efforts have been made to utilize multimodal information for PIC, since multi-modality can provide richer information than single modality. Those research efforts on multimodal PIC are under the assumption of independently identically distribution. However, connections between different modalities commonly exist in real-world cases. Taking the modalities of scene and object as example, in the scene of ’library/indoor’, the object ’book jacket’ resides with high probabilities. To this end, in this paper, a novel PIC approach, called CoupledPIC, is proposed to bridge this gap by comprehensively capturing the coupling relations between different modalities. In CoupledPIC, two submodules are designed to capture explicit and implicit coupling relations between different modalities respectively. The explicit modality coupling is learned with a tensor fusion networks based submodule, via the direct interaction of features. For the implicit modality coupling, a graph convolutional networks based submodule is proposed to learn on both the initial graphs and attention guided graphs, via information aggregation on graphs. Extensive experiments on the public benchmark, PicAlert, demonstrate the effectiveness of the proposed CoupledPIC, yielding significant improvement by modeling inter-modality coupling information.
Yonggang Huang 0001, Shoujin Wang, Wenpeng Lu, Huiyan Wu
IEEE Trans. Inf. Forensics Secur.3
2023 Modeling User Demand Evolution for Next-Basket Prediction
abstract
Users’ purchase behaviors are complex and dynamic, which are usually driven by various personal demands evolving with time. According to psychology and economic theories, user demands can be satisfied with a sequence of purchase behaviors, resulting in a basket of items. However, most of the existing works simply predict the next basket from a shallow perspective of (purchase) sequence data modeling without deep insight into the underlying factors which drive user purchase behaviors. In fact, filling a basket with multiple items is a process to incrementally satisfy a user's demand. Therefore, the key challenges to predict a user's next basket lie in (1) how to track the changes of the user's demand, and (2) how to satisfy her demand at a given moment. To this end, we propose an Evolving DEmand SAtisfaction (EvoDESA) model to model a user's demand evolution for next-basket prediction. In EvoDESA, a demand evolution module learns the dynamics of user demand over a sequence of basket-purchase behaviors. Then, a next-basket planning module effectively packs an optimal combination of items to best satisfy the user's current demand. Extensive experiments on three real-world transaction datasets demonstrate the considerable superiority of EvoDESA over the state-of-the-art approaches.
Shoujin Wang, Yan Wang 0002, Liang Hu 0004, Xiuzhen Zhang 0001, Qi Zhang 0020, Quan Z. Sheng, Mehmet A. Orgun, Longbing Cao, Defu Lian
IEEE Trans. Knowl. Data Eng.1
2022 Word Sense Disambiguation with Knowledge-Enhanced and Local Self-Attention-based Extractive Sense Comprehension
abstract
Word sense disambiguation (WSD), identifying the most suitable meaning of ambiguous words in the given contexts according to a predefined sense inventory, is one of the most classical and challenging tasks in natural language processing. Benefiting from the powerful ability of deep neural networks, WSD has achieved a great advancement in recent years. Reformulating WSD as a text span extraction task is an effective approach, which accepts a sentence context of an ambiguous word together with all definitions of its candidate senses simultaneously, and requires to extract the text span corresponding with the right sense. However, the approach merely depends on a short definition to learn sense representation, which neglects abundant semantic knowledge from related senses and leads to data-inefficient learning and suboptimal WSD performance. To address the limitations, we propose a novel WSD method with Knowledge-Enhanced and Local Self-Attention-based Extractive Sense Comprehension (KELESC). Specifically, a knowledge-enhanced method is proposed to enrich semantic representation by incorporating additional examples and definitions of the related senses in WordNet. Then, in order to avoid the huge computing complexity induced by the additional information, a local self-attention mechanism is utilized to constrain attention to be local, which allows longer input texts without large-scale computing burdens. Extensive experimental results demonstrate that KELESC achieves better performance than baseline models on public benchmark datasets.
Guobiao Zhang, Wenpeng Lu, Xueping Peng, Shoujin Wang, Baoshuo Kan, Rui Yu 0005
COLING4
2022 A Systematical Evaluation for Next-Basket Recommendation Algorithms
abstract
Next basket recommender systems (NBRs) aim to recommend a user’s next (shopping) basket of items via modeling the user’s preferences towards items based on the user’s purchase history, usually a sequence of historical baskets. Due to its wide applicability in the real-world E-commerce industry, the studies NBR have attracted increasing attention in recent years. NBRs have been widely studied and much progress has been achieved in this area with a variety of NBR approaches having been proposed. However, an important issue is that there is a lack of a systematic and unified evaluation over the various NBR approaches. Different studies often evaluate NBR approaches on different datasets, under different experimental settings, making it hard to fairly and effectively compare the performance of different NBR approaches. To bridge this gap, in this work, we conduct a systematical empirical study in NBR area. Specifically, we review the representative work in NBR and analyze their cons and pros. Then, we run the selected NBR algorithms on the same datasets, under the same experimental setting and evaluate their performances using the same measurements. This provides a unified framework to fairly compare different NBR approaches. We hope this study can provide a valuable reference for the future research in this vibrant area.
Zhufeng Shao, Shoujin Wang, Qian Zhang 0070, Wenpeng Lu, Xueping Peng
DSAA2
2022 News Recommendation Via Multi-Interest News Sequence Modelling
abstract
A session-based news recommender system recommends the next news to a user by modeling the potential interests embedded in a sequence of news read/clicked by her/him in a session. Generally, a user’s interests are diverse, namely there are multiple interests corresponding to different types of news, e.g., news of distinct topics, within a session. However, most of existing methods typically overlook such important characteristic and thus fail to distinguish and model the potential multiple interests of a user, impeding accurate recommendation of the next piece of news. Therefore, this paper proposes multi-interest news sequence (MINS) model for news recommendation. In MINS, a news encoder based on self-attention is devised on learn an informative embedding for each piece of news, and then a novel parallel interest network is devised to extract the potential multiple interests embedded in the news sequence in preparation for the subsequent next-news recommendations. The experimental results on a real-world dataset demonstrate that our model can achieve better performance than the state-of-the-art compared models. Our source code is publicly available on GitHub1.
Rongyao Wang, Shoujin Wang, Wenpeng Lu, Xueping Peng
ICASSP2
2022 A Probabilistic Code Balance Constraint with Compactness and Informativeness Enhancement for Deep Supervised Hashing
abstract
Building on deep representation learning, deep supervised hashing has achieved promising performance in tasks like similarity retrieval. However, conventional code balance constraints (i.e., bit balance and bit uncorrelation) imposed on avoiding overfitting and improving hash code quality are unsuitable for deep supervised hashing owing to their inefficiency and impracticality of simultaneously learning deep data representations and hash functions. To address this issue, we propose probabilistic code balance constraints on deep supervised hashing to force each hash code to conform to a discrete uniform distribution. Accordingly, a Wasserstein regularizer aligns the distribution of generated hash codes to a uniform distribution. Theoretical analyses reveal that the proposed constraints form a general deep hashing framework for both bit balance and bit uncorrelation and maximizing the mutual information between data input and their corresponding hash codes. Extensive empirical analyses on two benchmark datasets further demonstrate the enhancement of compactness and informativeness of hash codes for deep supervised hash to improve retrieval performance (code available at: https://github.com/mumuxi/dshwr).
Qi Zhang 0020, Liang Hu 0004, Longbing Cao, Chongyang Shi 0001, Shoujin Wang, Dora D. Liu
IJCAI5
2022 Modeling Spatio-temporal Neighbourhood for Personalized Point-of-interest Recommendation
abstract
Point-of-interest (POI) recommendations can help users explore attractive locations, which is playing an important role in location-based social networks (LBSNs). In POI recommendations, the results are largely impacted by users' preferences. However, the existing POI methods model user and location almost separately, which cannot capture users' personal and dynamic preferences to location. In addition, they also ignore users' acceptance to distance/time of location. To overcome the limitations of the existing methods, we first introduce Knowledge Graph with temporal information (known as TKG) into POI recommendation, including both user and location with timestamps. Then, based on TKG, we propose a Spatial-Temporal Graph Convolutional Attention Network (STGCAN), a novel network that learns users' preferences on TKG by dynamically capturing the spatial-temporal neighbourhoods. Specifically, in STGCAN, we construct receptive fields on TKG to aggregate neighbourhoods of user and location respectively at each timestamp. And we measure the spatial-temporal interval as users' acceptance to distance/time with self-attention. Experiments on three real-world datasets demonstrate that the proposed model outperforms the state-of-the-art POI recommendation approaches.
Guohao Sun 0001, Xiu Susie Fang, Jian Yang 0001, Shoujin Wang
IJCAI5
2022 Chinese Sentence Matching with Multiple Alignments and Feature Augmentation
abstract
Chinese sentence matching is a critical and yet challenging task in natural language processing. Recent work on modeling sentence semantic relations with deep neural models has shown its great potential in improving the performance of sentence matching. However, existing sentence matching methods usually focus on generating word-level sentence representation, which neglects the character-level information and leads to weak semantic representations. Also, they usually capture the interactive features with an attention-based alignment, which are typically implemented on sentence level and neglect the interactions among characters, words and sentences. This paper proposes a novel Chinese sentence matching model with Multiple Alignments and Feature Augmentation (MAFA). Specifically, the model first employs the multi-level embedding layer to accept the character and word sequences of sentences, and introduces the multiple alignment layer to capture the interactions among characters, words and sentences in turn. Then, the feature augmentation layer is applied to combine the interactive features to generate the final semantic matching representations. Finally, the prediction layer is utilized to judge the matching degree of the input sentences. Substantial and extensive experiments are conducted on two real-world data sets to show that MAFA significantly outperforms the competing methods and achieve comnarable nerformance with BERT-based methods.
Youhui Zuo, Xueping Peng, Wenpeng Lu, Shoujin Wang, Weiyu Zhang 0001, Yi Zhai 0003
IJCNN4
2022 Data Science and Artificial Intelligence for Responsible Recommendations
abstract
With the advancement of data science and AI, more and more powerful and accurate recommender systems (RSs) have been developed. They provide recommendation services in various areas, including shopping, eating, travelling and entertainment. RSs have achieved a great success and benefted the society. However, most of the research on RS has focused on the improvement of the recommendation accuracy, while ignoring other important qualities, such as trustworthiness (robustness, fairness, explainability, privacy and security) and social impact (influence on users' recognition and behaviours) of the recommendations. These are important aspects and cannot be overlooked since they measure properties that determine whether the recommendation service is reliable, trustworthy and benefcial to individual users and society. In this work, responsible recommendations refer to trustworthy recommendation techniques and positive-social-impact recommendation results.
Shoujin Wang, Ninghao Liu 0001, Xiuzhen Zhang 0001, Yan Wang 0002, Francesco Ricci 0001, Bamshad Mobasher
KDD1
2022 Word Sense Disambiguation Based on Memory Enhancement Mechanism
Baoshuo Kan, Wenpeng Lu, Xueping Peng, Shoujin Wang, Guobiao Zhang, Weiyu Zhang 0001, Xinxiao Qiao
KSEM (2)4
2022 Rethinking Adjacent Dependency in Session-Based Recommendations
Qian Zhang 0070, Shoujin Wang, Wenpeng Lu, Chong Feng 0001, Xueping Peng, Qingxiang Wang
PAKDD (3)2
2022 An Ion Exchange Mechanism Inspired Story Ending Generator for Different Characters
Qi Zhang 0020, Chongyang Shi 0001, Kaiying Jiang, Liang Hu 0004, Shoujin Wang
ECML/PKDD (2)6
2022 Sequential/Session-based Recommendations: Challenges, Approaches, Applications and Opportunities
abstract
In recent years, sequential recommender systems (SRSs) and session-based recommender systems (SBRSs) have emerged as a new paradigm of RSs to capture users' short-term but dynamic preferences for enabling more timely and accurate recommendations. Although SRSs and SBRSs have been extensively studied, there are many inconsistencies in this area caused by the diverse descriptions, settings, assumptions and application domains. There is no work to provide a unified framework and problem statement to remove the commonly existing and various inconsistencies in the area of SR/SBR. There is a lack of work to provide a comprehensive and systematic demonstration of the data characteristics, key challenges, most representative and state-of-the-art approaches, typical real- world applications and important future research directions in the area. This work aims to fill in these gaps so as to facilitate further research in this exciting and vibrant area.
Shoujin Wang, Qi Zhang 0020, Liang Hu 0004, Xiuzhen Zhang 0001, Yan Wang 0002, Charu C. Aggarwal
SIGIR1
2022 Veracity-aware and Event-driven Personalized News Recommendation for Fake News Mitigation
abstract
Despite the tremendous efforts by social media platforms and fact-check services for fake news detection, fake news and misinformation still spread wildly on social media platforms (e.g., Twitter). Consequently, fake news mitigation strategies are urgently needed. Most of the existing work on fake news mitigation focuses on the overall mitigation on a whole social network while ignoring developing concrete mitigation strategies to deter individual users from sharing fake news. In this paper, we propose a novel veracity-aware and event-driven recommendation model to recommend personalised corrective true news to individual users for effectively debunking fake news. Our proposed model Rec4Mit (Recommendation for Mitigation) not only effectively captures a user’s current reading preference with a focus on which event, e.g., US election, from her/his recent reading history containing true and/or fake news, but also accurately predicts the veracity (true or fake) of candidate news. As a result, Rec4Mit can recommend the most suitable true news to best match the user’s preference as well as to mitigate fake news. In particular, for those users who have read fake news of a certain event, Rec4Mit is able to recommend the corresponding true news of the same event. Extensive experiments on real-world datasets show Rec4Mit significantly outperforms the state-of-the-art news recommendation methods in terms of the capability to recommend personalized true news for fake news mitigation.
Shoujin Wang, Xiaofei Xu 0002, Xiuzhen Zhang 0001, Yan Wang 0002, Wenzhuo Song
WWW1
2022 Aspect-Driven User Preference and News Representation Learning for News Recommendation
abstract
Intelligent human-device interfaces play key roles in fully automated vehicles (FAVs), ensuring smooth interactions and improving the driving experience. Listening to news is a popular method of relaxing during a journey; as a result, travelers require automatic recommendations of preferred news programs. Most existing news recommender systems usually learn topic-level representations of users and news for recommendations while neglecting to learn more informative aspect-level features, resulting in limited recommendation performance. To bridge this significant gap, we propose a novel Aspect-driven News Recommender System (ANRS) built on aspect-level user preferences and news representation learning. In ANRS, a news aspect-level encoder and a user aspect-level encoder are devised to learn the fine-grained aspect-level representations of users’ preferences and news characteristics respectively. These representations are subsequently fed into a click predictor to predict the probability of a given user clicking on the candidate news item. Extensive experiments demonstrate the superiority of our method over state-of-the-art baseline methods.
Wenpeng Lu, Rongyao Wang, Shoujin Wang, Xueping Peng, Hao Wu 0066, Qian Zhang 0070
IEEE Trans. Intell. Transp. Syst.3
2022 Exploiting intra- and inter-session dependencies for session-based recommendations
Nan Wang 0009, Shoujin Wang, Yan Wang 0002, Quan Z. Sheng, Mehmet A. Orgun
World Wide Web2
2022 Multi-granularity interaction model based on pinyins and radicals for Chinese semantic matching
Wenpeng Lu, Shoujin Wang, Xueping Peng, Ping Jian, Hao Wu 0066, Weiyu Zhang 0001
World Wide Web3
2021 Sequential Dependency Enhanced Graph Neural Networks for Session-based Recommendations
abstract
Session-based recommendations (SBR) play an important role in many real-world applications, such as e-commerce and media streaming. To perform accurate session-based recommendations, it is crucial to capture both sequential dependencies over a sequence of adjacent items and complex item transitions over a set of items within sessions. Note that item transitions are not necessarily dependent on sequential dependencies, e.g., the transition from one item to the other distant item in a session is often not sequential. However, almost all the existing session-based recommender systems (SBRS) fail to consider both kinds of information, which leads to their limited performance improvement. Aiming at this deficiency, we propose a novel sequential dependency enhanced graph neural network (SDE-GNN) to capture both sequential dependencies and item transition relations over items within sessions for more accurate next-item recommendations. Specifically, we first devise a sequential dependency learning module to capture the sequential dependencies over a sequence of adjacent items in each session. Then, we propose an item transition learning module to capture complex transitions between items. In the module, a novel residual gate and a specialized attention mechanism are integrated into gate-GNN to build an attention augmented GNN, called AU-GNN. Finally, we devise a gated fusion component to combine the learned sequential dependencies and item transitions together in preparation for the subsequent next-item recommendations. Exhaustive experiments on two public real-world data sets demonstrate the superiority of SDE-GNN over the state-of-the-art methods.
Shoujin Wang, Wenpeng Lu, Hao Wu 0066, Qian Zhang 0070, Zhufeng Shao
DSAA2
2021 Graph Learning based Recommender Systems: A Review
abstract
Recent years have witnessed the fast development of the emerging topic of Graph Learning based Recommender Systems (GLRS). GLRS mainly employ advanced graph learning approaches to model users’ preferences and intentions as well as items’ characteristics and popularity for Recommender Systems (RS). Differently from other approaches, including content based filtering and collaborative filtering, GLRS are built on graphs where the important objects, e.g., users, items, and attributes, are either explicitly or implicitly connected. With the rapid development of graph learning techniques, exploring and exploiting homogeneous or heterogeneous relations in graphs is a promising direction for building more effective RS. In this paper, we provide a systematic review of GLRS, by discussing how they extract knowledge from graphs to improve the accuracy, reliability and explainability of the recommendations. First, we characterize and formalize GLRS, and then summarize and categorize the key challenges and main progress in this novel research area.
Shoujin Wang, Liang Hu 0004, Yan Wang 0002, Xiangnan He 0001, Quan Z. Sheng, Mehmet A. Orgun, Longbing Cao, Francesco Ricci 0001, Philip S. Yu
IJCAI1
2021 Next-item Recommendations in Short Sessions
abstract
The changing preferences of users towards items trigger the emergence of session-based recommender systems (SBRSs), which aim to model the dynamic preferences of users for next-item recommendations. However, most of the existing studies on SBRSs are based on long sessions only for recommendations, ignoring short sessions, though short sessions, in fact, account for a large proportion in most of the real-world datasets. As a result, the applicability of existing SBRSs solutions is greatly reduced. In a short session, quite limited contextual information is available, making the next-item recommendation very challenging. To this end, in this paper, inspired by the success of few-shot learning (FSL) in effectively learning a model with limited instances, we formulate the next-item recommendation as an FSL problem. Accordingly, following the basic idea of a representative approach for FSL, i.e., meta-learning, we devise an effective SBRS called INter-SEssion collaborativeRecommender neTwork (INSERT) for next-item recommendations in short sessions. With the carefully devised local module and global module, INSERT is able to learn an optimal preference representation of the current user in a given short session. In particular, in the global module, a similar session retrieval network (SSRN) is designed to find out the sessions similar to the current short session from the historical sessions of both the current user and other users, respectively. The obtained similar sessions are then utilized to complement and optimize the preference representation learned from the current short session by the local module for more accurate next-item recommendations in this short session. Extensive experiments conducted on two real-world datasets demonstrate the superiority of our proposed INSERT over the state-of-the-art SBRSs when making next-item recommendations in short sessions.
Wenzhuo Song, Shoujin Wang, Yan Wang 0002, Sheng-Sheng Wang 0001
RecSys2
2021 Stratified and time-aware sampling based adaptive ensemble learning for streaming recommendations
Shoujin Wang, Yan Wang 0002, Hongwei Liu 0002
Appl. Intell.2
2021 Chinese clinical named entity recognition based on stacked neural network
abstract
Summary The precise named entity recognition (NER) is a key component in Chinese clinical natural language processing. Although clinical NER systems have attracted widespread attention and been studied for decades, the latest NER research usually relies on a shallow text representation with one‐layer neural encoding, which fails to capture deep features and limits its performance improvement. To capture more features and encode the clinical text efficiently, we propose a deep stacked neural network for Chinese clinical NER. The neural network stacks two bidirectional long‐short term memory and gated recurrent unit layers to encode the text twice, followed by a conditional random fields (CRF) layer to recognize named entities in Chinese clinical text. Extensive empirical results on three real‐world datasets demonstrate that the proposed method significantly outperforms six state‐of‐the‐art NER methods. Especially compared with the conventional CRF model, our method has at least 3.75% F1‐score improvement on these public datasets.
Wenpeng Lu, Shoujin Wang, Xueping Peng, Rui Yu 0005
Concurr. Comput. Pract. Exp.3
2021 Visual content-enhanced sequential recommendation with feature-level attention
Tong Qu, Shoujin Wang
Neurocomputing3
2021 Comprehensive Analysis of a New Varying Parameter Zeroing Neural Network for Time Varying Matrix Inversion
abstract
The matrix inversion problem plays a very important role in mathematics as well as practical engineering applications. In this article, unlike the traditional fixed-parameter zeroing neural network (ZNN) model, on the basis of the original varying-parameter ZNN (VPZNN) model, an improved VPZNN (IVPZNN) model is established and researched to solve time-varying matrix inversion (TVMI). Specifically, the value of the proposed novel time-varying parameter in the IVPZNN model can grow rapidly over time, which can better meet the needs of ZNN in hardware implementation. In addition, theoretical analyses of the novel time varying parameter and the proposed IVPZNN model are given to guarantee the global superexponential convergence and finite-time convergence. Numerical calculation results verify the superior property of the established IVPZNN model for addressing the TVMI problem, as compared with the existing fixed-parameter ZNN and VPZNN models.
Lin Xiao 0002, Jianhua Dai 0003, Qiuyue Zuo, Shoujin Wang
IEEE Trans. Ind. Informatics5
2021 Dynamic Scheduling Algorithm in Cyber Mimic Defense Architecture of Volunteer Computing
abstract
Volunteer computing uses computers volunteered by the general public to do distributed scientific computing. Volunteer computing is being used in high-energy physics, molecular biology, medicine, astrophysics, climate study, and other areas. These projects have attained unprecedented computing power. However, with the development of information technology, the traditional defense system cannot deal with the unknown security problems of volunteer computing . At the same time, Cyber Mimic Defense (CMD) can defend the unknown attack behavior through its three characteristics: dynamic, heterogeneous, and redundant. As an important part of the CMD, the dynamic scheduling algorithm realizes the dynamic change of the service centralized executor, which can enusre the security and reliability of CMD of volunteer computing . Aiming at the problems of passive scheduling and large scheduling granularity existing in the existing scheduling algorithms, this article first proposes a scheduling algorithm based on time threshold and task threshold and realizes the dynamic randomness of mimic defense from two different dimensions; finally, combining time threshold and random threshold, a dynamic scheduling algorithm based on multi-level queue is proposed. The experiment shows that the dynamic scheduling algorithm based on multi-level queue can take both security and reliability into account, has better dynamic heterogeneous redundancy characteristics, and can effectively prevent the transformation rule of heterogeneous executors from being mastered by attackers.
Qianmu Li, Shunmei Meng, Xiaonan Sang, Hanrui Zhang 0002, Shoujin Wang, Ali Kashif Bashir, Keping Yu, Usman Tariq
ACM Trans. Internet Techn.5
2021 Sentence Semantic Matching Based on 3D CNN for Human-Robot Language Interaction
abstract
The development of cognitive robotics brings an attractive scenario where humans and robots cooperate to accomplish specific tasks. To facilitate this scenario, cognitive robots are expected to have the ability to interact with humans with natural language, which depends on natural language understanding ( NLU ) technologies. As one core task in NLU, sentence semantic matching ( SSM ) has widely existed in various interaction scenarios. Recently, deep learning–based methods for SSM have become predominant due to their outstanding performance. However, each sentence consists of a sequence of words, and it is usually viewed as one-dimensional ( 1D ) text, leading to the existing available neural models being restricted into 1D sequential networks. A few researches attempt to explore the potential of 2D or 3D neural models in text representation. However, it is hard for their works to capture the complex features in texts, and thus the achieved performance improvement is quite limited. To tackle this challenge, we devise a novel 3D CNN-based SSM ( 3DSSM ) method for human–robot language interaction. Specifically, first, a specific architecture called feature cube network is designed to transform a 1D sentence into a multi-dimensional representation named as semantic feature cube. Then, a 3D CNN module is employed to learn a semantic representation for the semantic feature cube by capturing both the local features embedded in word representations and the sequential information among successive words in a sentence. Given a pair of sentences, their representations are concatenated together to feed into another 3D CNN to capture the interactive features between them to generate the final matching representation. Finally, the semantic matching degree is judged with the sigmoid function by taking the learned matching representation as the input. Extensive experiments on two real-world datasets demonstrate that 3DSSM is able to achieve comparable or even better performance over the state-of-the-art competing methods.
Wenpeng Lu, Rui Yu 0005, Shoujin Wang, Can Wang 0004, Ping Jian, Heyan Huang
ACM Trans. Internet Techn.3
2020 Intention Nets: Psychology-Inspired User Choice Behavior Modeling for Next-Basket Prediction
abstract
Human behaviors are complex, which are often observed as a sequence of heterogeneous actions. In this paper, we take user choices for shopping baskets as a typical case to study the complexity of user behaviors. Most of existing approaches often model user behaviors in a mechanical way, namely treating a user action sequence as homogeneous sequential data, such as hourly temperatures, which fails to consider the complexity in user behaviors. In fact, users' choices are driven by certain underlying intentions (e.g., feeding the baby or relieving pain) according to Psychological theories. Moreover, the durations of intentions to drive user actions are quite different; some of them may be persistent while others may be transient. According to Psychological theories, we develop a hierarchical framework to describe the goal, intentions and action sequences, based on which, we design Intention Nets (IntNet). In IntNet, multiple Action Chain Nets are constructed to model the user actions driven by different intentions, and a specially designed Persistent-Transient Intention Unit models the different intention durations. We apply the IntNet to next-basket prediction, a recent challenging task in recommender systems. Extensive experiments on real-world datasets show the superiority of our Psychology-inspired model IntNet over the state-of-the-art approaches.
Shoujin Wang, Liang Hu 0004, Yan Wang 0002, Quan Z. Sheng, Mehmet A. Orgun, Longbing Cao
AAAI1
2020 Intention2Basket: A Neural Intention-driven Approach for Dynamic Next-basket Planning
abstract
User purchase behaviours are complex and dynamic, which are usually observed as multiple choice actions across a sequence of shopping baskets. Most of the existing next-basket prediction approaches model user actions as homogeneous sequence data without considering complex and heterogeneous user intentions, impeding deep under-standing of user behaviours from the perspective of human inside drivers and thus reducing the prediction performance. Psychological theories have indicated that user actions are essentially driven by certain underlying intentions (e.g., diet and entertainment). Moreover, different intentions may influence each other while different choices usually have different utilities to accomplish an intention. Inspired by such psychological insights, we formalize the next-basket prediction as an Intention Recognition, Modelling and Accomplishing problem and further design the Intention2Basket (Int2Ba in short) model. In Int2Ba, an Intention Recognizer, a Coupled Intention Chain Net, and a Dynamic Basket Planner are specifically designed to respectively recognize, model and accomplish the heterogeneous intentions behind a sequence of baskets to better plan the next-basket. Extensive experiments on real-world datasets show the superiority of Int2Ba over the state-of-the-art approaches.
Shoujin Wang, Liang Hu 0004, Yan Wang 0002, Quan Z. Sheng, Mehmet A. Orgun, Longbing Cao
IJCAI1
2020 Chinese Sentence Semantic Matching Based on Multi-Granularity Fusion Model
Xu Zhang 0053, Wenpeng Lu, Guoqiang Zhang 0003, Shoujin Wang
PAKDD (2)5
2020 Modelling Local and Global Dependencies for Next-Item Recommendations
Nan Wang 0009, Shoujin Wang, Yan Wang 0002, Quan Z. Sheng, Mehmet A. Orgun
WISE (2)2
2020 Double-Wing Mixture of Experts for Streaming Recommendations
Shoujin Wang, Yan Wang 0002, Hongwei Liu 0002, Weizhe Zhang
WISE (2)2
2020 Privacy-aware offloading for training tasks of generative adversarial network in edge computing
abstract
Currently, the generative adversarial network (GAN), with complex training processes in the physical machine (PM), has achieved great priority in image generation , audio conversion, image translation, etc. To improve the training efficiency of GAN, the edge computing paradigm is accepted as an alternative of the PMs to accommodate the training tasks, that is, the training tasks are migrated to the edge nodes (ENs) for hosting. However, it is still a key challenge to keep the overall network performance (i.e., load balance , transmission time) and privacy protection of training tasks at the same time. To address this challenge, a privacy-aware task offloading method, named POM, is developed accordingly in this paper. First, improving the strength pareto evolutionary algorithm (SPEA2) is fully investigated to obtain the offloading strategies for collaboratively improving the training performance and privacy preservation . Then, the most balanced offloading strategy is acquired for training GAN. Eventually, systematic experiments indicate that POM achieves an optimal performance efficiently among the other representative benchmark methods.
Xiaolong Xu 0001, Xihua Liu, Shoujin Wang, Quan Qi, Lianyong Qi
Inf. Sci.4
2020 Design and Comprehensive Analysis of a Noise-Tolerant ZNN Model With Limited-Time Convergence for Time-Dependent Nonlinear Minimization
abstract
Zeroing neural network (ZNN) is a powerful tool to address the mathematical and optimization problems broadly arisen in the science and engineering areas. The convergence and robustness are always co-pursued in ZNN. However, there exists no related work on the ZNN for time-dependent nonlinear minimization that achieves simultaneously limited-time convergence and inherently noise suppression. In this article, for the purpose of satisfying such two requirements, a limited-time robust neural network (LTRNN) is devised and presented to solve time-dependent nonlinear minimization under various external disturbances. Different from the previous ZNN model for this problem either with limited-time convergence or with noise suppression, the proposed LTRNN model simultaneously possesses such two characteristics. Besides, rigorous theoretical analyses are given to prove the superior performance of the LTRNN model when adopted to solve time-dependent nonlinear minimization under external disturbances. Comparative results also substantiate the effectiveness and advantages of LTRNN via solving a time-dependent nonlinear minimization problem.
Lin Xiao 0002, Jianhua Dai 0003, Rongbo Lu, Shuai Li 0002, Jichun Li 0002, Shoujin Wang
IEEE Trans. Neural Networks Learn. Syst.6
2020 Inferring Implicit Rules by Learning Explicit and Hidden Item Dependency
abstract
Revealing complex relations between entities (e.g., items within or between transactions) is of great significance for business optimization, prediction, and decision making. Such relations include not only co-occurrence-based explicit relations but also nonco-occurrence-based implicit ones. Explicit relations have been substantially studied by rule mining-based approaches, including association rule mining and causal rule discovery. In contrast, implicit relations have received much less attention but could be more actionable. In this paper, we focus on the implicit relations between items which rarely or never co-occur while each of them co-occurs with other identical items (link items) with a high probability. A framework integrates both explicit and hidden item dependencies and a corresponding efficient algorithm IRRMiner captures such implicit relations with implicit rule inference. Experimental results show that IRRMiner not only infers implicit rules of various sizes consisting of both frequent and infrequent items effectively, it also runs at least four times faster than IARMiner, a typical indirect association rule mining algorithm which can only mine size-2 indirect association rules between frequent items. IRRMiner is applied to make recommendations and shows that the identified implicit rules can increase recommendation reliability.
Shoujin Wang, Longbing Cao
IEEE Trans. Syst. Man Cybern. Syst.1
2019 Modeling Multi-Purpose Sessions for Next-Item Recommendations via Mixture-Channel Purpose Routing Networks
abstract
A session-based recommender system (SBRS) suggests the next item by modeling the dependencies between items in a session. Most of existing SBRSs assume the items inside a session are associated with one (implicit) purpose. However, this may not always be true in reality, and a session may often consist of multiple subsets of items for different purposes (e.g., breakfast and decoration). Specifically, items (e.g., bread and milk) in a subsethave strong purpose-specific dependencies whereas items (e.g., bread and vase) from different subsets have much weaker or even no dependencies due to the difference of purposes. Therefore, we propose a mixture-channel model to accommodate the multi-purpose item subsets for more precisely representing a session. Filling gaps in existing SBRSs, this model recommends more diverse items to satisfy different purposes. Accordingly, we design effective mixture-channel purpose routing networks (MCPRN) with a purpose routing network to detect the purposes of each item and assign it into the corresponding channels. Moreover, a purpose specific recurrent network is devised to model the dependencies between items within each channel for a specific purpose. The experimental results show the superiority of MCPRN over the state-of-the-art methods in terms of both recommendation accuracy and diversity.
Shoujin Wang, Liang Hu 0004, Yan Wang 0002, Quan Z. Sheng, Mehmet A. Orgun, Longbing Cao
IJCAI1
2019 Sequential Recommender Systems: Challenges, Progress and Prospects
abstract
The emerging topic of sequential recommender systems (SRSs) has attracted increasing attention in recent years. Different from the conventional recommender systems (RSs) including collaborative filtering and content-based filtering, SRSs try to understand and model the sequential user behaviors, the interactions between users and items, and the evolution of users’ preferences and item popularity over time. SRSs involve the above aspects for more precise characterization of user contexts, intent and goals, and item consumption trend, leading to more accurate, customized and dynamic recommendations. In this paper, we provide a systematic review on SRSs. We first present the characteristics of SRSs, and then summarize and categorize the key challenges in this research area, followed by the corresponding research progress consisting of the most recent and representative developments on this topic. Finally, we discuss the important research directions in this vibrant area.
Shoujin Wang, Liang Hu 0004, Yan Wang 0002, Longbing Cao, Quan Z. Sheng, Mehmet A. Orgun
IJCAI1
2018 Attention-Based Transactional Context Embedding for Next-Item Recommendation
abstract
To recommend the next item to a user in a transactional context is practical yet challenging in applications such as marketing campaigns. Transactional context refers to the items that are observable in a transaction. Most existing transaction based recommender systems (TBRSs) make recommendations by mainly considering recently occurring items instead of all the ones observed in the current context. Moreover, they often assume a rigid order between items within a transaction, which is not always practical. More importantly, a long transaction often contains many items irreverent to the next choice, which tends to overwhelm the influence of a few truly relevant ones. Therefore, we posit that a good TBRS should not only consider all the observed items in the current transaction but also weight them with different relevance to build an attentive context that outputs the proper next item with a high probability. To this end, we design an effective attention based transaction embedding model (ATEM) for context embedding to weight each observed item in a transaction without assuming order. The empirical study on real-world transaction datasets proves that ATEM significantly outperforms the state-of-the-art methods in terms of both accuracy and novelty.
Shoujin Wang, Liang Hu 0004, Longbing Cao, Xiaoshui Huang, Defu Lian, Wei Liu 0007
AAAI1
2017 Diversifying Personalized Recommendation with User-session Context
abstract
Recommender systems (RS) have become an integral part of our daily life. However, most current RS often repeatedly recommend items to users with similar profiles. We argue that recommendation should be diversified by leveraging session contexts with personalized user profiles. For this, current session-based RS (SBRS) often assume a rigidly ordered sequence over data which does not fit in many real-world cases. Moreover, personalization is often omitted in current SBRS. Accordingly, a personalized SBRS over relaxedly ordered user-session contexts is more pragmatic. In doing so, deep-structured models tend to be too complex to serve for online SBRS owing to the large number of users and items. Therefore, we design an efficient SBRS with shallow wide-in-wide-out networks, inspired by the successful experience in modern language modelings. The experiments on a real-world e-commerce dataset show the superiority of our model over the state-of-the-art methods.
Liang Hu 0004, Longbing Cao, Shoujin Wang, Guandong Xu, Jian Cao 0001, Zhiping Gu
IJCAI3
2017 Perceiving the Next Choice with Comprehensive Transaction Embeddings for Online Recommendation
Shoujin Wang, Liang Hu 0004, Longbing Cao
ECML/PKDD (2)1
2016 Training deep neural networks on imbalanced data sets
abstract
Deep learning has become increasingly popular in both academic and industrial areas in the past years. Various domains including pattern recognition, computer vision, and natural language processing have witnessed the great power of deep networks. However, current studies on deep learning mainly focus on data sets with balanced class labels, while its performance on imbalanced data is not well examined. Imbalanced data sets exist widely in real world and they have been providing great challenges for classification tasks. In this paper, we focus on the problem of classification using deep network on imbalanced data sets. Specifically, a novel loss function called mean false error together with its improved version mean squared false error are proposed for the training of deep networks on imbalanced data sets. The proposed method can effectively capture classification errors from both majority class and minority class equally. Experiments and comparisons demonstrate the superiority of the proposed approach compared with conventional methods in classifying imbalanced data sets on deep neural networks.
Shoujin Wang, Wei Liu 0007, Jia Wu 0001, Longbing Cao, Qinxue Meng, Paul J. Kennedy
IJCNN1