Xianzhi Wang 0001

dblp:51/8330 · DBLP profile ↗
← Back
54ranked-venue papers in the field
4as first author
34since 2021 · last 2026
0000-0001-9582-3445ORCID · conflict

Domains — venue-derived; a paper can count in several

Information Retrieval & Web Search · 24 (4 first)Data Mining & Knowledge Discovery · 22Database Systems & Data Management · 6Knowledge Engineering, Semantic Web & Information Systems · 1Business Process & Enterprise Data · 1
YearPublicationVenuePosition
2026 LLM-Enhanced Reinforcement Learning for Long-Term User Satisfaction in Interactive Recommendation
Chongjun Xia, Yanchun Peng, Xianzhi Wang 0001
DASFAA (1)3
2026 Diagnosing and Mitigating Mid-Sequence Degradation in Recommender Systems
Linjiang Guo, Nitin Bisht, Shiqing Wu 0001, Huan Huo, Xianzhi Wang 0001, Guandong Xu
SIGIR5
2025 SarRec: Statistically-guaranteed Augmented Retrieval for Recommendation
abstract
Recently, Large Language Models with Retrieval-Augmented Generation (RAG) have recently emerged as a powerful paradigm for sequential recommendation. However, existing methods typically retrieve items for each user without any principled mechanism for guaranteeing the reliability of generated recommendations, limiting their trustworthiness. To address this, we introduce SarRec : Statistically-guaranteed Augmented Retrieval for Recommendations, a framework that uses a simple retrieval step to provide relevant context and delivers calibrated, uncertainty-aware predictions with formal statistical guarantees. Specifically, SarRec first constructs the user's context set, utilizing a lightweight differentiable retrieval mechanism for identifying relevant context, and then calibrates the LLM's outputs by adapting the conformal prediction mechanism. We further provide a theoretical analysis that establishes an upper bound on the expected risk of recommendation performance metrics. Extensive experiments on multiple datasets from different domains validate the effectiveness of our framework.
Nitin Bisht, Zihao Li 0005, Guandong Xu, Xianzhi Wang 0001
CIKM5
2025 Reembedding and Reweighting are Needed for Tail Item Sequential Recommendation
abstract
Applying large vision models (LVMs) and large language models (LLMs) for item embedding is becoming cutting-edge for sequential recommendation, given their success in broad applications. Despite their advantages over traditional approaches, these models suffer more significant performance degradation on tail items against conventional ID-based solutions, which are largely overlooked by recent research. In this paper, we substantiate the above challenges as (1) all-in ground-truth, i.e., the standard cross-entropy (CE) loss focuses solely on the target items while treating all non-ground-truth equally, causing insufficient optimization for tail items, and (2) knowledge transfer tax, i.e., the knowledge encapsulated in LLMs and LVMs dominates the optimization process due to insufficient training for tail items. We propose Rewarding and reembedding, a simple yet efficient method to address the above challenges. Specifically, we reinitialize tail item embedding via a Gaussian distribution to alleviate knowledge transfer tax; besides, a rewarding function is incorporated in the CE loss, which adaptively adjusts item rewards during training to encourage the model to pay more attention to tail items rather than exclusively optimizing for ground-truth. Overall, our method enables a more nuanced optimization and is mathematically comparable to the direct preference optimization (DPO) in LLMs. Our extensive experiments on three public datasets show our method outperforms fourteen baselines in overall performance and improves the performance on tail items by a large margin. Our code is available at https://github.com/Yuhanleeee/R2Rec.
Zihao Li 0005, Yakun Chen, Xianzhi Wang 0001
WWW4
2025 Large language models are few-shot multivariate time series classifiers
abstract
Abstract Large Language Models (LLMs) are widely applied in time series analysis. Yet, their utility in few-shot classification—a scenario with limited training data—remains unexplored. We aim to leverage the pre-trained knowledge in LLMs to overcome the data scarcity problem within multivariate time series. To this end, we propose LLMFew, an LLM-enhanced framework, to investigate the feasibility and capacity of LLMs for few-shot multivariate time series classification (MTSC). We first introduce a Patch-wise Temporal Convolution Encoder (PTCEnc) to align time series data with the textual embedding input of LLMs. Then, we fine-tune the pre-trained LLM decoder with Low-rank Adaptations (LoRA) to enable effective representation learning from time series data. Experimental results show our model consistently outperforms state-of-the-art baselines by a large margin, achieving 125.2% and 50.2% improvement in classification accuracy on Handwriting and EthanolConcentration datasets, respectively. Our results also show LLM-based methods achieve comparable performance to traditional models across various datasets in few-shot MTSC, paving the way for applying LLMs in practical scenarios where labeled data are limited. Our code is available at https://github.com/junekchen/llm-fewshot-mtsc .
Yakun Chen, Zihao Li 0005, Chao Yang 0024, Xianzhi Wang 0001, Guandong Xu
Data Min. Knowl. Discov.4
2025 Special Issue on Responsible Recommender Systems Part 2
Lina Yao 0001, Julian J. McAuley, Xianzhi Wang 0001, Dietmar Jannach
ACM Trans. Intell. Syst. Technol.3
2024 MVis4LD: Multimodal Visual Interactive System for Lie Detection
Md. Kowsar Hossain Sakib, Md. Rafiqul Islam 0004, Shanjita Akter Prome, Thanh Thao Lam Nguyen, David Asirvatham, Neethiahnanthan Ari Ragavan, Xianzhi Wang 0001, Cesar Sanín
ACIIDS (2)7
2024 CLIMB: Imbalanced Data Modelling Using Contrastive Learning with Limited Labels
Abdullah Alsuhaibani, Muhammad Imran Razzak, Shoaib Jameel, Xianzhi Wang 0001, Guandong Xu
WISE (4)4
2024 Dyformer: A dynamic transformer-based architecture for multivariate time series classification
Chao Yang 0024, Xianzhi Wang 0001, Lina Yao 0001, Guodong Long, Guandong Xu
Inf. Sci.2
2024 Special Issue on Responsible Recommender Systems Part 1
abstract
introduction Free Access Share on Just AcceptedSpecial Issue on Responsible Recommender Systems Part 1 Authors: Lina Yao CSIRO's Data61 and University of New South Wales, Australia CSIRO's Data61 and University of New South Wales, Australia 0000-0002-4149-839XSearch about this author , Julian McAuley University of California, USA University of California, USASearch about this author , Xianzhi Wang University of Technology Sydney, Australia University of Technology Sydney, Australia 0000-0001-9582-3445Search about this author , Dietmar Jannach University of Klagenfurt, Austria University of Klagenfurt, Austria 0000-0002-4698-8507Search about this author Authors Info & Claims ACM Transactions on Intelligent Systems and TechnologyAccepted on April 2024https://doi.org/10.1145/3663528Online AM:15 June 2024Publication History 0citation5DownloadsMetricsTotal Citations0Total Downloads5Last 12 Months5Last 6 weeks5 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Publisher SiteeReaderPDF
Lina Yao 0001, Julian J. McAuley, Xianzhi Wang 0001, Dietmar Jannach
ACM Trans. Intell. Syst. Technol.3
2024 Attention-Aware Social Graph Transformer Networks for Stochastic Trajectory Prediction
abstract
Trajectory prediction is fundamental to various intelligent technologies, such as autonomous driving and robotics. The motion prediction of pedestrians and vehicles helps emergency braking, reduces collisions, and improves traffic safety. Current trajectory prediction research faces problems of complex social interactions, high dynamics and multi-modality. Especially, it still has limitations in long-time prediction. We propose Attention-aware Social Graph Transformer Networks for multi-modal trajectory prediction. We combine Graph Convolutional Networks and Transformer Networks by generating stable resolution pseudo-images from Spatio-temporal graphs through a designed stacking and interception method. Furthermore, we design the attention-aware module to handle social interaction information in scenarios involving mixed pedestrian-vehicle traffic. Thus, we maintain the advantages of the Graph and Transformer, i.e., the ability to aggregate information over an arbitrary number of neighbors and the ability to perform complex time-dependent data processing. We conduct experiments on datasets involving pedestrian, vehicle, and mixed trajectories, respectively. Our results demonstrate that our model minimizes displacement errors across various metrics and significantly reduces the likelihood of collisions. It is worth noting that our model effectively reduces the final displacement error, illustrating the ability of our model to predict for a long time.
Yao Liu 0017, Binghao Li, Xianzhi Wang 0001, Claude Sammut, Lina Yao 0001
IEEE Trans. Knowl. Data Eng.3
2024 BehaviorNet: A Fine-grained Behavior-aware Network for Dynamic Link Prediction
abstract
Dynamic link prediction has become a trending research subject because of its wide applications in the web, sociology, transportation, and bioinformatics. Currently, the prevailing approach for dynamic link prediction is based on graph neural networks, in which graph representation learning is the key to perform dynamic link prediction tasks. However, there are still great challenges because the structure of graphs evolves over time. A common approach is to represent a dynamic graph as a collection of discrete snapshots, in which information over a period is aggregated through summation or averaging. This way results in some fine-grained time-related information loss, which further leads to a certain degree of performance degradation. We conjecture that such fine-grained information is vital because it implies specific behavior patterns of nodes and edges in a snapshot. To verify this conjecture, we propose a novel fine-grained behavior-aware network (BehaviorNet) for dynamic network link prediction. Specifically, BehaviorNet adapts a transformer-based graph convolution network to capture the latent structural representations of nodes by adding edge behaviors as an additional attribute of edges. GRU is applied to learn the temporal features of given snapshots of a dynamic network by utilizing node behaviors as auxiliary information. Extensive experiments are conducted on several real-world dynamic graph datasets, and the results show significant performance gains for BehaviorNet over several state-of-the-art (SOTA) discrete dynamic link prediction baselines. Ablation study validates the effectiveness of modeling fine-grained edge and node behaviors.
Zhiying Tu, Tonghua Su, Xianzhi Wang 0001, Xiaofei Xu 0001, Zhongjie Wang 0003
ACM Trans. Web4
2023 MTSTI: A Multi-task Learning Framework for Spatiotemporal Imputation
Yakun Chen, Kaize Shi, Xianzhi Wang 0001, Guandong Xu
ADMA (5)3
2023 Exploring the Effectiveness of Positional Embedding on Transformer-Based Architectures for Multivariate Time Series Classification
Chao Yang 0024, Yakun Chen, Zihao Li 0005, Xianzhi Wang 0001
ADMA (1)4
2023 From Time Series to Multi-modality: Classifying Multivariate Time Series via Both 1D and 2D Representations
Chao Yang 0024, Xianzhi Wang 0001, Lina Yao 0001, Guodong Long, Guandong Xu
ADMA (1)2
2023 RETIA: Relation-Entity Twin-Interact Aggregation for Temporal Knowledge Graph Extrapolation
abstract
Temporal knowledge graph (TKG) extrapolation aims to predict future unknown events (facts) based on historical information, and has attracted considerable attention due to its great practical significance. Accurate representations (embeddings) of entities and relations form the basis of TKG extrapolation. Recent work has been devoted to improving the rationality of entity representations. However, on the one hand, ignoring relation modeling results in incomplete relation representations; therefore, some approaches aggregate only immediately adjacent entities of relations, but this can lead to the "message islands" problem of relation modeling. On the other hand, ignoring the association constraints between relations and entities can make the embeddings of both relations and entities prone to overfitting. To address the abovementioned challenges, we propose an advanced method, namely, RETIA. For the former issue, we generate twin hyperrelation subgraphs for each historical subgraph and then aggregate both the adjacent entities and relations in the hyperrelation subgraphs through a graph convolutional network (GCN). About the latter concern, we propose a twin-interact module (TIM), which provides communication channels for relation aggregation and entity aggregation during the evolution of the historical sequence. Experiments conducted on five public datasets show that RETIA has made great improvements across several evaluation metrics. Our released code is available at https://github.com/CGCL-codes/RETIA.
Kangzheng Liu, Feng Zhao 0003, Guandong Xu, Xianzhi Wang 0001, Hai Jin 0001
ICDE4
2023 SOAC: Supervised Off-Policy Actor-Critic for Recommender Systems
abstract
Improving users’ long-term experience in recommender systems (RS) has become a growing concern for recommendation platforms. Reinforcement learning (RL) is an attractive approach because it can plan and optimize long-term returns sequentially. However, directly applying RL as an online learning method in the RS setting can significantly compromise users’ satisfaction and experience. As a result, learning the recommendation policy from logged feedback collected under different policies has emerged as a promising direction. Offline learning enables the agent to utilize off-policy learning techniques. Nevertheless, several challenges need to be addressed, such as distribution shift. In this paper, we propose a novel RL method, called Supervised Off-Policy Actor-Critic (SOAC), for learning the recommendation policy from the logged feedback without exploration. The proposed SOAC addresses challenges, including distribution shift and extrapolation errors, and focuses on improving the ranking of items in a recommendation list. The experimental results demonstrate that SOAC can achieve better recommendation performance than existing supervised RL methods.
Shiqing Wu 0001, Guandong Xu, Xianzhi Wang 0001
ICDM3
2023 Dual Contrastive Transformer for Hierarchical Preference Modeling in Sequential Recommendation
abstract
Sequential recommender systems (SRSs) aim to predict the subsequent items which may interest users via comprehensively modeling users' complex preference embedded in the sequence of user-item interactions. However, most of existing SRSs often model users' single low-level preference based on item ID information while ignoring the high-level preference revealed by item attribute information, such as item category. Furthermore, they often utilize limited sequence context information to predict the next item while overlooking richer inter-item semantic relations. To this end, in this paper, we proposed a novel hierarchical preference modeling framework to substantially model the complex low- and high-level preference dynamics for accurate sequential recommendation. Specifically, in the framework, a novel dual-transformer module and a novel dual contrastive learning scheme have been designed to discriminatively learn users' low- and high-level preference and to effectively enhance both low- and high-level preference learning respectively. In addition, a novel semantics-enhanced context embedding module has been devised to generate more informative context embedding for further improving the recommendation performance. Extensive experiments on six real-world datasets have demonstrated both the superiority of our proposed method over the state-of-the-art ones and the rationality of our design.
Chengkai Huang, Shoujin Wang, Xianzhi Wang 0001, Lina Yao 0001
SIGIR3
2023 Simplifying Graph-based Collaborative Filtering for Recommendation
abstract
Graph Convolutional Networks (GCNs) are a popular type of machine learning models that use multiple layers of convolutional aggregation operations and non-linear activations to represent data. Recent studies apply GCNs to Collaborative Filtering (CF)-based recommender systems (RSs) by modeling user-item interactions as a bipartite graph and achieve superior performance. However, these models face difficulty in training with non-linear activations on large graphs. Besides, most GCN-based models could not model deeper layers due to the over-smoothing effect with the graph convolution operation. In this paper, we improve the GCN-based CF models from two aspects. First, we remove non-linearities to enhance recommendation performance, which is consistent with the theories in simple graph convolutional networks. Second, we obtain the initialization of the embedding for each node in the graph by computing the network embedding on the condensed graph, which alleviates the over smoothing problem in graph convolution aggregation operation with sparse interaction data. The proposed model is a linear model that is easy to train, scalable to large datasets, and shown to yield better efficiency and effectiveness on four real datasets.
Xianzhi Wang 0001, Dingxian Wang, Haoyuan Zou, Hongzhi Yin, Guandong Xu
WSDM2
2023 Exploiting Explicit and Implicit Item relationships for Session-based Recommendation
abstract
The session-based recommendation aims to predict users' immediate next actions based on their short-term behaviors reflected by past and ongoing sessions. Graph neural networks (GNNs) recently dominated the related studies, yet their performance heavily relies on graph structures, which are often predefined, task-specific, and designed heuristically. Furthermore, existing graph-based methods either neglect implicit correlations among items or consider explicit and implicit relationships altogether in the same graphs. We propose to decouple explicit and implicit relationships among items. As such, we can capture the prior knowledge encapsulated in explicit dependencies and learned implicit correlations among items simultaneously in a flexible and more interpretable manner for effective recommendations. We design a dual graph neural network that leverages the feature representations extracted by two GNNs: a graph neural network with a single gate (SG-GNN) and an adaptive graph neural network (A-GNN). The former models explicit dependencies among items. The latter employs a self-learning strategy to capture implicit correlations among items. Our experiments on four real-world datasets show our model outperforms state-of-the-art methods by a large margin, achieving 18.46% and 70.72% improvement in [email protected], and 49.10% and 115.29% improvement in [email protected] on Diginetica and LastFM datasets.
Zihao Li 0005, Xianzhi Wang 0001, Chao Yang 0024, Lina Yao 0001, Julian J. McAuley, Guandong Xu
WSDM2
2023 Modeling Temporal Positive and Negative Excitation for Sequential Recommendation
abstract
Sequential recommendation aims to predict the next item which interests users via modeling their interest in items over time. Most of the existing works on sequential recommendation model users’ dynamic interest in specific items while overlooking users’ static interest revealed by some static attribute information of items, e.g., category, brand. Moreover, existing works often only consider the positive excitation of a user’s historical interactions on his/her next choice on candidate items while ignoring the commonly existing negative excitation, resulting in insufficiently modeling dynamic interest. The overlook of static interest and negative excitation will lead to incomplete interest modeling and thus impedes the recommendation performance. To this end, in this paper, we propose modeling both static interest and negative excitation for dynamic interest to further improve the recommendation performance. Accordingly, we design a novel Static-Dynamic Interest Learning (SDIL) framework featured with a novel Temporal Positive and Negative Excitation Modeling (TPNE) module for accurate sequential recommendation. TPNE is specially designed for comprehensively modeling dynamic interest based on temporal positive and negative excitation learning. Extensive experiments on three real-world datasets show that SDIL can effectively capture both static and dynamic interest and outperforms state-of-the-art baselines.
Chengkai Huang, Shoujin Wang, Xianzhi Wang 0001, Lina Yao 0001
WWW3
2023 Generative Adversarial Reward Learning for Generalized Behavior Tendency Inference
abstract
Recent advances in reinforcement learning have inspired increasing interest in learning user modeling adaptively through dynamic interactions, e.g., in reinforcement learning based recommender systems. In most reinforcement learning applications, reward functions provide the critical guideline for optimization. However, current reinforcement learning-based methods rely on manually-defined reward functions, which cannot adapt to dynamic, noisy environments. Moreover, they generally use task-specific reward functions that sacrifice generalization ability. We propose a generative inverse reinforcement learning for user behavioral preference modeling to address the above issues. Instead of using predefined reward functions, our model can automatically learn the rewards from user's actions based on discriminative actor-critic network and Wasserstein GAN. Our model provides a general approach to characterizing and explaining underlying behavioral tendencies. Our experiments show our method outperforms state-of-the-art methods in several scenarios, namely traffic signal control, online recommender systems, and scanpath prediction.
Xiaocong Chen, Lina Yao 0001, Xianzhi Wang 0001, Aixin Sun, Quan Z. Sheng
IEEE Trans. Knowl. Data Eng.3
2022 Multi-agent Transformer Networks for Multimodal Human Activity Recognition
abstract
Human activity recognition has become an important challenge yet to resolve while also having promising benefits in various applications for years. Existing approaches have made great progress by applying deep-learning and attention-based methods. However, the deep learning-based approaches may not fully exploit the features to resolve multimodal human activity recognition tasks. Also, the potential of attention-based methods still has not been fully explored to better extract the multimodal spatial-temporal relationship and produce robust results. In this work, we propose Multi-agent Transformer Network (MATN), a multi-agent attention-based deep learning algorithm, to address the above issues in multimodal human activity recognition. We first design a unified representation learning layer to encode the multimodal data, which preprocesses the data in a generalized and efficient way. Then we develop a multimodal spatial-temporal transformer module that applies the attention mechanism to extract the salient spatial-temporal features. Finally, we use a multi-agent training module to collaboratively select the informative modalities and predict the activity labels. We have extensively conducted experiments to evaluate MATN's performance on two public multimodal human activity recognition datasets. The results show that our model has achieved competitive performance compared to the state-of-the-art approaches, which also demonstrates scalability, effectiveness, and robustness.
Jingcheng Li, Lina Yao 0001, Binghao Li, Xianzhi Wang 0001, Claude Sammut
CIKM4
2022 Social Graph Transformer Networks for Pedestrian Trajectory Prediction in Complex Social Scenarios
abstract
Pedestrian trajectory prediction is essential for many modern applications, such as abnormal motion analysis and collision avoidance for improved traffic safety. Previous studies still face challenges in embracing high social interaction, dynamics, and multi-modality for achieving high accuracy with long-time predictions. We propose Social Graph Transformer Networks for multi-modal prediction of pedestrian trajectories, where we combine Graph Convolutional Network and Transformer Network by generating stable resolution pseudo-images from Spatio-temporal graphs through a designed stacking and interception method. Specifically, we adopt adjacency matrices to obtain Spatio-temporal features and Transformer for long-time trajectory predictions. As such, we retrain the advantages of both, i.e., the ability to aggregate information over an arbitrary number of neighbors and to conduct complex time-dependent data processing. Our experimental results show that our model reduces the final displacement error and achieves state-of-the-art in multiple metrics. The module's effectiveness is demonstrated through ablation experiments.
Yao Liu 0017, Lina Yao 0001, Binghao Li, Xianzhi Wang 0001, Claude Sammut
CIKM4
2022 minIL: A Simple and Small Index for String Similarity Search with Edit Distance
abstract
The string similarity search is core functionality in a range of applications, including data cleaning, near-duplicate object detection, and data integration. We study the problem of threshold similarity search with the edit distance, where given a set of strings, a threshold$k$, and a query string$q$, we aim to find all strings in the set whose edit distances to$q$are no larger than$k$. Extensive studies have been proposed for the threshold similarity search problem with the edit distance. However, they suffer from a huge space consumption issue when achieving only an acceptable efficiency, especially for long strings. In this paper, we propose a simple yet small index, called minIL, to eliminate this issue. First, we adopt a minhash family to capture pivot characters and to construct sketch representations for strings. Second, we develop a multi-level inverted index to search sketches with a low space consumption. Finally, we apply a novel learned index technique on top of the index that further improves the query efficiency. Extensive experiments on real-world datasets offer insight into the performance of our method and show that it substantially reduces the index size, and is capable of outperforming the baseline approaches.
Zhong Yang 0004, Bolong Zheng, Xianzhi Wang 0001, Guohui Li 0001, Xiaofang Zhou 0001
ICDE3
2022 Temporal Knowledge Graph Reasoning via Time-Distributed Representation Learning
abstract
Temporal knowledge graph (TKG) reasoning has attracted significant attention. Recent approaches for modeling historical information have led to great advances. However, the problems of time variability and unseen entities have become two major obstacles preventing further development. The time variability problem means that different historical timestamps play different roles in the inference process. Furthermore, in the context of time variability, the unseen entity problem means that a query cannot obtain a predicted entity that is unseen in the scale-varying history rather than in a fixed set, thus turning from static to dynamic. In this paper, we propose a novel method named DHU-NET for addressing the time variability challenge and the dynamic unseen entity challenge derived from it. With regard to the former concern, we propose a time-distributed representation learning method based on a graph convolutional network(GCN) and a self-attention mechanism, which learns the distributed representations of facts at different historical timestamps and comprehensively pays different levels of attention to the different timestamps. With regard to the latter issue, we extract the unseen entities from a global static KG based on a copy mechanism and bring them into consideration during the final prediction step. Experiments on six benchmark datasets demonstrate the substantial improvements achieved by DHUNET in terms of multiple evaluation metrics. Our released codes are available at https://github.com/CGCL-codes/DHUNET.
Kangzheng Liu, Feng Zhao 0003, Guandong Xu, Xianzhi Wang 0001, Hai Jin 0001
ICDM4
2022 Locality-Sensitive State-Guided Experience Replay Optimization for Sparse Rewards in Online Recommendation
abstract
Online recommendation requires handling rapidly changing user preferences. Deep reinforcement learning (DRL) is an effective means of capturing users' dynamic interest during interactions with recommender systems. Generally, it is challenging to train a DRL agent in online recommender systems because of the sparse rewards caused by the large action space (e.g., candidate item space) and comparatively fewer user interactions. Leveraging experience replay (ER) has been extensively studied to conquer the issue of sparse rewards. However, they adapt poorly to the complex environment of online recommender systems and are inefficient in learning an optimal strategy from past experience. As a step to filling this gap, we propose a novel state-aware experience replay model, in which the agent selectively discovers the most relevant and salient experiences and is guided to find the optimal policy for online recommendations. In particular, a locality-sensitive hashing method is proposed to selectively retain the most meaningful experience at scale and a prioritized reward-driven strategy is designed to replay more valuable experiences with higher chance. We formally show that the proposed method guarantees the upper and lower bound on experience replay and optimizes the space complexity, as well as empirically demonstrate our model's superiority to several existing experience replay methods over three benchmark simulation platforms.
Xiaocong Chen, Lina Yao 0001, Julian J. McAuley, Weili Guan, Xiaojun Chang, Xianzhi Wang 0001
SIGIR6
2022 Hierarchical Task-aware Multi-Head Attention Network
abstract
Neural Multi-task Learning is gaining popularity as a way to learn multiple tasks jointly within a single model. While related research continues to break new ground, two major limitations still remain, including (i) poor generalization to scenarios where tasks are loosely correlated; and (ii) under-investigation on global commonality and local characteristics of tasks. Our aim is to bridge these gaps by presenting a neural multi-task learning model coined Hierarchical Task-aware Multi-headed Attention Network (HTMN). HTMN explicitly distinguishes task-specific features from task-shared features to reduce the impact caused by weak correlation between tasks. The proposed method highlights two parts: Multi-level Task-aware Experts Network that identifies task-shared global features and task-specific local features, and Hierarchical Multi-Head Attention Network that hybridizes global and local features to profile more robust and adaptive representations for each task. Afterwards, each task tower receives its hybrid task-adaptive representation to perform task-specific predictions. Extensive experiments on two real datasets show that HTMN consistently outperforms the compared methods on a variety of prediction tasks.
Jing Du 0003, Lina Yao 0001, Xianzhi Wang 0001, Bin Guo 0001, Zhiwen Yu 0001
SIGIR3
2022 Graph Neural Network with Self-attention and Multi-task Learning for Credit Default Risk Prediction
Zihao Li 0005, Xianzhi Wang 0001, Lina Yao 0001, Yakun Chen, Guandong Xu, Ee-Peng Lim
WISE2
2022 Mitigating Multi-class Unintended Demographic Bias in Text Classification with Adversarial Learning
Le Pan, Lina Yao 0001, Wenjie Zhang 0001, Xianzhi Wang 0001
WISE4
2021 Generative Inverse Deep Reinforcement Learning for Online Recommendation
abstract
Deep reinforcement learning enables an agent to capture users' interest through dynamic interactions with the environment. It uses a reward function to learn user's interest and to control the learning process, attracting great interest in recommendation research. However, most reward functions are manually designed; they are either too unrealistic or imprecise to reflect the variety, dimensionality, and non-linearity of the recommendation problem. This impedes the agent from learning an optimal policy in highly dynamic online recommendation scenarios. To address the above issue, we propose a generative inverse reinforcement learning approach that avoids the need of defining an elaborative reward function. In particular, we model the recommendation problem as an automatic policy learning problem. We first generate policies based on observed users' preferences and then evaluate the learned policy by a measurement based on a discriminative actor-critic network. We conduct experiments on an online platform, VirtualTB, and demonstrate the feasibility and effectiveness of our proposed approach via comparisons with several state-of-the-art methods.
Xiaocong Chen, Lina Yao 0001, Aixin Sun, Xianzhi Wang 0001, Xiwei Xu 0001, Liming Zhu 0001
CIKM4
2021 Global Convolutional Neural Processes
abstract
The ability to deal with uncertainty in machine learning models has become equally, if not more, crucial to their predictive ability itself. For instance, during the pandemic, governmental policies and personal decisions are constantly made around uncertainties. Targeting this, Neural Process Families (NPFs) have recently shone a light on prediction with uncertainties by bridging Gaussian processes and neural networks. Latent neural process, a member of NPF, is believed to be capable of modelling the uncertainty on certain points (local uncertainty) as well as the general function priors (global uncertainties). Nonetheless, some critical questions remain unresolved, such as a formal definition of global uncertainties, the causality behind global uncertainties, and the manipulation of global uncertainties for generative models. Regarding this, we build a member GloBal Convolutional Neural Process(GBCoNP) that achieves the SOTA log-likelihood in latent NPFs. It designs a global uncertainty representation p(z), which is an aggregation on a discretized input space. The causal effect between the degree of global uncertainty and the intra-task diversity is discussed. The learnt prior is analyzed on a variety of scenarios, including 1D, 2D, and a newly proposed spatial-temporal COVID dataset. Our manipulation of the global uncertainty not only achieves generating the desired samples to tackle few-shot learning, but also enables the probability evaluation on the functional priors.
Xuesong Wang 0002, Lina Yao 0001, Xianzhi Wang 0001, Hye-Young Paik, Sen Wang 0001
ICDM3
2021 MetaGB: A Gradient Boosting Framework for Efficient Task Adaptive Meta Learning
abstract
Deep learning frameworks generally require sufficient training data to generalize well while fail to adapt on small or few-shot datasets. Meta-learning offers an effective means of tackling few-shot scenarios and has drawn increasing attention in recent years. Meta-optimization aims to learn a shared set of parameters across tasks for meta-learning while facing challenges in determining whether an initialization condition can be generalized to tasks with diverse distributions. In this regard, we propose a meta-gradient boosting framework that can fit diverse distributions based on a base learner (which learns shared information across tasks) and a series of gradient-boosted modules (which capture task-specific information). We evaluate the model on several few-shot learning benchmarks and demonstrate the effectiveness of our model in modulating task-specific meta-learned priors and handling diverse distributions.
Manqing Dong, Lina Yao 0001, Xianzhi Wang 0001, Xiwei Xu 0001, Liming Zhu 0001
ICDM3
2021 NP-PROV: Neural Processes with Position-Relevant-Only Variances
Xuesong Wang 0002, Lina Yao 0001, Xianzhi Wang 0001, Feiping Nie 0001, Boualem Benatallah
WISE (1)3
2020 Spectrum-Guided Adversarial Disparity Learning
abstract
It has been a significant challenge to portray intraclass disparity precisely in the area of activity recognition, as it requires a robust representation of the correlation between subject-specific variation for each activity class. In this work, we propose a novel end-to-end knowledge directed adversarial learning framework, which portrays the class-conditioned intraclass disparity using two competitive encoding distributions and learns the purified latent codes by denoising learned disparity. Furthermore, the domain knowledge is incorporated in an unsupervised manner to guide the optimization and further boosts the performance. The experiments on four HAR benchmark datasets demonstrate the robustness and generalization of our proposed methods over a set of state-of-the-art. We further prove the effectiveness of automatic domain knowledge incorporation in performance enhancement.
Zhe Liu 0023, Lina Yao 0001, Lei Bai 0001, Xianzhi Wang 0001, Can Wang 0004
KDD4
2020 Prototype Similarity Learning for Activity Recognition
abstract
Human Activity Recognition (HAR) plays an irreplaceable role in various applications such as security, gaming, and assisted living. Recent studies introduce deep learning to mitigate the manual feature extraction (i.e., data representation) efforts and achieve high accuracy. However, there are still challenges in learning accurate representations for sensory data due to the weakness of representation modules and the subject variances. We propose a scheme called Distance-based HAR from Ensembled spatial-temporal Representations (DHARER) to address above challenges. The idea behind DHARER is straightforward—the same activities should have similar representations. We first learn representations of the input sensory segments and latent prototype representations of each class, using a Convolution Neural Network (CNN)-based dual-stream representation module; then the learned representations are projected to activity types by measuring their similarity to the learned prototypes. We have conducted extensive experiments under a strict subject-independent setting on three large-scale datasets to evaluate the proposed scheme, and our experimental results demonstrate superior performance of DHARER to several state-of-the-art methods.
Lei Bai 0001, Lina Yao 0001, Xianzhi Wang 0001, Salil S. Kanhere, Yang Xiao 0014
PAKDD (1)3
2020 Adversarial Attacks and Detection on Reinforcement Learning-Based Interactive Recommender Systems
abstract
Adversarial attacks pose significant challenges for detecting adversarial attacks at an early stage. We propose attack-agnostic detection on reinforcement learning-based interactive recommendation systems. We first craft adversarial examples to show their diverse distributions and then augment recommendation systems by detecting potential attacks with a deep learning-based classifier based on the crafted data. Finally, we study the attack strength and frequency of adversarial examples and evaluate our model on standard datasets with multiple crafting methods. Our extensive experiments show that most adversarial attacks are effective, and both attack strength and attack frequency impact the attack performance. The strategically-timed attack achieves comparative attack performance with only 1/3 to 1/2 attack frequency. Besides, our black-box detector trained with one crafting method has the generalization ability over several crafting methods.
Yuanjiang Cao, Xiaocong Chen, Lina Yao 0001, Xianzhi Wang 0001, Wei Zhang 0098
SIGIR4
2020 From Appearance to Essence: Comparing Truth Discovery Methods without Using Ground Truth
abstract
Truth discovery has been widely studied in recent years as a fundamental means for resolving the conflicts in multi-source data. Although many truth discovery methods have been proposed based on different considerations and intuitions, investigations show that no single method consistently outperforms the others. To select the right truth discovery method for a specific application scenario, it becomes essential to evaluate and compare the performance of different methods. A drawback of current research efforts is that they commonly assume the availability of certain ground truth for the evaluation of methods. However, the ground truth may be very limited or even impossible to obtain, rendering the evaluation biased. In this article, we present CompTruthHyp , a generic approach for comparing the performance of truth discovery methods without using ground truth. In particular, our approach calculates the probability of observations in a dataset based on the output of different methods. The probability is then ranked to reflect the performance of these methods. We review and compare 12 representative truth discovery methods and consider both single-valued and multi-valued objects. The empirical studies on both real-world and synthetic datasets demonstrate the effectiveness of our approach for comparing truth discovery methods.
Xiu Susie Fang, Quan Z. Sheng, Xianzhi Wang 0001, Wei Zhang 0098, Anne H. H. Ngu, Jian Yang 0001
ACM Trans. Intell. Syst. Technol.3
2019 Reminder Care System: An Activity-Aware Cross-Device Recommendation System
May S. Altulyan, Chaoran Huang 0001, Lina Yao 0001, Xianzhi Wang 0001, Salil S. Kanhere, Yuanjiang Cao
ADMA4
2019 Expert2Vec: Distributed Expert Representation Learning in Question Answering Community
Xiaocong Chen, Chaoran Huang 0001, Xiang Zhang 0012, Xianzhi Wang 0001, Wei Liu 0101, Lina Yao 0001
ADMA4
2019 Spatio-Temporal Graph Convolutional and Recurrent Networks for Citywide Passenger Demand Prediction
abstract
Online ride-sharing platforms have become a critical part of the urban transportation system. Accurately recommending hotspots to drivers in such platforms is essential to help drivers find passengers and improve users' experience, which calls for efficient passenger demand prediction strategy. However, predicting multi-step passenger demand is challenging due to its high dynamicity, complex dependencies along spatial and temporal dimensions, and sensitivity to external factors (meteorological data and time meta). We propose an end-to-end deep learning framework to address the above problems. Our model comprises three components in pipeline: 1) a cascade graph convolutional recurrent neural network to accurately extract the spatial-temporal correlations within citywide historical passenger demand data; 2) two multi-layer LSTM networks to represent the external meteorological data and time meta, respectively; 3) an encoder-decoder module to fuse the above two parts and decode the representation to predict over multi-steps into the future. The experimental results on three real-world datasets demonstrate that our model can achieve accurate prediction and outperform the most discriminative state-of-the-art methods.
Lei Bai 0001, Lina Yao 0001, Salil S. Kanhere, Xianzhi Wang 0001, Wei Liu 0101, Zheng Yang 0002
CIKM4
2019 Know Your Mind: Adaptive Cognitive Activity Recognition with Reinforced CNN
abstract
Electroencephalography (EEG) signals reflect and measure activities in certain brain areas. Its zero clinical risk and easy-to-use features make it a good choice of providing insights into the cognitive process. However, effective analysis of time-varying EEG signals remains challenging. First, EEG signal processing and feature engineering are time-consuming and highly rely on expert knowledge, and most existing studies focus on domain-specific classification algorithms, which may not apply to other domains. Second, EEG signals usually have low signal-to-noise ratios and are more chaotic than other sensor signals. In this regard, we propose a generic EEG-based cognitive activity recognition framework that can adaptively support a wide range of cognitive applications to address the above issues. The framework uses a reinforced selective attention model to choose the characteristic information among raw EEG signals automatically. It employs a convolutional mapping operation to dynamically transform the selected information into a feature space to uncover the implicit spatial dependency of EEG sample distribution. We demonstrate the effectiveness of the framework under three representative scenarios: intention recognition with motor imagery EEG, person identification, and neurological diagnosis, and further evaluate it on three widely used public datasets. The experimental results show our framework outperforms multiple state-of-the-art baselines and achieves competitive accuracy on all the datasets while achieving low latency and high resilience in handling complex EEG signals across various domains. The results confirm the suitability of the proposed generic approach for a range of problems in the realm of brain-computer Interface applications.
Xiang Zhang 0012, Lina Yao 0001, Xianzhi Wang 0001, Wenjie Zhang 0001, Shuai Zhang 0007, Yunhao Liu 0001
ICDM3
2019 Passenger Demand Forecasting with Multi-Task Convolutional Recurrent Neural Networks
Lei Bai 0001, Lina Yao 0001, Salil S. Kanhere, Zheng Yang 0002, Jing Chu, Xianzhi Wang 0001
PAKDD (2)6
2019 Similarity-Aware Deep Attentive Model for Clickbait Detection
Manqing Dong, Lina Yao 0001, Xianzhi Wang 0001, Boualem Benatallah, Chaoran Huang 0001
PAKDD (2)3
2018 DUAL: A Deep Unified Attention Model with Latent Relation Representations for Fake News Detection
Manqing Dong, Lina Yao 0001, Xianzhi Wang 0001, Boualem Benatallah, Quan Z. Sheng
WISE (1)3
2018 Data-Augmented Regression with Generative Convolutional Network
Xiaodong Ning, Lina Yao 0001, Xianzhi Wang 0001, Boualem Benatallah, Shuai Zhang 0007, Xiang Zhang 0012
WISE (2)3
2017 Calling for Response: Automatically Distinguishing Situation-Aware Tweets During Crises
Xiaodong Ning, Lina Yao 0001, Xianzhi Wang 0001, Boualem Benatallah
ADMA3
2017 SourceVote: Fusing Multi-valued Data via Inter-source Agreements
Xiu Susie Fang, Quan Z. Sheng, Xianzhi Wang 0001, Mahmoud Barhamgi, Lina Yao 0001, Anne H. H. Ngu
ER3
2016 An Ensemble Approach for Better Truth Discovery
Xiu Susie Fang, Quan Z. Sheng, Xianzhi Wang 0001
ADMA3
2016 Truth Discovery via Exploiting Implications from Multi-Source Data
abstract
Data veracity is a grand challenge for various tasks on the Web. Since the web data sources are inherently unreliable and may provide conflicting information about the same real-world entities, truth discovery is emerging as a countermeasure of resolving the conflicts by discovering the truth, which conforms to the reality, from the multi-source data. A major challenge related to truth discovery is that different data items may have varying numbers of true values (or multi-truth), which counters the assumption of existing truth discovery methods that each data item should have exactly one true value. In this paper, we address this challenge by exploiting and leveraging the implications from multi-source data. In particular, we exploit three types of implications, namely the implicit negative claims, the distribution of positive/negative claims, and the co-occurrence of values in sources' claims, to facilitate multi-truth discovery. We propose a probabilistic approach with improvement measures that incorporate the three implications in all stages of truth discovery process. In particular, incorporating the negative claims enables multi-truth discovery, considering the distribution of positive/negative claims relieves truth discovery from the impact of sources' behavioral features in the specific datasets, and considering values' co-occurrence relationship compensates the information lost from evaluating each value in the same claims individually. Experimental results on three real-world datasets demonstrate the effectiveness of our approach.
Xianzhi Wang 0001, Quan Z. Sheng, Lina Yao 0001, Xue Li 0001, Xiu Susie Fang, Xiaofei Xu 0001, Boualem Benatallah
CIKM1
2016 Empowering Truth Discovery with Multi-Truth Prediction
abstract
Truth discovery is the problem of detecting true values from the conflicting data provided by multiple sources on the same data items. Since sources' reliability is unknown a priori, a truth discovery method usually estimates sources' reliability along with the truth discovery process. A major limitation of existing truth discovery methods is that they commonly assume exactly one true value on each data item and therefore cannot deal with the more general case that a data item may have multiple true values (or multi-truth). Since the number of true values may vary from data item to data item, this requires truth discovery methods being able to detect varying numbers of truth values from the multi-source data. In this paper, we propose a multi-truth discovery approach, which addresses the above challenges by providing a generic framework for enhancing existing truth discovery methods. In particular, we redeem the numbers of true values as an important clue for facilitating multi-truth discovery. We present the procedure and components of our approach, and propose three models, namely the byproduct model, the joint model, and the synthesis model to implement our approach. We further propose two extensions to enhance our approach, by leveraging the implications of similar numerical values and values' co-occurrence information in sources' claims to improve the truth discovery accuracy. Experimental studies on real-world datasets demonstrate the effectiveness of our approach.
Xianzhi Wang 0001, Quan Z. Sheng, Lina Yao 0001, Xue Li 0001, Xiu Susie Fang, Xiaofei Xu 0001, Boualem Benatallah
CIKM1
2015 Approximate Truth Discovery via Problem Scale Reduction
abstract
Many real-world applications rely on multiple data sources to provide information on their interested items. Due to the noises and uncertainty in data, given a specific item, the information from different sources may conflict. To make reliable decisions based on these data, it is important to identify the trustworthy information by resolving these conflicts, i.e., the truth discovery problem. Current solutions to this problem detect the veracity of each value jointly with the reliability of each source for each data item. In this way, the efficiency of truth discovery is strictly confined by the problem scale, which in turn limits truth discovery algorithms from being applicable on a large scale. To address this issue, we propose an approximate truth discovery approach, which divides sources and values into groups according to a user-specified approximation criterion. The groups are then used for efficient inter-value influence computation to improve the accuracy. Our approach is applicable to most existing truth discovery algorithms. Experiments on real-world datasets show that our approach improves the efficiency compared to existing algorithms while achieving similar or even better accuracy. The scalability is further demonstrated by experiments on large synthetic datasets.
Xianzhi Wang 0001, Quan Z. Sheng, Xiu Susie Fang, Xue Li 0001, Xiaofei Xu 0001, Lina Yao 0001
CIKM1
2015 An Integrated Bayesian Approach for Effective Multi-Truth Discovery
abstract
Truth-finding is the fundamental technique for corroborating reports from multiple sources in both data integration and collective intelligent applications. Traditional truth-finding methods assume a single true value for each data item and therefore cannot deal will multiple true values (i.e., the multi-truth-finding problem). So far, the existing approaches handle the multi-truth-finding problem in the same way as the single-truth-finding problems. Unfortunately, the multi-truth-finding problem has its unique features, such as the involvement of sets of values in claims, different implications of inter-value mutual exclusion, and larger source profiles. Considering these features could provide new opportunities for obtaining more accurate truth-finding results. Based on this insight, we propose an integrated Bayesian approach to the multi-truth-finding problem, by taking these features into account. To improve the truth-finding efficiency, we reformulate the multi-truth-finding problem model based on the mappings between sources and (sets of) values. New mutual exclusive relations are defined to reflect the possible co-existence of multiple true values. A finer-grained copy detection method is also proposed to deal with sources with large profiles. The experimental results on three real-world datasets show the effectiveness of our approach.
Xianzhi Wang 0001, Quan Z. Sheng, Xiu Susie Fang, Lina Yao 0001, Xiaofei Xu 0001, Xue Li 0001
CIKM1
2015 Context-aware Point-of-Interest Recommendation Using Tensor Factorization with Social Regularization
abstract
Point-of-Interest (POI) recommendation is a new type of recommendation task that comes along with the prevalence of location-based social networks in recent years. Compared with traditional tasks, it focuses more on personalized, context-aware recommendation results to provide better user experience. To address this new challenge, we propose a Collaborative Filtering method based on Non-negative Tensor Factorization, a generalization of the Matrix Factorization approach that exploits a high-order tensor instead of traditional User-Location matrix to model multi-dimensional contextual information. The factorization of this tensor leads to a compact model of the data which is specially suitable for context-aware POI recommendations. In addition, we fuse users' social relations as regularization terms of the factorization to improve the recommendation accuracy. Experimental results on real-world datasets demonstrate the effectiveness of our approach.
Lina Yao 0001, Quan Z. Sheng, Yongrui Qin, Xianzhi Wang 0001, Ali Shemshadi
SIGIR4