EDBT 2026 Demo / reviewers in the wild / expert
Guodong Long
dblp:34/10089
· DBLP profile ↗
47ranked-venue papers in the field
2as first author
26since 2021 · last 2026
0000-0003-3740-9515ORCID · verified
Domains — venue-derived; a paper can count in several
Data Mining & Knowledge Discovery · 28 (1 first)Information Retrieval & Web Search · 11 (1 first)Database Systems & Data Management · 7Knowledge Engineering, Semantic Web & Information Systems · 1
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | Learning Evolving Preferences: A Federated Continual Framework for User-Centric RecommendationabstractUser-centric recommendation has become essential for delivering personalized services, as it enables systems to adapt to users' evolving behaviors while respecting their long-term preferences and privacy constraints. Although federated learning offers a promising alternative to centralized training, existing approaches largely overlook user behavior dynamics, leading to temporal forgetting and weakened collaborative personalization. In this work, we propose FCUCR, a federated continual recommendation framework designed to support long-term personalization in a privacy-preserving manner. To address temporal forgetting, we introduce a time-aware self-distillation strategy that implicitly retains historical preferences during local model updates. To tackle collaborative personalization under heterogeneous user data, we design an inter-user prototype transfer mechanism that enriches each client's representation using knowledge from similar users while preserving individual decision logic. Extensive experiments on four public benchmarks demonstrate the superior effectiveness of our approach, along with strong compatibility and practical applicability. Code is available at https://github.com/Poizoner/code4FCUCR_www2026. Chunxu Zhang, Zhiheng Xue, Guodong Long, Bo Yang 0002 |
WWW | 3 |
| 2026 | Multimodal-enhanced Federated Recommendation: A Group-wise Fusion ApproachabstractFederated Recommendation (FR) has emerged as a promising paradigm for addressing the learn-to-rank problem in a privacy-preserving manner. However, effectively incorporating multimodal item features into FR remains an open challenge, due to efficiency constraints, distribution heterogeneity, and feature utilization alignment with the recommendation objective. To tackle these issues, we propose GFMFR, a novel multimodal fusion framework for federated recommendation. Specifically, multimodal representation learning is offloaded to the server, which stores item content and employs a high-capacity encoder to generate expressive representations, thereby alleviating the computational burden on clients. In addition, a group-aware multimodal aggregation mechanism learns shared representations for users with similar interests, enabling knowledge sharing while alleviating distribution heterogeneity. Finally, GFMFR adopts a preference-guided distillation strategy that leverages multimodal information in a way directly aligned with recommendation objectives. The proposed framework can be seamlessly integrated into existing federated recommender systems, enhancing their effectiveness by incorporating multimodal features. Extensive experiments on five benchmark datasets demonstrate that GFMFR consistently outperforms state-of-the-art multimodal FR baselines. The implementation code is available. https://github.com/Zhangwp2420/GFMFR. Chunxu Zhang, Guodong Long, Zhiheng Xue, Riting Xia, Bo Yang 0002 |
WWW | 3 |
| 2025 | cFedLoRA: Clustered Aggregation for Federated LoRA
Peng Yan 0002, Guodong Long |
ADMA (1) | 3 |
| 2025 | A Survey on Deep Learning based Time Series Analysis with Frequency TransformationabstractRecently, frequency transformation (FT) has been increasingly incorporated into deep learning models to significantly enhance state-of-the-art accuracy and efficiency in time series analysis. The advantages of FT, such as high efficiency and a global view, have been rapidly explored and exploited in various time series tasks and applications, demonstrating the promising potential of FT as a new deep learning paradigm for time series analysis. Despite the growing attention and the proliferation of research in this emerging field, there is currently a lack of a systematic review and in-depth analysis of deep learning-based time series models with FT. It is also unclear why FT can enhance time series analysis and what its limitations are in the field. To address these gaps, we present a comprehensive review that systematically investigates and summarizes the recent research advancements in deep learning-based time series analysis with FT. Specifically, we explore the primary approaches used in current models that incorporate FT, the types of neural networks that leverage FT, and the representative FT-equipped models in deep time series analysis. We propose a novel taxonomy to categorize the existing methods in this field, providing a structured overview of the diverse approaches employed in incorporating FT into deep learning models for time series analysis. Finally, we highlight the advantages and limitations of FT for time series modeling and identify potential future research directions that can further contribute to the community of time series analysis. Kun Yi 0001, Qi Zhang 0020, Wei Fan 0010, Longbing Cao, Shoujin Wang, Guodong Long, Liang Hu 0004, Qingsong Wen, Hui Xiong 0001 |
KDD (2) | 7 |
| 2025 | Beyond Dataset Watermarking: Model-Level Copyright Protection for Code Summarization Models
Jiale Zhang 0001, Di Wu 0050, Xiaobing Sun 0001, Qinghua Lu 0001, Guodong Long |
WWW | 6 |
| 2025 | eBaaS: AIoT-Enabled eBike Battery-Swap as a Service for Last-Mile DeliveryabstractIn China, the number of riders in the on-demand delivery industry has surpassed ten million. Ensuring that these riders earn a decent income can enhance their financial security, reduce poverty, and promote social equity and stability. Due to ease of use, lower-cost maintenance and environmental friendliness, electric bicycles (e-bikes) are the primary mode of transportation for delivery riders. However, these riders frequently encounter depleted batteries due to limited capacity and prolonged charging times, necessitating inconvenient swaps or recharges during deliveries. To address this issue, we propose the e-bike Battery Swap-as-a-Service (eBaaS), an innovative battery-swapping system that leverages an intelligent AIoT network for seamless battery swapping at distributed locations across urban areas. eBaaS integrates edge-cloud collaboration, battery resource allocation, battery anomaly detection, and battery range prediction to minimize downtime and reduce unnecessary mileage. While eBaaS's potential benefits are evident, there has been a lack of robust methods to quantify its impact. Thus, we further developed the eBaaS Impact Evaluation Method (EIEM), the first comprehensive model to address this gap. EIEM analyzes data from approximately 260,000 delivery riders and 5 million riding trajectories. Findings indicate that eBaaS reduces average invalid mileage by 6 km and increases the order volume by an average of over 20% daily per e-bike rider. Meanwhile, the annual electricity savings result in a reduction of 2.74 million kilograms of carbon emissions for 260,000 riders. The eBaaS system is therefore significantly beneficial for environmental conservation and sustainable urban development. Donghui Ding, Zhao Li 0007, Jiarun Zhang, Xuanwu Liu, Ji Zhang 0001, Yuchen Li 0001, Peng Cai 0001, Jianxun Liu 0001, Guodong Long |
WWW | 9 |
| 2025 | Adaptive Traffic Forecasting on Daily Basis: A Spatio-Temporal Context Learning ApproachabstractTraffic forecasting plays a crucial role in establishing an Intelligent Transportation System (ITS) by providing essential insights. Existing traffic forecasting relies on the assumption that there is a hidden invariant spatial-temporal pattern in the large-scale dataset. However, the traffic patterns are easily influenced by many unpredictable external factors, such as policy interventions and climate changes. Due to the dynamic nature of these exogenous factors, the traffic network's spatial-temporal patterns are also changed, thus impacting the performance of traffic forecasting models. Thus, there is an urgent need to rethink the traffic forecasting model in a fast-adaptive manner. To solve this challenge, this paper proposes an Adaptive Spatio-Temporal Context Learning framework named ASTCL, which achieves desired forecasting accuracy using daily basis traffic data collected from dozens of sensors. ASTCL constructs adaptive spatio-temporal contexts for target locations in the traffic network and generates dynamic sequence graphs based on semantic similarities. The adaptive contexts aggregate valuable information from available data, while the graphs reveal dynamic trends in traffic properties. Further, ASTCL introduces a joint convolution and attention mechanism to model intricate spatio-temporal relationships from multiple perspectives. Extensive experiments conducted on four real-world datasets demonstrate that ASTCL achieves remarkable fast adaptability and outperforms other state-of-the-art methods by a significant margin. Guodong Long, Yupeng Hu 0003, Wenpeng Lu, Meng Chen 0003, Chengqi Zhang, Yongshun Gong |
IEEE Trans. Knowl. Data Eng. | 3 |
| 2025 | Personalized Recommendation Models in Federated Settings: A SurveyabstractFederated recommender systems (FedRecSys) have emerged as a pivotal solution for privacy-aware recommendations, balancing growing demands for data security and personalized experiences. Current research efforts predominantly concentrate on adapting traditional recommendation architectures to federated environments, optimizing communication efficiency, and mitigating security vulnerabilities. However, user personalization modeling, which is essential for capturing heterogeneous preferences in this decentralized and non-IID data setting, remains underexplored. This survey addresses this gap by systematically exploring personalization in FedRecSys, charting its evolution from centralized paradigms to federated-specific innovations. We establish a foundational definition of personalization in a federated setting, emphasizing personalized models as a critical solution for capturing fine-grained user preferences. The work critically examines the technical hurdles of building personalized FedRecSys and synthesizes promising methodologies to meet these challenges. As the first consolidated study in this domain, this survey serves as both a technical reference and a catalyst for advancing personalized FedRecSys research. Chunxu Zhang, Guodong Long, Zijian Zhang 0009, Zhiwei Li 0007, Honglei Zhang 0002, Qiang Yang 0001, Bo Yang 0002 |
IEEE Trans. Knowl. Data Eng. | 2 |
| 2024 | GPFedRec: Graph-Guided Personalization for Federated RecommendationabstractThe federated recommendation system is an emerging AI service architecture that provides recommendation services in a privacy-preserving manner. Using user-relation graphs to enhance federated recommendations is a promising topic. However, it is still an open challenge to construct the user-relation graph while preserving data locality-based privacy protection in federated settings. Inspired by a simple motivation, similar users share a similar vision (embeddings) to the same item set, this paper proposes a novel Graph-guided Personalization for Federated Recommendation (GPFedRec). The proposed method constructs a user-relation graph from user-specific personalized item embeddings at the server without accessing the users' interaction records. The personalized item embedding is locally fine-tuned on each device, and then a user-relation graph will be constructed by measuring the similarity among client-specific item embeddings. Without accessing users' historical interactions, we embody the data locality-based privacy protection of vanilla federated learning. Furthermore, a graph-guided aggregation mechanism is designed to leverage the user-relation graph and federated optimization framework simultaneously. Extensive experiments on five benchmark datasets demonstrate GPFedRec's superior performance. The in-depth study validates that GPFedRec can generally improve existing federated recommendation methods as a plugin while keeping user privacy safe. Code is available https://github.com/Zhangcx19/GPFedRec Chunxu Zhang, Guodong Long, Tianyi Zhou 0001, Zijian Zhang 0009, Peng Yan 0002, Bo Yang 0002 |
KDD | 2 |
| 2024 | Boosting Patient Representation Learning via Graph Contrastive Learning
Yuxi Liu 0003, Jiang Bian 0001, Antonio Jimeno-Yepes, Jun Shen 0001, Fuyi Li, Guodong Long, Flora D. Salim |
ECML/PKDD (9) | 7 |
| 2024 | When Federated Recommendation Meets Cold-Start Problem: Separating Item Attributes and User InteractionsabstractFederated recommendation system usually trains a global model on the server without direct access to users' private data on their own devices. However, this separation of the recommendation model and users' private data poses a challenge in providing quality service, particularly when it comes to new items, namely cold-start recommendations in federated settings. This paper introduces a novel method called Item-aligned Federated Aggregation (IFedRec) to address this challenge. It is the first research work in federated recommendation to specifically study the cold-start scenario. The proposed method learns two sets of item representations by leveraging item attributes and interaction records simultaneously. Additionally, an item representation alignment mechanism is designed to align two item representations and learn the meta attribute network at the server within a federated learning framework. Experiments on four benchmark datasets demonstrate IFedRec's superior performance for cold-start scenarios. Furthermore, we also verify IFedRec owns good robustness when the system faces limited client participation and noise injection, which brings promising practical application potential in privacy-protection enhanced federated recommendation systems. The implementation code is available Chunxu Zhang, Guodong Long, Tianyi Zhou 0001, Zijian Zhang 0009, Peng Yan 0002, Bo Yang 0002 |
WWW | 2 |
| 2024 | Dyformer: A dynamic transformer-based architecture for multivariate time series classification
Chao Yang 0024, Xianzhi Wang 0001, Lina Yao 0001, Guodong Long, Guandong Xu |
Inf. Sci. | 4 |
| 2023 | Multi-level Transformer for Cancer Outcome Prediction in Large-Scale Claims Data
Leah Gerrard, Xueping Peng, Allison Clarke, Guodong Long |
ADMA (3) | 4 |
| 2023 | Soft Prompt Transfer for Zero-Shot and Few-Shot Learning in EHR Understanding
Yang Wang 0002, Xueping Peng, Tao Shen 0001, Allison Clarke, Clement Schlegel, Paul Martin 0014, Guodong Long |
ADMA (3) | 7 |
| 2023 | Improving Open-Domain Answer Sentence Selection by Distributed Clients with Privacy Preservation
Weikuan Wang, Tao Shen 0001, Michael Blumenstein, Guodong Long |
ADMA (5) | 4 |
| 2023 | From Time Series to Multi-modality: Classifying Multivariate Time Series via Both 1D and 2D Representations
Chao Yang 0024, Xianzhi Wang 0001, Lina Yao 0001, Guodong Long, Guandong Xu |
ADMA (1) | 4 |
| 2023 | UnifieR: A Unified Retriever for Large-Scale RetrievalabstractLarge-scale retrieval is to recall relevant documents from a huge collection given a query. It relies on representation learning to embed documents and queries into a common semantic encoding space. According to the encoding space, recent retrieval methods based on pre-trained language models (PLM) can be coarsely categorized into either dense-vector or lexicon-based paradigms. These two paradigms unveil the PLMs' representation capability in different granularities, i.e., global sequence-level compression and local word-level contexts, respectively. Inspired by their complementary global-local contextualization and distinct representing views, we propose a new learning framework, Unifier, which unifies dense-vector and lexicon-based retrieval in one model with a dual-representing capability. Experiments on passage retrieval benchmarks verify its effectiveness in both paradigms. A uni-retrieval scheme is further presented with even better retrieval quality. We lastly evaluate the model on BEIR benchmark to verify its transferability. Tao Shen 0001, Xiubo Geng, Chongyang Tao, Can Xu 0002, Guodong Long, Kai Zhang 0033, Daxin Jiang |
KDD | 5 |
| 2023 | Voting from Nearest Tasks: Meta-Vote Pruning of Pre-trained Models for Downstream Tasks
Tianyi Zhou 0001, Guodong Long, Jing Jiang 0002, Chengqi Zhang |
ECML/PKDD (2) | 3 |
| 2023 | Beyond Low-Pass Filtering: Graph Convolutional Networks With Automatic FilteringabstractGraph convolutional networks are becoming indispensable for deep learning from graph-structured data. Most of the existing graph convolutional networks share two big shortcomings. First, they are essentially low-pass filters, thus the potentially useful middle and high frequency band of graph signals are ignored. Second, the bandwidth of existing graph convolutional filters is fixed. Parameters of a graph convolutional filter only transform the graph inputs without changing the curvature of a graph convolutional filter function. In reality, we are uncertain about whether we should retain or cut off the frequency at a certain point unless we have expert domain knowledge. In this paper, we propose Automatic Graph Convolutional Networks (AutoGCN) to capture the full spectrum of graph signals and automatically update the bandwidth of graph convolutional filters. While it is based on graph spectral theory, our AutoGCN is also localized in space and has a spatial form. Experimental results show that AutoGCN achieves significant improvement over baseline methods which only work as low-pass filters. Zonghan Wu, Shirui Pan, Guodong Long, Jing Jiang 0002, Chengqi Zhang |
IEEE Trans. Knowl. Data Eng. | 3 |
| 2022 | Personalized Federated Learning with Robust Clustering Against Model Poisoning
Guodong Long |
ADMA (2) | 3 |
| 2022 | Positive Unlabeled Learning by Sample Selection and Prototype Refinement
Zhuowei Wang 0003, Guodong Long |
ADMA (1) | 2 |
| 2022 | EventBERT: A Pre-Trained Model for Event Correlation ReasoningabstractEvent correlation reasoning infers whether a natural language paragraph containing multiple events conforms to human common sense. For example, “Andrew was very drowsy, so he took a long nap, and now he is very alert” is sound and reasonable. In contrast, “Andrew was very drowsy, so he stayed up a long time, now he is very alert” does not comply with human common sense. Such reasoning capability is essential for many downstream tasks, such as script reasoning, abductive reasoning, narrative incoherence, story cloze test, etc. However, conducting event correlation reasoning is challenging due to a lack of large amounts of diverse event-based knowledge and difficulty in capturing correlation among multiple events. In this paper, we propose EventBERT, a pre-trained model to encapsulate eventuality knowledge from unlabeled text. Specifically, we collect a large volume of training examples by identifying natural language paragraphs that describe multiple correlated events and further extracting event spans in an unsupervised manner. We then propose three novel event- and correlation-based learning objectives to pre-train an event correlation model on our created training corpus. Experimental results show EventBERT outperforms strong baselines on four downstream tasks, and achieves state-of-the-art results on most of them. Moreover, it outperforms existing pre-trained models by a large margin, e.g., 6.5 ∼ 23%, in zero-shot learning of these tasks. Yucheng Zhou 0001, Xiubo Geng, Tao Shen 0001, Guodong Long, Daxin Jiang |
WWW | 4 |
| 2022 | Many-Class Few-Shot Learning on Multi-Granularity Class HierarchyabstractWe study many-class few-shot (MCFS) problem in both supervised learning and meta-learning settings. Compared to the well-studied many-class many-shot and few-class few-shot problems, the MCFS problem commonly occurs in practical applications but has been rarely studied in previous literature. It brings new challenges of distinguishing between many classes given only a few training samples per class. In this article, we leverage the class hierarchy as a prior knowledge to train a coarse-to-fine classifier that can produce accurate predictions for MCFS problem in both settings. The propose model, “memory-augmented hierarchical-classification network (MahiNet)”, performs coarse-to-fine classification where each coarse class can cover multiple fine classes. Since it is challenging to directly distinguish a variety of fine classes given few-shot data per class, MahiNet starts from learning a classifier over coarse-classes with more training data whose labels are much cheaper to obtain. The coarse classifier reduces the searching range over the fine classes and thus alleviates the challenges from “many classes”. On architecture, MahiNet first deploys a convolutional neural network (CNN) to extract features. It then integrates a memory-augmented attention module and a multi-layer perceptron (MLP) together to produce the probabilities over coarse and fine classes. While the MLP extends the linear classifier, the attention module extends the KNN classifier, both together targeting the “few-shot” problem. We design several training strategies of MahiNet for supervised learning and meta-learning. In addition, we propose two novel benchmark datasets “mcfsImageNet” (as a subset of ImageNet) and “mcfsOmniglot” (re-splitted Omniglot) specially designed for MCFS problem. In experiments, we show that MahiNet outperforms several state-of-the-art models (e.g., prototypical networks and relation networks) on MCFS problems in both supervised learning and meta-learning. Lu Liu 0019, Tianyi Zhou 0001, Guodong Long, Jing Jiang 0002, Chengqi Zhang |
IEEE Trans. Knowl. Data Eng. | 3 |
| 2021 | Sequential Diagnosis Prediction with Transformer and Ontological RepresentationabstractSequential diagnosis prediction on the Electronic Health Record (EHR) has been proven crucial for predictive analytics in the medical domain. EHR data, sequential records of a patient’s interactions with healthcare systems, has numerous inherent characteristics of temporality, irregularity and data insufficiency. Some recent works train healthcare predictive models by making use of sequential information in EHR data, but they are vulnerable to irregular, temporal EHR data with the states of admission/discharge from hospital, and insufficient data. To mitigate this, we propose an end-to-end robust transformer-based model called SETOR, which exploits neural ordinary differential equation to handle both irregular intervals between a patient’s visits with admitted timestamps and length of stay in each visit, to alleviate the limitation of insufficient data by integrating medical ontology, and to capture the dependencies between the patient’s visits by employing multi-layer transformer blocks. Experiments conducted on two real-world healthcare datasets show that, our sequential diagnoses prediction model SETOR not only achieves better predictive results than previous state-of-the-art approaches, irrespective of sufficient or insufficient training data, but also derives more interpretable embeddings of medical codes. The experimental codes are available at the GitHub repository1.1Github repository: https://github.com/Xueping/SETOR Xueping Peng, Guodong Long, Tao Shen 0001, Sen Wang 0001, Jing Jiang 0002 |
ICDM | 2 |
| 2021 | Structure-Augmented Text Representation Learning for Efficient Knowledge Graph CompletionabstractHuman-curated knowledge graphs provide critical supportive information to various natural language processing tasks, but these graphs are usually incomplete, urging auto-completion of them (a.k.a. knowledge graph completion). Prevalent graph embedding approaches, e.g., TransE, learn structured knowledge via representing graph elements (i.e., entities/relations) into dense embeddings and capturing their triple-level relationship with spatial distance. However, they are hardly generalizable to the elements never visited in training and are intrinsically vulnerable to graph incompleteness. In contrast, textual encoding approaches, e.g., KG-BERT, resort to graph triple’s text and triple-level contextualized representations. They are generalizable enough and robust to the incompleteness, especially when coupled with pre-trained encoders. But two major drawbacks limit the performance: (1) high overheads due to the costly scoring of all possible triples in inference, and (2) a lack of structured knowledge in the textual encoder. In this paper, we follow the textual encoding paradigm and aim to alleviate its drawbacks by augmenting it with graph embedding techniques – a complementary hybrid of both paradigms. Specifically, we partition each triple into two asymmetric parts as in translation-based graph embedding approach, and encode both parts into contextualized representations by a Siamese-style textual encoder. Built upon the representations, our model employs both deterministic classifier and spatial measurement for representation and structure learning respectively. It thus reduces the overheads by reusing graph elements’ embeddings to avoid combinatorial explosion, and enhances structured knowledge by exploring the spatial characteristics. Moreover, we develop a self-adaptive ensemble scheme to further improve the performance by incorporating triple scores from an existing graph embedding model. In experiments, we achieve state-of-the-art performance on three benchmarks and a zero-shot dataset for link prediction, with highlights of inference costs reduced by 1-2 orders of magnitude compared to a sophisticated textual encoding method. Bo Wang 0069, Tao Shen 0001, Guodong Long, Tianyi Zhou 0001, Ying Wang 0009, Yi Chang 0001 |
WWW | 3 |
| 2021 | Exploring BCI Control in Smart Environments: Intention Recognition Via EEG Representation Enhancement LearningabstractThe brain–computer interface (BCI) control technology that utilizes motor imagery to perform the desired action instead of manual operation will be widely used in smart environments. However, most of the research lacks robust feature representation of multi-channel EEG series, resulting in low intention recognition accuracy. This article proposes an EEG2Image based Denoised-ConvNets (called EID) to enhance feature representation of the intention recognition task. Specifically, we perform signal decomposition, slicing, and image mapping to decrease the noise from the irrelevant frequency bands. After that, we construct the Denoised-ConvNets structure to learn the colorspace and spatial variations of image objects without cropping new training images precisely. Toward further utilizing the color and spatial transformation layers, the colorspace and colored area of image objects have been enhanced and enlarged, respectively. In the multi-classification scenario, extensive experiments on publicly available EEG datasets confirm that the proposed method has better performance than state-of-the-art methods. Lin Yue, Sen Wang 0001, Robert Boots, Guodong Long, Weitong Chen 0001, Xiaowei Zhao 0004 |
ACM Trans. Knowl. Discov. Data | 5 |
| 2020 | BiteNet: Bidirectional Temporal Encoder Network to Predict Medical OutcomesabstractElectronic health records (EHRs) are longitudinal records of a patient's interactions with healthcare systems. A patient's EHR data is organized as a three-level hierarchy from top to bottom: patient journey - all the experiences of diagnoses and treatments over a period of time; individual visit - a set of medical codes in a particular visit; and medical code - a specific record in the form of medical codes. As EHRs begin to amass in millions, the potential benefits, which these data might hold for medical research and medical outcome prediction, are staggering - including, for example, predicting future admissions to hospitals, diagnosing illnesses or determining the efficacy of medical treatments. Each of these analytics tasks requires a domain knowledge extraction method to transform the hierarchical patient journey into a vector representation for further prediction procedure. The representations should embed a sequence of visits and a set of medical codes with a specific timestamp, which are crucial to any downstream prediction tasks. Hence, expressively powerful representations are appealing to boost learning performance. To this end, we propose a novel self-attention mechanism that captures the contextual dependency and temporal relationships within a patient's healthcare journey. An end-to-end bidirectional temporal encoder network (BiteNet) then learns representations of the patient's journeys, based solely on the proposed attention mechanism. We have evaluated the effectiveness of our methods on two supervised prediction and two unsupervised clustering tasks with a real-world EHR dataset. The empirical results demonstrate the proposed BiteNet model produces higher-quality representations than state-of-the-art baseline methods. Xueping Peng, Guodong Long, Tao Shen 0001, Sen Wang 0001, Jing Jiang 0002, Chengqi Zhang |
ICDM | 2 |
| 2020 | Cross-Graph: Robust and Unsupervised Embedding for Attributed Graphs with Corrupted StructureabstractGraph embedding has shown its effectiveness to represent graph information and capture deep relationships in graph data. Most recent graph embedding methods focus on attributed graphs, since they preserve both structure and content information in the network. However, corruption can exist in the graph structure as well as the node content of the graph, and both can lead to inferior embedding results. Unfortunately, few existing graph embedding algorithms have considered the corruption problem, and to the best of our knowledge, none has studied structural corruption in attributed graphs, including missing and redundant edges. This field is difficult for previous methods, mainly due to two challenges: (1) the existence of various corruption causes has made it difficult to recognize corruptions in graphs, and (2) the complexity of graph-structured data has increased the difficulty of handling corruption therein for graph embedding methods. These facts lead us here to propose a novel autoencoder-based graph embedding approach, which is robust against structural corruption. Our idea comes from the recent discovery of memorization effects in deep learning. Namely, deep neural networks prefer to fit clean data first, before they over-fit corrupted data. Specifically, we train two autoencoders simultaneously and let them learn the reliability of the edges in the graph from each other. The two autoencoders would evaluate the edges according to their reconstructed structure and manipulate this by devaluing those distrusted edges to update the structure information. The updated structure would be used further in the next iteration as the ground-truth of its peer-network. Experiments on different versions of real-world graphs show state-of-the-art results and demonstrate the robustness of our model against structural corruption. Bo Han 0003, Shirui Pan, Jing Jiang 0002, Gang Niu 0001, Guodong Long |
ICDM | 6 |
| 2020 | Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural NetworksabstractModeling multivariate time series has long been a subject that has attracted researchers from a diverse range of fields including economics, finance, and traffic. A basic assumption behind multivariate time series forecasting is that its variables depend on one another but, upon looking closely, it is fair to say that existing methods fail to fully exploit latent spatial dependencies between pairs of variables. In recent years, meanwhile, graph neural networks (GNNs) have shown high capability in handling relational dependencies. GNNs require well-defined graph structures for information propagation which means they cannot be applied directly for multivariate time series where the dependencies are not known in advance. In this paper, we propose a general graph neural network framework designed specifically for multivariate time series data. Our approach automatically extracts the uni-directed relations among variables through a graph learning module, into which external knowledge like variable attributes can be easily integrated. A novel mix-hop propagation layer and a dilated inception layer are further proposed to capture the spatial and temporal dependencies within the time series. The graph learning, graph convolution, and temporal convolution modules are jointly learned in an end-to-end framework. Experimental results show that our proposed model outperforms the state-of-the-art baseline methods on 3 of 4 benchmark datasets and achieves on-par performance with other approaches on two traffic datasets which provide extra structural information. Zonghan Wu, Shirui Pan, Guodong Long, Jing Jiang 0002, Xiaojun Chang, Chengqi Zhang |
KDD | 3 |
| 2020 | Confusable Learning for Large-Class Few-Shot Classification
Bingcong Li, Bo Han 0003, Zhuowei Wang 0003, Jing Jiang 0002, Guodong Long |
ECML/PKDD (2) | 5 |
| 2020 | Self-attention Enhanced Patient Journey Understanding in Healthcare System
Xueping Peng, Guodong Long, Tao Shen 0001, Sen Wang 0001, Jing Jiang 0002 |
ECML/PKDD (3) | 2 |
| 2019 | Temporal Self-Attention Network for Medical Concept EmbeddingabstractIn longitudinal electronic health records (EHRs), the event records of a patient are distributed over a long period of time and the temporal relations between the events reflect sufficient domain knowledge to benefit prediction tasks such as the rate of inpatient mortality. Medical concept embedding as a feature extraction method that transforms a set of medical concepts with a specific time stamp into a vector, which will be fed into a supervised learning algorithm. The quality of the embedding significantly determines the learning performance over the medical data. In this paper, we propose a medical concept embedding method based on applying a self-attention mechanism to represent each medical concept. We propose a novel attention mechanism which captures the contextual information and temporal relationships between medical concepts. A light-weight neural net, "Temporal Self-Attention Network (TeSAN)", is then proposed to learn medical concept embedding based solely on the proposed attention mechanism. To test the effectiveness of our proposed methods, we have conducted clustering and prediction tasks on two public EHRs datasets comparing TeSAN against five state-of-the-art embedding methods. The experimental results demonstrate that the proposed TeSAN model is superior to all the compared methods. To the best of our knowledge, this work is the first to exploit temporal self-attentive relations between medical events. Xueping Peng, Guodong Long, Tao Shen 0001, Sen Wang 0001, Jing Jiang 0002, Michael Blumenstein |
ICDM | 2 |
| 2019 | Collective Protection: Preventing Sensitive Inferences via Integrative TransformationabstractSharing ubiquitous mobile sensor data, especially physiological data, raises potential risks of leaking physical and demographic information that can be inferred from the time series sensor data. Existing sensitive information protection mechanisms that depend on data transformation are effective only on a particular sensitive attribute, together with usually requiring the labels of sensitive information for training. Considering this gap, we propose a novel user sensitive information protection framework without using a sensitive training dataset or being validated on protecting only one specific sensitive information. The presented approach transforms raw sensor data into a new format that has a "style" (sensitive information) of random noise and a "content" (desired information) of the raw sensor data, thus is free of user sensitive information for training and able to collectively protect all sensitive information at once. Our implementation and experiments on two real-world multisensor human activity datasets demonstrate that the proposed data transformation technique can achieve the protection for all sensitive information at once without requiring the knowledge of users' personal attributes for training, and simultaneously preserve the usability of the new transformed data with regard to inferring human activities with insignificant performance loss. Dalin Zhang 0001, Lina Yao 0001, Kaixuan Chen 0001, Guodong Long, Sen Wang 0001 |
ICDM | 4 |
| 2018 | Dynamic Illness Severity Prediction via Multi-task RNNs for Intensive Care UnitabstractMost of the existing analytics on ICU data mainly focus on mortality risk prediction and phenotyping analysis. However, they have limitations in providing sufficient evidence for decision making in a dynamically changing clinical environment. In this paper, we propose a novel approach that simultaneously analyses different organ systems to predict the illness severity of patients in an ICU, which can intuitively reflect the condition of the patients in a timely fashion. Specifically, we develop a novel deep learning model, namely MTRNN-ATT, which is based on multi-task recurrent neural networks. The physiological features of each organ system in time-series representations are learned by a single long short-term memory unit as a specific task. To utilize the relationships between organ systems, we use a shared LSTM unit to exploit the correlations between different tasks for further performance improvement. Also, we apply an attention mechanism in our deep model to learn the selective features at each stage to achieve better prediction results. We conduct extensive experiments on a real-world clinical dataset (MIMIC-III) to compare our method with many state-of-the-art methods. The experiment results demonstrate that the proposed approach performs better on the prediction tasks of illness severity scores. Weitong Chen 0001, Sen Wang 0001, Guodong Long, Lina Yao 0001, Quan Z. Sheng, Xue Li 0001 |
ICDM | 3 |
| 2017 | Graph Ladder Networks for Network ClassificationabstractNumerous network representation-based algorithms for network classification have emerged in recent years, but many suffer from two limitations. First, they separate the network representation learning and node classification in networks into two steps, which may result in sub-optimal results because the node representation may not fit the classification model well, and vice versa. Second, they are mostly shallow methods that can only capture the linear and simple relationships in the data. In this paper, we propose an effective deep learning model, Graph Ladder Networks (GLN), for node classification in networks. Our model learns a ladder network which unifies the representation learning and network classification into one single framework by exploiting both labeled and unlabeled nodes in a network. To integrate both structure and node content information in the networks, the most recently developed graph convolution network, is further employed. The experiments on the most popular academic network dataset, Citeseer, demonstrate that our approach reaches outstanding performance compared to other state-of-the-art algorithms. Ruiqi Hu, Shirui Pan, Jing Jiang 0002, Guodong Long |
CIKM | 4 |
| 2017 | MGAE: Marginalized Graph Autoencoder for Graph ClusteringabstractGraph clustering aims to discovercommunity structures in networks, the task being fundamentally challenging mainly because the topology structure and the content of the graphs are difficult to represent for clustering analysis. Recently, graph clustering has moved from traditional shallow methods to deep learning approaches, thanks to the unique feature representation learning capability of deep learning. However, existing deep approaches for graph clustering can only exploit the structure information, while ignoring the content information associated with the nodes in a graph. In this paper, we propose a novel marginalized graph autoencoder (MGAE) algorithm for graph clustering. The key innovation of MGAE is that it advances the autoencoder to the graph domain, so graph representation learning can be carried out not only in a purely unsupervised setting by leveraging structure and content information, it can also be stacked in a deep fashion to learn effective representation. From a technical viewpoint, we propose a marginalized graph convolutional network to corrupt network node content, allowing node content to interact with network features, and marginalizes the corrupted features in a graph autoencoder context to learn graph feature representations. The learned features are fed into the spectral clustering algorithm for graph clustering. Experimental results on benchmark datasets demonstrate the superior performance of MGAE, compared to numerous baselines. Shirui Pan, Guodong Long, Xingquan Zhu 0001, Jing Jiang 0002 |
CIKM | 3 |
| 2017 | Boosting for graph classification with universum
Shirui Pan, Jia Wu 0001, Xingquan Zhu 0001, Guodong Long, Chengqi Zhang |
Knowl. Inf. Syst. | 4 |
| 2017 | Learning Multiple Diagnosis Codes for ICU Patients with Local Disease Correlation MiningabstractIn the era of big data, a mechanism that can automatically annotate disease codes to patients’ records in the medical information system is in demand. The purpose of this work is to propose a framework that automatically annotates the disease labels of multi-source patient data in Intensive Care Units (ICUs). We extract features from two main sources, medical charts and notes. The Bag-of-Words model is used to encode the features. Unlike most of the existing multi-label learning algorithms that globally consider correlations between diseases, our model learns disease correlation locally in the patient data. To achieve this, we derive a local disease correlation representation to enrich the discriminant power of each patient data. This representation is embedded into a unified multi-label learning framework. We develop an alternating algorithm to iteratively optimize the objective function. Extensive experiments have been conducted on a real-world ICU database. We have compared our algorithm with representative multi-label learning algorithms. Evaluation results have shown that our proposed method has state-of-the-art performance in the annotation of multiple diagnostic codes for ICU patients. This study suggests that problems in the automated diagnosis code annotation can be reliably addressed by using a multi-label learning model that exploits disease correlation. The findings of this study will greatly benefit health care and management in ICU considering that the automated diagnosis code annotation can significantly improve the quality and management of health care for both patients and caregivers. Sen Wang 0001, Xue Li 0001, Xiaojun Chang, Lina Yao 0001, Quan Z. Sheng, Guodong Long |
ACM Trans. Knowl. Discov. Data | 6 |
| 2016 | Global and Local Influence-based Social RecommendationabstractSocial recommendation has been widely studied in recent years. Existing social recommendation models use various explicit pieces of social information as regularization terms in recommendation, for instance, social links are considered as new constraints. However, social influence, an implicit source of information in social networks, is seldomly considered, even though it often drives recommendations in social networks. In this paper, we introduce a new global and local influence-based social recommendation model. Based on the observation that user purchase behaviour is influenced by both global influential nodes and the local influential nodes of the user, we formulate the global and local influence as an regularization terms, and incorporate them into a matrix factorization-based recommendation model. Experimental results on large data sets demonstrate the performance of the proposed method. Qinzhe Zhang, Jia Wu 0001, Hong Yang 0003, Weixue Lu, Guodong Long, Chengqi Zhang |
CIKM | 5 |
| 2016 | Inferring Latent Network from Cascade Data for Dynamic Social RecommendationabstractSocial recommendation explores social information to improve the quality of a recommender system. It can be further divided into explicit and implicit social network recommendation. The former assumes the existence of explicit social connections between users in addition to the rating data. The latter one assumes the availability of only the ratings but not the social connections between users since the explicit social information data may not necessarily be available and usually are binary decision values (e.g., whether two people are friends), while the strength of their relationships is missing. Most of the works in this field use only rating data to infer the latent social networks. They ignore the dynamic nature of users that the preferences of users drift over time distinctly. To this end, we propose a new Implicit Dynamic Social Recommendation (IDSR) model, which infers latent social network from cascade data. It can sufficiently mine the information contained in time by mining the cascade data and identify the dynamic changes in the users in time by using the latest updated social network to make recommendations. Experiments and comparisons on three real-world datasets show that the proposed model outperforms the state-of-the-art solutions in both explicit and implicit scenarios. Qin Zhang 0011, Jia Wu 0001, Peng Zhang 0001, Guodong Long, Ivor W. Tsang, Chengqi Zhang |
ICDM | 4 |
| 2016 | Exploring Heterogeneous Product Networks for Discovering Collective Marketing Hyping Behavior
Qinzhe Zhang, Qin Zhang 0011, Guodong Long, Peng Zhang 0001, Chengqi Zhang |
PAKDD (1) | 3 |
| 2016 | Diagnosis Code Assignment Using Sparsity-Based Disease Correlation EmbeddingabstractWith the latest developments in database technologies, it becomes easier to store the medical records of hospital patients from their first day of admission than was previously possible. In Intensive Care Units (ICU), modern medical information systems can record patient events in relational databases every second. Knowledge mining from these huge volumes of medical data is beneficial to both caregivers and patients. Given a set of electronic patient records, a system that effectively assigns the disease labels can facilitate medical database management and also benefit other researchers, e.g., pathologists. In this paper, we have proposed a framework to achieve that goal. Medical chart and note data of a patient are used to extract distinctive features. To encode patient features, we apply a Bag-of-Words encoding method for both chart and note data. We also propose a model that takes into account both global information and local correlations between diseases. Correlated diseases are characterized by a graph structure that is embedded in our sparsity-based framework. Our algorithm captures the disease relevance when labeling disease codes rather than making individual decision with respect to a specific disease. At the same time, the global optimal values are guaranteed by our proposed convex objective function. Extensive experiments have been conducted on a real-world large-scale ICU database. The evaluation results demonstrate that our method improves multi-label classification results by successfully incorporating disease correlations. Sen Wang 0001, Xiaojun Chang, Xue Li 0001, Guodong Long, Lina Yao 0001, Quan Z. Sheng |
IEEE Trans. Knowl. Data Eng. | 4 |
| 2016 | Online Learning from Trapezoidal Data StreamsabstractIn this paper, we study a new problem of continuous learning from doubly-streaming data where both data volume and feature space increase over time. We refer to the doubly-streaming data as trapezoidal data streams and the corresponding learning problem as online learning from trapezoidal data streams. The problem is challenging because both data volume and data dimension increase over time, and existing online learning[1],[2], online feature selection[3], and streaming feature selection algorithms[4],[5]are inapplicable. We propose a new Online Learning with Streaming Features algorithm (OL$_{SF}$for short) and its two variants, which combine online learning[1],[2]and streaming feature selection[4],[5]to enable learning from trapezoidal data streams with infinite training instances and features. When a new training instance carrying new features arrives, a classifier updates the existing features by following the passive-aggressive update rule[2]and updates the new features by following the structural risk minimization principle. Feature sparsity is then introduced by using the projected truncation technique. We derive performance bounds of the OL$_{SF}$algorithm and its variants. We also conduct experiments on real-world data sets to show the performance of the proposed algorithms. Qin Zhang 0011, Peng Zhang 0001, Guodong Long, Wei Ding 0003, Chengqi Zhang, Xindong Wu 0001 |
IEEE Trans. Knowl. Data Eng. | 3 |
| 2015 | Invariant Event Tracking on Social Networks
Sayan Unankard, Xue Li 0001, Guodong Long |
DASFAA (2) | 3 |
| 2015 | Towards Mining Trapezoidal Data StreamsabstractWe study a new problem of learning from doubly-streaming data where both data volume and feature space increase over time. We refer to the problem as mining trapezoidal data streams. The problem is challenging because both data volume and feature space are increasing, to which existing online learning, online feature selection and streaming feature selection algorithms are inapplicable. We propose a new Sparse Trapezoidal Streaming Data mining algorithm (STSD) and its two variants which combine online learning and online feature selection to enable learning trapezoidal data streams with infinite training instances and features. Specifically, when new training instances carrying new features arrive, the classifier updates the existing features by following the passive-aggressive update rule used in online learning and updates the new features with the structural risk minimization principle. Feature sparsity is also introduced using the projected truncation techniques. Extensive experiments on the demonstrated UCI data sets show the performance of the proposed algorithms. Qin Zhang 0011, Peng Zhang 0001, Guodong Long, Wei Ding 0003, Chengqi Zhang, Xindong Wu 0001 |
ICDM | 3 |
| 2013 | Graph Based Feature Augmentation for Short and Sparse Text Classification
Guodong Long, Jing Jiang 0002 |
ADMA (1) | 1 |
| 2012 | TCSST: transfer classification of short & sparse text using external dataabstractShort & sparse text is becoming more prevalent on the web, such as search snippets, micro-blogs and product reviews. Accurately classifying short & sparse text has emerged as an important while challenging task. Existing work has considered utilizing external data (e.g. Wikipedia) to alleviate data sparseness, by appending topics detected from external data as new features. However, training a classifier on features concatenated from different spaces is not easy considering the features have different physical meanings and different significance to the classification task. Moreover, it exacerbates the "curse of dimensionality" problem. In this study, we propose a transfer classification method, TCSST, to exploit the external data to tackle the data sparsity issue. The transfer classifier will be learned in the original feature space. Considering that the labels of the external data may not be readily available or sufficiently enough, TCSST further exploits the unlabeled external data to aid the transfer classification. We develop novel strategies to allow TCSST to iteratively select high quality unlabeled external data to help with the classification. We evaluate the performance of TCSST on both benchmark as well as real-world data sets. Our experimental results demonstrate that the proposed method is effective in classifying very short & sparse text, consistently outperforming existing and baseline methods. Guodong Long, Ling Chen 0006, Xingquan Zhu 0001, Chengqi Zhang |
CIKM | 1 |