VLDB 2026 Research / reviewers in the wild / expert
Yuwei Wang 0003
dblp:22/335-3
· DBLP profile ↗
29ranked-venue papers
0as first author
27since 2021 · last 2026
0000-0002-3228-7371ORCID · conflict
Domains — the database's venue-derived domains; a paper can count in several
Computer networks · 16 · 14 since 2021Databases, data management, data science and information retrieval · 6 · 6 since 2021Artificial intelligence and machine learning · 4 · 4 since 2021Systems, architecture and hardware · 3 · 3 since 2021Applied, interdisciplinary, general and emerging computing · 3 · 3 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 since 2021
| Year | Publication | Venue | Position |
|---|---|---|---|
| 2026 | Re-architecting Personalized Federated Learning for Demanding Edge EnvironmentsabstractFederated Edge Learning (FEL) has emerged as a promising approach for enabling edge devices to collaboratively train machine learning models while preserving data privacy. Despite its advantages, practical FEL deployment faces significant challenges related to device constraints and device-server interactions, necessitating heterogeneous, user-adaptive model training with limited and uncertain communication. While knowledge cache-driven federated learning offers a promising FEL solution for demanding edge environments, its logits-based interaction design provides poor richness of exchanged information for on-device model optimization. To tackle this issue, we introduce DistilCacheFL, a novel personalized FEL architecture that enhances the exchange of optimization insights while delivering state-of-the-art performance with efficient communication. DistilCacheFL incorporates the benefits of both dataset distillation and knowledge cache-driven federated learning by storing and organizing distilled data as knowledge in the server-side knowledge cache, allowing devices to periodically download and utilize personalized knowledge for local model optimization. Moreover, a device-centric cache sampling strategy is introduced to tailor transferred knowledge for individual devices within controlled communication bandwidth. Extensive experiments on five datasets covering image recognition, audio understanding, and mobile sensor data mining tasks demonstrate that (1) DistilCacheFL significantly outperforms state-of-the-art methods regardless of model structures, data distributions, and modalities. (2) DistilCacheFL can train splendid personalized on-device models with at least 28.6 improvement in communication efficiency. Quyang Pan, Tingting Wi, Yuwei Wang 0003, Min Liu 0001, Bo Gao 0006, Jingyuan Wang 0001 |
AAAI | 5 |
| 2026 | Representation Decorrelation Guided Robust Image Retrieval Against Label Noise
Xuefeng Jiang 0001, Tian Wen, Lvhua Wu, Yuwei Wang 0003, Min Liu 0001 |
IEEE Trans. Big Data | 6 |
| 2026 | Representation Optimal Matching for Federated Learning With Noisy Labels in Remote SensingabstractRemote sensing (RS) applications increasingly operate over distributed infrastructures that integrate space-airground- sea resources with edge intelligence, yet remains challenging to centralize due to geographic dispersion, cross-institution barriers and privacy regulations. Federated learning (FL), a promising privacy-preserving distributed learning paradigm, has garnered wide attention. However, the practical application of FL for RS encounters the issue of label noise stemming from inevitable annotation errors. In this work, we pioneer an early investigation of label noise in distributed RS tasks. We introduce the Federated Representation Optimal Matching (FedROM) framework, which guides robust representation alignment in the presence of noisy labels without requiring auxiliary data or transmitting extra sensitive information. Specifically, FedROM focuses on the robust local updating process, where clients first identify underlying noisy samples from the perspectives of both per-sample loss value and latent representation space. Subsequently, inspired by the optimal transport technique, we adaptively align the latent representations of identified noisy samples with their corresponding closest class centroids with the least representation matching distance, where class centroids are averaged by the latent representations of other relatively clean samples. This reduces the misleading effects caused by noisy samples and guides the model to capture more robust semantic features in the latent representation space. Theoretical analysis proves the robustness and convergence of FedROM. Extensive experiments on two real-world distributed RS datasets covering multi-source domains and varying label noise rates demonstrate the robustness of FedROM against eighteen baseline methods. Meanwhile, FedROM also surpasses its counterparts in conditions of no label noise, narrowing the gap with the centralized training. To facilitate related communities, our code is open-sourced athttps://github.com/Sprinter1999/ROM. Xuefeng Jiang 0001, Tian Wen, Jinliang Yuan, Huashuo Liu, Lvhua Wu, Yuwei Wang 0003, Min Liu 0001 |
IEEE Trans. Mob. Comput. | 8 |
| 2026 | A Model Consistency-Based Countermeasure to GAN-Based Data Poisoning Attack in Federated LearningabstractIn federated learning (FL), although the original intention of “available but not visible” data is to allay data privacy concerns, it potentially brings new security threats, particularly poisoning attacks that target such “not visible” local data. Intuitively, such data poisoning attacks have great potential in stealthily degrading global FL outcomes, and are expected to be even stealthier if being enhanced by generative models like generative adversarial networks (GANs). However, existing defense methods have not been thoroughly challenged in this regard and generally fail to be aware of a local generation of seemingly legitimate poisoned data. With a growing concern on potentially stealthier attacks, in this paper, a cost-effective defense mechanism named Model Consistency-Based Defense (MCD) is proposed, which offers a comprehensive examination of available local models across multiple feature dimensions, providing an indirect yet effective means of identifying hidden data poisoning attackers. To push the limit of MCD against stealthier attacks, we propose a new GAN-based data poisoning attack model named VagueGAN and an unsupervised variant of it, which can be flexibly deployed to generate seemingly legitimate but noisy poisoned data. The consistency of GAN outputs revealed by VagueGAN helps strengthen MCD to work against stealthier GAN-based attacks as well as other mainstream ones. Extensive experiments on multiple open datasets (MNIST, Fashion-MNIST, CIFAR-10, CIFAR-100, and Mini-Imagenet) indicate that our attack method better balances the trade-off between attack effectiveness and stealthiness with low complexity. More importantly, our defense mechanism is shown to be more competent in identifying a variety of poisoned data, particularly stealthier GAN-poisoned ones. Bo Gao 0006, Ke Xiong 0001, Yuwei Wang 0003, Pingyi Fan, Khaled Ben Letaief |
IEEE Trans. Mob. Comput. | 4 |
| 2026 | Recursive Offloading for LLM Serving in Multi-Tier NetworksabstractHeterogeneous device-edge-cloud computing infrastructures have become the backbone of modern telecommunication operators and Wide Area Networks (WANs), providing multi-tier computational support for emerging intelligent applications. With the rapid proliferation of Large Language Model (LLM) services, efficiently coordinating inference tasks and reducing communication burden within these multi-tier network architectures becomes a critical deployment challenge. Current LLM serving paradigms exhibit significant limitations: on-device deployment restricts service to lightweight LLMs due to hardware constraints, while cloud-centric deployment encounters resource congestion and considerable prompt communication overhead during peak periods. Model-cascading inference, though better suited for multi-tier networks, depends on static, manually-tuned thresholds that cannot adapt to dynamic network conditions or varying task complexities. To address these challenges, we propose RecServe, a recursive offloading framework tailored for LLM serving in multi-tier networks. RecServe introduces a task-specific hierarchical confidence evaluation mechanism that guides offloading decisions based on inferred task complexity in progressively scaled LLMs across device, edge, and cloud tiers. To further enable intelligent task routing across tiers, RecServe employs a sliding-window-based dynamic offloading strategy with quantile interpolation, enabling real-time tracking of historical confidence distributions and adaptive offloading threshold adjustments. This design allows inference tasks to be recursively offloaded to higher tiers only when necessary, optimizing heterogeneous resource utilization while reducing cross-tier communication with little compromise on service quality. Theoretical analysis provides distinct conditions under which RecServe is expected to achieve reduced communication burden and computational costs. Experiments on eight datasets demonstrate that RecServe outperforms CasServe in both service quality and communication efficiency, and reduces the communication burden by over 50% compared to centralized cloud-based serving. Yuwei Wang 0003, Min Liu 0001, Bo Gao 0006, Jinda Lu, Zheming Yang, Tian Wen |
IEEE Trans. Mob. Comput. | 3 |
| 2025 | Learnable Sparse Customization in Heterogeneous Edge ComputingabstractTo effectively manage and utilize massive distributed data at the network edge, Federated Learning (FL) has emerged as a promising edge computing paradigm across data silos. However, FL still faces two challenges: system heterogeneity (i.e., the diversity of hardware resources across edge devices) and statistical heterogeneity (i.e., non-IID data). Although sparsification can extract diverse submodels for diverse clients, most sparse FL works either simply assign submodels with artificially-given rigid rules or prune partial parameters using heuristic strategies, resulting in inflexible sparsification and poor performance. In this work, we propose Learnable Personalized Sparsification for heterogeneous Federated learning (FedLPS), which achieves the learnable customization of heterogeneous sparse models with importance-associated patterns and adaptive ratios to simultaneously tackle system and statistical heterogeneity. Specifically, FedLPS learns the importance of model units on local data representation and further derives an importance-based sparse pattern with minimal heuristics to accurately extract personalized data features in non-IID settings. Furthermore, Prompt Upper Confidence Bound Variance (P-UCBV) is designed to adaptively determine sparse ratios by learning the superimposed effect of diverse device capabilities and non-IID data, aiming at resource self-adaptation with promising accuracy. Extensive experiments show that FedLPS outperforms status quo approaches in accuracy and training costs, which improves accuracy by 1.28% – 59.34% while reducing running time by more than 68.80%. Min Liu 0001, Yuwei Wang 0003, Zhuotao Liu, Jingyuan Wang 0001 |
ICDE | 4 |
| 2025 | Peak-controlled logits poisoning attack in federated distillationabstractFederated Distillation (FD) is an innovative distributed machine learning paradigm that enables efficient and flexible cross-device knowledge transfer through knowledge distillation, without the need to upload large-scale model parameters to a central server. Although FD has attracted increasing attention in recent years, its security aspects remain relatively underexplored. Existing attack methods targeting traditional federated learning mainly focus on the transmission of model parameters and gradients, while attacks specifically designed for the unnormalized outputs (logits) in the emerging FD paradigm are still lacking. To fill this research gap and contribute to the enhancement of FD’s security, we previously proposed the Federated Distillation Logits Attack (FDLA), which manipulates the logits transmitted during communication to mislead and degrade the performance of client models. However, FDLA has limitations in controlling its impact on participants with different roles or identities and lacks a systematic investigation into the effects of malicious interventions at various stages of knowledge transfer. To overcome these limitations, we propose a more advanced and controllable logits poisoning method—Peak-Controlled Federated Distillation Logits Attack (PCFDLA). PCFDLA enhances the effectiveness of FDLA by precisely controlling the peak values of logits to adjust the intensity of the attack. This method generates highly misleading perturbations that achieve stronger attack performance while maintaining a similar level of stealthiness to FDLA when detection is based on differences in model parameters. Moreover, we introduce a novel evaluation metric to more comprehensively assess the performance of such attacks. Experimental results show that PCFDLA significantly increases the destructive impact on victim models while maintaining high stealth. It consistently achieves superior performance across multiple datasets, highlighting its potential threat to the security of federated distillation systems. Yuhan Tang, Bo Gao 0006, Tian Wen, Yuwei Wang 0003 |
Discov. Comput. | 5 |
| 2025 | REFOL: Resource-Efficient Federated Online Learning for Traffic Flow ForecastingabstractMultiple federated learning (FL) methods are proposed for traffic flow forecasting (TFF) to avoid heavy-transmission and privacy-leaking concerns resulting from the disclosure of raw data in centralized methods. However, these FL methods adopt offline learning which may yield subpar performance, when concept drift occurs, i.e., distributions of historical and future data vary. Online learning can detect concept drift during model training, thus more applicable to TFF. Nevertheless, the existing federated online learning method for TFF fails to efficiently solve the concept drift problem and causes tremendous computing and communication overhead. Therefore, we propose a novel method named Resource-Efficient Federated Online Learning (REFOL) for TFF, which guarantees prediction performance in a communication-lightweight and computation-efficient way. Specifically, we design a data-driven client participation mechanism to detect the occurrence of concept drift and determine clients’ participation necessity. Subsequently, we propose an adaptive online optimization strategy, which guarantees prediction performance and meanwhile avoids meaningless model updates. Then, a graph convolution-based model aggregation mechanism is designed, aiming to assess participants’ contribution based on spatial correlation without importing extra communication and computing consumption on clients. Finally, we conduct extensive experiments on real-world datasets to demonstrate the superiority of REFOL in terms of prediction improvement and resource economization. Qingxiang Liu 0004, Yuxuan Liang 0002, Xiaolong Xu 0001, Min Liu 0001, Muhammad Bilal 0003, Yuwei Wang 0003, Xujing Li, Yu Zheng 0004 |
IEEE Trans. Intell. Transp. Syst. | 7 |
| 2025 | Energy-Efficient Over-the-Air Computation in UAV-Assisted IIoT NetworksabstractIn remote industrial Internet of Things (IIoT) monitoring systems, the uncrewed aerial vehicle (UAV) serves as supplementary infrastructure to aggregate data from a large number of distributed sensors, and achieve industrial operation intelligence. In the wireless data aggregation process, using conventional orthogonal multiple access techniques face challenges such as scarce bandwidth, high communication latency and energy consumption. To tackle these issues, the over-the-air computation (AirComp) technique has emerged. It allows concurrent data transmissions from sensors, as well as integrates communication and computation processes, ultimately enabling fast data aggregation. However, the energy consumption issue remains unresolved. In this paper, we exploit spatial correlations among sensor measurements, and design an energy-efficient AirComp in UAV-assisted IIoT networks, where only a subset of sensors transmit data instead of all sensors. Then, we derive a closed-form expression for the mean square error (MSE) of each combination under a specific number of sensor transmissions. By jointly optimizing the UAV deployment and pre-coding coefficients of sensors, we formulate the problem of minimizing MSE for each combination of transmitted sensors. Furthermore, the MSE optimization algorithm is developed to output the average MSE of all combinations. Finally, we evaluate the average MSE and network lifetime performance of proposed scheme. Yali Chen 0002, Min Liu 0001, Bo Ai 0001, Yuwei Wang 0003, Yunhao Liu 0001 |
IEEE Trans. Mob. Comput. | 5 |
| 2025 | Burst-Sensitive Traffic Forecast via Multi-Property Personalized Fusion in Federated LearningabstractFor distributed network traffic prediction with data localization and privacy protection, Federated Learning (FL) enables collaborative training without raw data exchange across Base Stations (BSs). Nevertheless, traffic across BSs exhibit inherently heterogeneous trend burst and smooth fluctuation properties, but existing FL methods model single-scale series from only one view, which cannot simultaneously capture diverse trend and fluctuation properties, especially distinct burst distributions. In this paper, we proposePersonalized Federated Forecasting with Multi-property Self-fusion (P2FMS), which can represent multi-scale traffic properties from different views. With precise multi-property representations, a fusion-level prediction decision is learned for each client in a personalized manner to promptly sense traffic bursts and improve forecasting performance in non-IID settings. Specifically, P2FMS decomposes the traffic series into distinct time scales, based on which, we effectively extract closeness, period, and trend properties from different views. The closeness and period are embedded through global-view representations with spatial correlations, while non-stationary trends are individually fitted from the client-side view. Furthermore, a personalized combiner is designed to accurately quantify the proportion of general fluctuation raws (i.e., closeness and period) and specific trend property in predictions, which enables multi-property self-fusion for each client to accommodate heterogeneous traffic patterns and enhance prediction accuracy. Besides, an alternant training mechanism is introduced to optimize property representation and fusion modules with the convergence guarantee. Extensive experiments on real-world datasets show that P2FMS outperforms status quo methods in both prediction performance and convergence time. Min Liu 0001, Yuwei Wang 0003, Xuying Meng, Jingyuan Wang 0001, Junbo Zhang 0004, Ke Xu 0002 |
IEEE Trans. Mob. Comput. | 4 |
| 2024 | Tackling Noisy Clients in Federated Learning with End-to-end Label CorrectionabstractRecently, federated learning (FL) has achieved wide successes for diverse privacy-sensitive applications without sacrificing the sensitive private information of clients. However, the data quality of client datasets can not be guaranteed since corresponding annotations of different clients often contain complex label noise of varying degrees, which inevitably causes the performance degradation. Intuitively, the performance degradation is dominated by clients with higher noise rates since their trained models contain more misinformation from data, thus it is necessary to devise an effective optimization scheme to mitigate the negative impacts of these noisy clients. In this work, we propose a two-stage framework FedELC to tackle this complicated label noise issue. The first stage aims to guide the detection of noisy clients with higher label noise, while the second stage aims to correct the labels of noisy clients' data via an end-to-end label correction framework which is achieved by learning possible ground-truth labels of noisy clients' datasets via back propagation. We implement sixteen related methods and evaluate five datasets with three types of complicated label noise scenarios for a comprehensive comparison. Extensive experimental results demonstrate our proposed framework achieves superior performance than its counterparts for different scenarios. Additionally, we effectively improve the data quality of detected noisy clients' local datasets with our label correction framework. The code is available at https://github.com/Sprinter1999/FedELC. Xuefeng Jiang 0001, Jia Li 0053, Runhan Li, Yuwei Wang 0003, Min Liu 0001 |
CIKM | 8 |
| 2024 | Agglomerative Federated Learning: Empowering Larger Model Training via End-Edge-Cloud CollaborationabstractFederated Learning (FL) enables training Artificial Intelligence (AI) models over end devices without compromising their privacy. As computing tasks are increasingly performed by a combination of cloud, edge, and end devices, FL can benefit from this End-Edge-Cloud Collaboration (EECC) paradigm to achieve collaborative device-scale expansion with real-time access. Although Hierarchical Federated Learning (HFL) supports multitier model aggregation suitable for EECC, prior works assume the same model structure on all computing nodes, constraining the model scale by the weakest end devices. To address this issue, we propose Agglomerative Federated Learning (FedAgg), which is a novel EECC-empowered FL framework that allows the trained models from end, edge, to cloud to grow larger in size and stronger in generalization ability. FedAgg recursively organizes computing nodes among all tiers based on Bridge Sample Based Online Distillation Protocol (BSBODP), which enables every pair of parent-child computing nodes to mutually transfer and distill knowledge extracted from generated bridge samples. This design enhances the performance by exploiting the potential of larger models, with privacy constraints of FL and flexibility requirements of EECC both satisfied. Experiments under various settings demonstrate that FedAgg outperforms state-of-the-art methods by an average of 4.53% accuracy gains and remarkable improvements in convergence rate. Our code is available at https://github.com/wuzhiyuan2000/FedAgg. Yuwei Wang 0003, Min Liu 0001, Bo Gao 0006, Quyang Pan, Tianliu He, Xuefeng Jiang 0001 |
INFOCOM | 3 |
| 2024 | Logits Poisoning Attack in Federated Distillation
Yuhan Tang, Bo Gao 0006, Tian Wen, Yuwei Wang 0003 |
KSEM (3) | 5 |
| 2024 | RTIFed: A Reputation based Triple-step Incentive mechanism for energy-aware Federated learning over battery-constricted devices
Tian Wen, Huixin Wu, Danxin Wang, Weishan Zhang, Yuwei Wang 0003, Shaohua Cao |
Comput. Networks | 8 |
| 2024 | Exploring the Distributed Knowledge Congruence in Proxy-data-free Federated DistillationabstractFederated learning (FL) is a privacy-preserving machine learning paradigm in which the server periodically aggregates local model parameters from cli ents without assembling their private data. Constrained communication and personalization requirements pose severe challenges to FL. Federated distillation (FD) is proposed to simultaneously address the above two problems, which exchanges knowledge between the server and clients, supporting heterogeneous local models while significantly reducing communication overhead. However, most existing FD methods require a proxy dataset, which is often unavailable in reality. A few recent proxy-data-free FD approaches can eliminate the need for additional public data, but suffer from remarkable discrepancy among local knowledge due to client-side model heterogeneity, leading to ambiguous representation on the server and inevitable accuracy degradation. To tackle this issue, we propose a proxy-data-free FD algorithm based on distributed knowledge congruence (FedDKC). FedDKC leverages well-designed refinement strategies to narrow local knowledge differences into an acceptable upper bound, so as to mitigate the negative effects of knowledge incongruence. Specifically, from perspectives of peak probability and Shannon entropy of local knowledge, we design kernel-based knowledge refinement (KKR) and searching-based knowledge refinement (SKR) respectively, and theoretically guarantee that the refined-local knowledge can satisfy an approximately-similar distribution and be regarded as congruent. Extensive experiments conducted on three common datasets demonstrate that our proposed FedDKC significantly outperforms the state-of-the-art on various heterogeneous settings while evidently improving the convergence speed. Yuwei Wang 0003, Min Liu 0001, Quyang Pan, Junbo Zhang 0004, Zeju Li, Qingxiang Liu 0004 |
ACM Trans. Intell. Syst. Technol. | 3 |
| 2024 | Online Spatio-Temporal Correlation-Based Federated Learning for Traffic Flow ForecastingabstractTraffic flow forecasting (TFF) is of great importance to the construction of Intelligent Transportation Systems. To mitigate communication burden and tackle with the problem of privacy leakage aroused by centralized forecasting methods, Federated Learning (FL) has been applied to TFF. However, existing FL-based approaches employ batch learning manner, which makes the pre-trained models inapplicable to subsequent traffic data, thus exhibiting subpar prediction performance. In this paper, we perform the first study of forecasting traffic flow adopting online learning manner in FL framework and then propose a novel prediction method named Online Spatio-Temporal Correlation-based Federated Learning (FedOSTC), aiming to guarantee performance gains regardless of traffic fluctuation. Specifically, clients employ Gated Recurrent Unit (GRU)-based encoders to obtain the internal temporal patterns inside traffic data sequences. Then, the central server evaluates spatial correlation among clients via Graph Attention Network (GAT), catering to the dynamic changes of spatial closeness caused by traffic fluctuation. Furthermore, to improve the generalization of the global model for upcoming traffic data, a period-aware aggregation mechanism is proposed to aggregate the local models which are optimized using Online Gradient Descent (OGD) algorithm at clients. We perform comprehensive experiments on two real-world datasets to validate the efficiency and effectiveness of our proposed method and the numerical results demonstrate the superiority of FedOSTC. Qingxiang Liu 0004, Min Liu 0001, Yuwei Wang 0003, Bo Gao 0006 |
IEEE Trans. Intell. Transp. Syst. | 4 |
| 2024 | Adaptive Bitrate Video Caching in UAV-Assisted MEC Networks Based on Distributionally Robust OptimizationabstractTo alleviate the pressure on the ground base station (BS) from intensive video requests, unmanned aerial vehicle (UAV)-assisted mobile edge computing (MEC) has become a promising and flexible solution. The UAV carries a MEC server to provide caching and transcoding services for adaptive bitrate video streaming, which can reduce duplicate transmissions of the BS and the content acquisition latency of users, while improving the flexibility of video delivery. However, considering the uncertainty of user requests and content popularity distribution, improving the robustness of video caching is a challenge to promote practical applications. Thus, by integrating caching and transcoding on the UAV, as well as backhaul retrieving, we study the bitrate-aware video caching and processing with uncertain popularity distribution. Then, the problem of joint cache placement and video delivery scheduling under the worst-case distribution is formulated to minimize the total expected system latency with energy consumption constrained. Specifically, we use$\zeta$-structure probability metrics to characterize the uncertainty and construct confidence sets of arrival distribution. Furthermore, a distributionally robust latency optimization algorithm based on convex optimization theory is designed to obtain a robust solution. Finally, we conduct extensive simulations using real-world datasets to evaluate the effectiveness and robustness of the proposed scheme. Yali Chen 0002, Min Liu 0001, Bo Ai 0001, Yuwei Wang 0003 |
IEEE Trans. Mob. Comput. | 4 |
| 2024 | Staleness-Controlled Asynchronous Federated Learning: Accuracy and Efficiency TradeoffabstractFederated Learning (FL) is an emerging distributed learning paradigm with the privacy-preserving advantage of collaboratively training a shared model across multiple participants. Considering the prevailing device heterogeneity circumstance in practice, asynchronous interaction is introduced into FL to break the straggler barrier of synchronization, at the cost of significant accuracy degradation derived from model staleness. Although quite a few works attempt to partially mitigate the detrimental impact after occurring staleness issue, they neglect to control the overall staleness degree of clients-side local models from the whole training perspective, resulting in highly-stale models for aggregation and slow convergence speed. To this end, we propose a Staleness-Controlled Asynchronous Federated Learning (SC-AFL) method, which enables to restrict staleness degree of local models within a certain bound via dynamically tuning the aggregated strategy of each round, aiming to strike a good balance between accuracy guarantee and convergence acceleration. Specifically, we leverage the Lyapunov optimization framework to decouple the troublesome round-coupling problem into the single-round sequential solving problem, and further develop a deterministic algorithm that selects the aggregated number of clients to minimize training time under the constraint of maintaining staleness queue stability. Besides, we derive the theoretical convergence analysis of SC-AFL and also present the upper bound of the performance gap with the optimum. Extensive experiments on three datasets demonstrate the superiority of SC-AFL in terms of time-to-accuracy speedup on both IID and Non-IID data distributions, achieving a good balance between model accuracy and convergence efficiency in AFL system. Zengqi Zhang, Quyang Pan, Min Liu 0001, Yuwei Wang 0003, Tianliu He, Yali Chen 0002 |
IEEE Trans. Mob. Comput. | 5 |
| 2024 | FedCache: A Knowledge Cache-Driven Federated Learning Architecture for Personalized Edge IntelligenceabstractEdge Intelligence (EI) allows Artificial Intelligence (AI) applications to run at the edge, where data analysis and decision-making can be performed in real-time and close to data sources. To protect data privacy and unify data silos distributed among end devices in EI, Federated Learning (FL) is proposed for collaborative training of shared AI models across multiple devices without compromising data privacy. However, the prevailing FL approaches cannot guarantee model generalization and adaptation on heterogeneous clients. Recently, Personalized Federated Learning (PFL) has drawn growing awareness in EI, as it enables a productive balance between local-specific training requirements inherent in devices and global-generalized optimization objectives for satisfactory performance. However, most existing PFL methods are based on the Parameters Interaction-based Architecture (PIA) represented by FedAvg, which suffers from unaffordable communication burdens due to large-scale parameters transmission between devices and the edge server. In contrast, Logits Interaction-based Architecture (LIA) allows to update model parameters with logits transfer and gains the advantages of communication lightweight and heterogeneous on-device model allowance compared to PIA. Nevertheless, previous LIA methods attempt to achieve satisfactory performance either relying on unrealistic public datasets or increasing communication overhead for additional information transmission other than logits. To tackle this dilemma, we propose a knowledge cache-driven PFL architecture, named FedCache, which reserves a knowledge cache on the server for fetching personalized knowledge from the samples with similar hashes to each given on-device sample. During the training phase, ensemble distillation is applied to on-device models for constructive optimization with personalized knowledge transferred from the server-side knowledge cache. Empirical experiments on four datasets demonstrate that FedCache achieves comparable performance with state-of-art PFL approaches, with more than two orders of magnitude improvements in communication efficiency. Our code and DEMO are available athttps://github.com/wuzhiyuan2000/FedCache. Yuwei Wang 0003, Min Liu 0001, Ke Xu 0002, Xuefeng Jiang 0001, Bo Gao 0006, Jinda Lu |
IEEE Trans. Mob. Comput. | 3 |
| 2024 | FedICT: Federated Multi-Task Distillation for Multi-Access Edge ComputingabstractThe growing interest in intelligent services and privacy protection for mobile devices has given rise to the widespread application of federated learning in Multi-access Edge Computing (MEC). Diverse user behaviors call for personalized services with heterogeneous Machine Learning (ML) models on different devices. Federated Multi-task Learning (FMTL) is proposed to train related but personalized ML models for different devices, whereas previous works suffer from excessive communication overhead during training and neglect the model heterogeneity among devices in MEC. Introducing knowledge distillation into FMTL can simultaneously enable efficient communication and model heterogeneity among clients, whereas existing methods rely on a public dataset, which is impractical in reality. To tackle this dilemma,Federated MultI-task Distillation for Multi-access EdgeCompuTing (FedICT) is proposed. FedICT direct local-global knowledge aloof during bi-directional distillation processes between clients and the server, aiming to enable multi-task clients while alleviating client drift derived from divergent optimization directions of client-side local models. Specifically, FedICT includes Federated Prior Knowledge Distillation (FPKD) and Local Knowledge Adjustment (LKA). FPKD is proposed to reinforce the clients' fitting of local data by introducing prior knowledge of local data distributions. Moreover, LKA is proposed to correct the distillation loss of the server, making the transferred local knowledge better match the generalized representation. Extensive experiments on three datasets demonstrate that FedICT significantly outperforms all compared benchmarks in various data heterogeneous and model architecture settings, achieving improved accuracy with less than 1.2% training communication overhead compared with FedAvg and no more than 75% training communication round compared with FedGKT in all considered scenarios. Yuwei Wang 0003, Min Liu 0001, Quyang Pan, Xuefeng Jiang 0001, Bo Gao 0006 |
IEEE Trans. Parallel Distributed Syst. | 3 |
| 2023 | FedTrip: A Resource-Efficient Federated Learning Method with Triplet RegularizationabstractIn the federated learning scenario, geographically distributed clients collaboratively train a global model. Data heterogeneity among clients significantly results in inconsistent model updates, which evidently slow down model convergence. To alleviate this issue, many methods employ regularization terms to narrow the discrepancy between client-side local models and the server-side global model. However, these methods impose limitations on the ability to explore superior local models and ignore the valuable information in historical models. Besides, although the up-to-date representation method simultaneously concerns the global and historical local models, it suffers from unbearable computation cost. To accelerate convergence with low resource consumption, we innovatively propose a model regularization method named FedTrip, which is designed to restrict global-local divergence and decrease current-historical correlation for alleviating the negative effects derived from data heterogeneity. FedTrip helps the current local model to be close to the global model while keeping away from historical local models, which contributes to guaranteeing the consistency of local updates among clients and efficiently exploring superior local models with negligible additional computation cost on attaching operations. Empirically, we demonstrate the superiority of FedTrip via extensive evaluations. To achieve the target accuracy, FedTrip outperforms the state-of-the-art baselines in terms of significantly reducing the total overhead of client-server communication and local computation. Xujing Li, Min Liu 0001, Yuwei Wang 0003, Hui Jiang 0015, Xuefeng Jiang 0001 |
IPDPS | 4 |
| 2023 | FedBIAD: Communication-Efficient and Accuracy-Guaranteed Federated Learning with Bayesian Inference-Based Adaptive DropoutabstractFederated Learning (FL) emerges as a distributed machine learning paradigm without end-user data transmission, effectively avoiding privacy leakage. Participating devices in FL are usually bandwidth-constrained, and the uplink is much slower than the downlink in wireless networks, which causes a severe uplink communication bottleneck. A prominent direction to alleviate this problem is federated dropout, which drops fractional weights of local models. However, existing federated dropout studies focus on random or ordered dropout and lack theoretical support, resulting in unguaranteed performance. In this paper, we propose Federated learning with Bayesian Inference-based Adaptive Dropout (FedBIAD), which regards weight rows of local models as probability distributions and adaptively drops partial weight rows based on importance indicators correlated with the trend of local training loss. By applying FedBIAD, each client adaptively selects a high-quality dropping pattern with accurate approximations and only transmits parameters of non-dropped weight rows to mitigate uplink costs while improving accuracy. Theoretical analysis demonstrates that the convergence rate of the average generalization error of FedBIAD is minimax optimal up to a squared logarithmic factor. Extensive experiments on image classification and next-word prediction show that compared with status quo approaches, FedBIAD provides 2× uplink reduction with an accuracy increase of up to 2.41% even on non-Independent and Identically Distributed (non-IID) data, which brings up to 72% decrease in training time. Min Liu 0001, Yuwei Wang 0003, Hui Jiang 0015, Xuefeng Jiang 0001 |
IPDPS | 4 |
| 2023 | VagueGAN: A GAN-Based Data Poisoning Attack Against Federated Learning SystemsabstractFederated learning (FL) is a privacy-preserving distributed learning paradigm relying on but without directly accessing privately owned datasets. However, the ‘‘available but not visible’’ nature of training data in FL leads to security risks. In particular, ‘‘not visible’’ local data can easily become the best targets of poisoning attacks. Although existing data poisoning methods may successfully attack FL systems, they mostly lead to significant data statistical changes and thus can be not hard to detect. In this paper, we propose VagueGAN, a new data poisoning attack model that unconventionally leverages the power of generative adversarial network (GAN) to generate seemingly legitimate vague data with appropriate amounts of poisonous noise. The quality of such vague data can be controlled on demand to achieve a balanced trade-off between attack effectiveness and stealthiness. Extensive experiments show that data poisoning attacks enhanced by our VagueGAN not only better degrade FL outcomes with low efforts but also are generally much less detectable. Bo Gao 0006, Ke Xiong 0001, Yang Lu 0008, Yuwei Wang 0003 |
SECON | 5 |
| 2023 | MJOA-MU: End-to-edge collaborative computation for DNN inference based on model uploading
Min Liu 0001, Qiuping Zhang, Yuwei Wang 0003 |
Comput. Networks | 5 |
| 2023 | A Federated Learning Framework for Fingerprinting-Based Indoor Localization in Multibuilding and Multifloor EnvironmentsabstractThe participatory nature of federated learning (FL) makes it attractive for fingerprinting-based indoor localization in multibuilding and multifloor environments. A group of sensing clients can collaboratively leverage their private, local fingerprint data to help their edge server update a location prediction model. However, it is challenging to jointly handle the two involved issues, i.e., building-floor classification (BFC) and latitude–longitude regression (LLR), in a wide 3-D space through enabling FL on decentralized yet heterogeneous data and over an imperfect wireless network. In this article, we confront these challenges and propose an FL framework, FedLoc3D, for both BFC and LLR. Specifically, the former issue is addressed by an FedDSC-BFC approach, which generates a multilabel classification model based on a convolutional neural network with depthwise separable convolutions. The latter issue is addressed by an FedADA-LLR approach, which develops a multitarget regression model based on a deep neural network with autoencoder and data augmentation. Extensive experiments on a real-world data set of WiFi fingerprints are carried out, and our approaches with enhanced capabilities of feature extraction, generalization, and convergence are validated to improve both localization accuracy and learning efficiency under data heterogeneity and network instability. Bo Gao 0006, Nan Cui, Ke Xiong 0001, Yang Lu 0008, Yuwei Wang 0003 |
IEEE Internet Things J. | 6 |
| 2022 | Towards Federated Learning against Noisy Labels via Local Self-RegularizationabstractFederated learning (FL) aims to learn joint knowledge from a large scale of decentralized devices with labeled data in a privacy-preserving manner. However, data with noisy labels are ubiquitous in reality since high-quality labeled data require expensive human efforts, which cause severe performance degradation. Although a lot of methods are proposed to directly deal with noisy labels, these methods either require excessive computation overhead or violate the privacy protection principle of FL. To this end, we focus on this issue in FL with the purpose of alleviating performance degradation yielded by noisy labels meanwhile guaranteeing data privacy. Specifically, we propose a Local Self-Regularization method, which effectively regularizes the local training process via implicitly hindering the model from memorizing noisy labels and explicitly narrowing the model output discrepancy between original and augmented instances using self distillation. Experimental results demonstrate that our proposed method can achieve notable resistance against noisy labels in various noise levels on three benchmark datasets. In addition, we integrate our method with existing state-of-the-arts and achieve superior performance on the real-world dataset Clothing1M.The code is available at https://github.com/Sprinter1999. Xuefeng Jiang 0001, Yuwei Wang 0003, Min Liu 0001 |
CIKM | 3 |
| 2022 | FedSyL: Computation-Efficient Federated Synergy Learning on Heterogeneous IoT DevicesabstractAs a popular privacy-preserving model training technique, Federated Learning (FL) enables multiple end-devices to collaboratively train Deep Neural Network (DNN) models without exposing local privately-owned data. According to the FL paradigm, resource-constrained end-devices in IoT should perform model training which is computation-intensive, whereas the edge server occupied with powerful computation capability only performs model aggregation. Due to the above unbalanced computation pattern, IoT-oriented FL is time-consuming and inefficient. In order to alleviate the computation burden of end-devices, recent countermeasures introduce the edge server to assist end-devices in model training. However, existing works neither efficiently address the computation heterogeneity across end-devices nor reduce the leakage risk of data privacy. To this end, we propose a Federated Synergy Learning (FedSyL) paradigm which innovatively strikes a balance between training efficiency and data leakage risk. We explore the complicated relationship between the local training latency and multi-dimensional training configurations, and design a uniform training latency prediction method by applying the polynomial quadratic regression analysis. Additionally, we design the optimal model offloading strategy with the consideration of resource limitation and computation heterogeneity of end-devices, so as to accurately assign capability=matched device-side sub-models for heterogeneous end-devices. We implement FedSyL on a real test-bed comprising multiple heterogeneous end-devices. Experimental results demonstrate the superiority of FedSyL on training efficiency and privacy protection. Hui Jiang 0015, Min Liu 0001, Yuwei Wang 0003, Xiaobing Guo |
IWQoS | 4 |
| 2020 | Spectrum Sharing Among Rapidly Deployable Small Cells: A Hybrid Multi-Agent ApproachabstractOn-demand deployment of small cells plays a key role in augmenting macro-cell coverage for outdoor hotspots, where user devices are brought together and intensively upload self-generated data. In this paper, we study spectrum sharing among rapidly deployable small cells in the uplink, even without a priori global knowledge. We propose a hybrid multi-agent approach, which allows a leading macro-cell base station (MBS) and multiple following small base stations (SBSs) to take part in a user-centric, online joint optimization of small cell deployment and uplink resource allocation. Specifically, we propose a centralized mechanism for the MBS to solve the first subproblem of small cell deployment stage by stage, based on an adversarial bandit model. Furthermore, we propose a distributed mechanism for the group of SBSs to collectively solve the second subproblem of uplink resource allocation stage by stage, based on a stochastic game model. We prove that our approach is guaranteed to produce a joint strategy, which is built upon a mixed strategy with bounded regret on the first tier and an equilibrium solution on the second tier. Our approach is validated by simulations on the aspects of convergence behavior, strategy correctness, power consumption, and spectral efficiency. Bo Gao 0006, Lingyun Lu, Ke Xiong 0001, Jung-Min Park 0001, Yaling Yang, Yuwei Wang 0003 |
IEEE Trans. Wirel. Commun. | 6 |
| 2011 | Power-Aware Traffic Engineering with Named Data NetworkingabstractPower-aware traffic engineering puts some links to sleep by moving their traffic to other links. However, this can make the utilization of remaining links higher, especially when the traffic amount is large. There is a tradeoff between the number of sleeping links and the utilization of links. To solve this problem, we propose to use a state-of-the-art networking called Named Data Networking (NDN), which can cache and retrieve the content in the storable routers. This can facilitate power-aware traffic engineering, because some traffic does not need to travel through the core network any more, and it only ends up at the edge routers which have already cached the required content. We use NDN to balance the traffic demand between origin-destination core routers so that traffic demand through the network can be adjusted to satisfy the requirement of power-aware traffic engineering. We evaluate power-aware traffic engineering with NDN and show its advantage compared to the one with conventional networking. Yunlong Song, Min Liu 0001, Yuwei Wang 0003 |
MSN | 3 |