Dinh C. Nguyen

dblp:242/7584 · DBLP profile ↗
← Back
42ranked-venue papers
12as first author
39since 2021 · last 2026
0000-0002-8092-6756ORCID · conflict

Domains — the database's venue-derived domains; a paper can count in several

Computer networks · 29 · 11 first-author · 26 since 2021Applied, interdisciplinary, general and emerging computing · 4 · 4 since 2021Systems, architecture and hardware · 3 · 1 first-author · 3 since 2021Artificial intelligence and machine learning · 1 · 1 since 2021Security and privacy · 1 · 1 since 2021Databases, data management, data science and information retrieval · 1 · 1 since 2021
YearPublicationVenuePosition
2026 Adaptive Semantic Communications for Time-Critical 6G Wireless Networks
abstract
In the rapidly evolving landscape of 6G wireless networks, time-sensitive applications demand efficient data transmission that prioritizes meaningful content over raw signals. This paper introduces a novel adaptive semantic communication system designed for ultra-reliable and low-latency applications, such as autonomous vehicles, drone monitoring, and satellite imaging. The system uses a multi-exit autoencoder to dynamically alter encoding depth based on input data complexity, maximizing the balance of semantic accuracy and processing performance. A lightweight contextual multi-armed bandit (CMAB) mechanism guides exit selection, leveraging a hybrid feature extractor that combines an encoder-derived semantic features vector with statistical image metrics to enable real-time decisions without supervision. The design of this adaptable architecture, an online learning policy for resource allocation, and validation through tests with object detection benchmarks are all significant contributions. Results demonstrate superior performance over traditional and neural-based codecs, particularly under high compression ratios, with enhanced fidelity in latency-constrained environments. This approach paves the way for practical 6G deployments in edge-intelligent systems, offering reduced overhead while preserving critical information for upstream and downstream tasks.
Md. Bokhtiar-Al-Zami, Atit Pokharel, Dinh C. Nguyen
CCNC3
2026 Resource-Efficient Distributed Quantum Learning over Wireless Networks with Qubit Reuse
abstract
Distributed quantum computing (DQC) mitigates the hardware limitations of near-term devices by partitioning large circuits into smaller segments executed on qubit-limited processors. However, even these reduced circuits often exceed the capacity of near-term devices that provide only extremely few reliable qubits. To address this, we introduce a qubit-reuse based DQC framework that exploits mid-circuit measurement and reset to enable scalable execution with minimal physical qubits. We consider distributed quantum learning (DQL) as a representative case study and formulate an energy minimization problem for the proposed framework that jointly optimizes quantum operation energy, measurement repetitions, and transmission power. To tackle the inherent non-convexity, we design a hybrid block coordinate descent (BCD) and successive convex approximation (SCA) algorithm for efficient solution. Extensive simulations on MNIST and CIFAR-10 demonstrate that the proposed qubit-reuse framework enables scalable execution on qubit-limited devices while achieving competitive performance compared to centralized quantum computing, and that the joint optimization algorithm significantly improves energy efficiency over baseline schemes.
Shaba Shaon, Atit Pokharel, Alexander Coutras, Avimanyu Sahoo, Dinh C. Nguyen
CCNC5
2026 Secure UAV-Assisted Federated Learning: A Digital Twin-Driven Approach With Zero-Knowledge Proofs
abstract
Federated learning (FL) has gained popularity as a privacy-preserving method of training machine learning models on decentralized networks. However to ensure reliable operation of UAV-assisted FL systems, issues like as excessive energy consumption, communication inefficiencies, and security vulnerabilities must be solved. This paper proposes an innovative framework that integrates Digital Twin (DT) technology and zero-knowledge FL (zkFed) to tackle these challenges. UAVs act as mobile base stations, allowing scattered devices to train FL models locally and upload model updates for aggregation. By incorporating DT technology, our approach enables real-time system monitoring and predictive maintenance, improving UAV network efficiency. Additionally, Zero-Knowledge Proofs (ZKPs) strengthen security by allowing model verification without exposing sensitive data. To optimize energy efficiency and resource management, we introduce a dynamic allocation strategy that adjusts UAV flight paths, transmission power, and processing rates based on network conditions. Using block coordinate descent and convex optimization techniques, our method significantly reduces system energy consumption by up to 29.6% compared to conventional FL approaches. Simulation results demonstrate improved learning performance, security, and scalability, positioning this framework as a promising solution for next-generation UAV-based intelligent networks.
Md. Bokhtiar-Al-Zami, Dinh C. Nguyen
IEEE Internet Things J.3
2026 Empowering IIoT With Federated Edge Learning for Human Activity Recognition Problems
abstract
Human Activity Recognition (HAR) has become a cornerstone in the dynamic development of the Industrial Internet of Things (IIoT). This study introduces an extensive framework aimed at embedding HAR functionality into industrial settings to promote workplace safety, streamline operations, and facilitate predictive maintenance. Through AI techniques, HAR problems can be achieved with high accuracy. However, traditional AI models require centrally trained data on remotely powerful cloud servers. This leads to issues with privacy and security of health records and increases latency. To address this problem, the Federated Learning (FL) technique was proposed. FL allows distributed training on the patient’s IoT devices and serves as the communication mechanism between local devices and the FL aggregator. Thanks to this architecture, the health data needs only to be stored locally on its devices without being uploaded to data centers, thus ensuring security and reducing service response times and computational costs. In this study, we implement FedANN and FedConvNN independently in a federated learning setting to address human activity recognition problems toward real-time applications. Finally, we evaluate the effectiveness of the based on the variation initiation of the number of different training clients. The results show that the FedConvNN solution improves accuracy and reduces model and communication complexity compared to FedANN and centralized training models, with the potential for real-time deployment in HAR tasks. Our code is available on our GitHub repository: https://github.com/itsminhcs/Fedavg-HAR.git.
Dang Nhat Minh, Abdellah Chehri, Van-Hau Nguyen, Dinh C. Nguyen, Vu Khanh Quy, Gwanggil Jeon
IEEE Internet Things J.6
2026 Escaping Barren Plateaus in Variational Quantum Algorithms Using Negative Learning Rate in Quantum Internet of Things
abstract
Variational Quantum Algorithms (VQAs) are becoming the primary computational primitive for next-generation quantum computers, particularly those embedded as resource-constrained accelerators in the emerging Quantum Internet of Things (QIoT). However, under such device-constrained execution conditions, the scalability of learning is severely limited by barren plateaus, where gradients collapse to zero and training stalls. This poses a practical challenge to delivering VQA-enabled intelligence on QIoT endpoints, which often have few qubits, constrained shot budgets, and strict latency requirements. In this paper, we present a novel approach for escaping barren plateaus by including negative learning rates into the optimization process in QIoT devices. Our method introduces controlled instability into model training by switching between positive and negative learning phases, allowing recovery of significant gradients and exploring flatter areas in the loss landscape. We theoretically evaluate the effect of negative learning on gradient variance and propose conditions under which it helps escape from barren zones. The experimental findings on typical VQA benchmarks show consistent improvements in both convergence and simulation results over traditional optimizers. By escaping barren plateaus, our approach leads to a novel pathway for robust optimization in quantum-classical hybrid models.
Ratun Rahman, Dinh C. Nguyen
IEEE Internet Things J.2
2026 Distributed Quantum Learning Over Near-Term Devices: Convergence Analysis and Security Design
abstract
Distributed quantum learning (DQL) has emerged as a promising paradigm to scale quantum-enhanced machine learning by interconnecting multiple quantum devices. However, for efficient real-world deployment, it is essential to characterize how DQL converges under practical scenarios while simultaneously safeguarding multi-device quantum infrastructures from evolving security threats. Addressing these aspects in an integrated manner is key to ensuring both performance and resilience in large-scale DQL systems. Therefore, this paper presents a new DQL study where our innovation lies in: (i) conducting a holistic convergence analysis for DQL under practical settings, i.e., partial device participation, non-convex loss functions, and heterogeneous data distributions, (ii) developing a novel multi-layered post-quantum cryptographic architecture with a quantum neural network-powered adaptive mechanism that monitors conditions, evaluates threats, and adjusts parameters across three National Institute of Standards and Technology (NIST)-compliant levels. Our theoretical framework and empirical validation reveal two key insights: (i) the derived convergence bound uncovers a fundamental trade-off between convergence rate, measurement shots, and the size of the participating device subset; and (ii) findings from our evaluations on a physical testbed modeling quantum control architectures expose the performance limitations of static post-quantum security, while confirming that our adaptive framework effectively mitigates these overheads to preserve overall system efficiency. Specifically, the hardware experiments demonstrate that our dynamic security mechanism reduces total security execution time by approximately 49% relative to static high-security baselines, while maintaining a threat detection accuracy of over 91%. Furthermore, extensive simulations validate our theoretical analysis, showing strong agreement between predicted and observed convergence trends. The coupling of these two stages ensures both theoretically grounded performance optimization and adaptive threat resilience, enabling efficient, secure, and scalable DQL deployment.
Atit Pokharel, Shaba Shaon, Thomas H. Morris, Dinh C. Nguyen
IEEE J. Sel. Areas Commun.4
2026 Quantum Noise Mitigation With Adaptive Zero-Noise Extrapolation: A Contextual Multi-Armed Bandits Approach
Ratun Rahman, Dinh C. Nguyen
IEEE J. Sel. Areas Commun.2
2026 Tackling Heterogeneity in Quantum Federated Learning: An Integrated Sporadic-Personalized Approach
abstract
Quantum federated learning (QFL) emerges as a powerful technique that combines quantum computing with federated learning to efficiently process complex data across distributed quantum devices while ensuring data privacy in quantum networks. Despite recent research efforts, existing QFL frameworks struggle to achieve optimal model training performance primarily due to inherent heterogeneity in terms of (i) quantum noise where current quantum devices are subject to varying levels of noise due to varying device quality and susceptibility to quantum decoherence, and (ii) heterogeneous data distributions where data across participating quantum devices are naturally non-independent and identically distributed (non-IID). To address these challenges, we propose a novel integrated sporadic-personalized approach called SPQFL that simultaneously handles quantum noise and data heterogeneity in a single QFL framework. It is featured in two key aspects: (i) for quantum noise heterogeneity, we introduce a notion of sporadic learning to tackle quantum noise heterogeneity across quantum devices, and (ii) for quantum data heterogeneity, we implement personalized learning through model regularization to mitigate overfitting during local training on non-IID quantum data distributions, thereby enhancing the convergence of the global model. Moreover, we conduct a rigorous convergence analysis for the proposed SPQFL framework, with both sporadic and personalized learning considerations. Theoretical findings reveal that the upper bound of the SPQFL algorithm is strongly influenced by both the number of quantum devices and the number of quantum noise measurements. Extensive simulation results in real-world datasets also illustrate that the proposed SPQFL approach yields significant improvements in terms of training performance and convergence stability compared to the state-of-the-art methods.
Ratun Rahman, Shaba Shaon, Dinh C. Nguyen
IEEE Trans. Computers3
2026 Collaborative Multimodal Learning Over Integrated Aerial-Terrestrial Networks Under Adversarial Attacks
abstract
With the rapid growth of intelligent aerial-terrestrial applications, enabling collaborative multimodal learning (CML) across heterogeneous data sources, such as aerial images from unmanned aerial vehicles (UAVs) and time-series signals from ground edge devices (EDs), has become essential for achieving reliable intelligence beyond unimodal approaches. However, aerial-terrestrial CML systems face stringent latency requirements, limited energy and computation resources, and vulnerability to adversarial attacks, which are not jointly addressed in existing studies. This paper proposes a wireless aerial-terrestrial CML framework that integrates distributed UAVs and terrestrial EDs with modality-specific encoder training and multimodal fusion at a ground base station (BS). We formulate a latency minimization problem under energy, and security-aware constraints by jointly optimizing UAV trajectories and resource allocation, ED resource allocation, as well as resource allocation of the BS. The framework explicitly incorporates both passive eavesdropping and active interference attacks to ensure secure and robust aerial-terrestrial CML operation. To solve the resulting non-convex latency minimization problem, we develop a simple yet efficient iterative optimization algorithm to find a high-quality optimal solution based on successive convex approximation. Extensive simulation results with real-world datasets demonstrate that the proposed framework significantly outperforms existing training methods in terms of accuracy, loss, and convergence. Moreover, our joint optimization framework achieves up to 94.05% lower latency and stronger robustness against aerial adversaries compared with baseline schemes.
Shaba Shaon, Dinh C. Nguyen, Dusit Niyato, H. Vincent Poor
IEEE Trans. Commun.2
2026 Communication-Efficient Quantum Federated Learning Over Large-Scale Wireless Networks
abstract
Quantum federated learning (QFL) combines the robust data processing of quantum computing with the privacy-preserving features of federated learning (FL). However, in large-scale wireless networks, optimizing sum-rate is crucial for unlocking the true potential of QFL, facilitating effective model sharing and aggregation as devices compete for limited bandwidth amid dynamic channel conditions and fluctuating power resources. This paper studies a novel sum-rate maximization problem within a muti-channel QFL framework, specifically designed for non-orthogonal multiple access (NOMA)-based large-scale wireless networks. We develop a sum-rate maximization problem by jointly considering quantum device’s channel selection and transmit power. Our formulated problem is a non-convex, mixed-integer non-linear programming (MINLP) challenge that remains non-deterministic polynomial time (NP)-hard even with specified channel selection parameters. The complexity of the problem motivates us to create an effective iterative optimization approach that utilizes the sophisticated quantum approximate optimization algorithm (QAOA) to derive high-quality approximate solutions. Additionally, our study presents the first theoretical exploration of QFL convergence properties under full device participation, rigorously analyzing real-world scenarios with nonconvex loss functions, diverse data distributions, and the effects of quantum shot noise. Extensive simulation results indicate that our multi-channel NOMA-based QFL framework enhances model training and convergence behavior, surpassing conventional algorithms in terms of accuracy and loss. Moreover, our quantum-centric joint optimization approach achieves more than a 100% increase in sum-rate while ensuring rapid convergence, significantly outperforming the state-of-the-arts.
Shaba Shaon, Christopher G. Brinton, Dinh C. Nguyen
IEEE Trans. Netw.3
2025 Federated Split Learning for Human Activity Recognition with Differential Privacy
abstract
This paper proposes a novel intelligent human activity recognition (HAR) framework based on a new design of Federated Split Learning (FSL) with Differential Privacy (DP) over edge networks. Our FSL-DP framework leverages both accelerometer and gyroscope data, achieving significant improvements in HAR accuracy. The evaluation includes a detailed comparison between traditional Federated Learning (FL) and our FSL framework, showing that the FSL framework outperforms FL models in both accuracy and loss metrics. Additionally, we examine the privacy-performance trade-off under different data settings in the DP mechanism, highlighting the balance between privacy guarantees and model accuracy. The results also indicate that our FSL framework achieves faster communication times per training round compared to traditional FL, further emphasizing its efficiency and effectiveness. This work provides valuable insight and a novel framework which was tested on a real-life dataset.
Josue Ndeko, Shaba Shaon, Aubrey Beal, Avimanyu Sahoo, Dinh C. Nguyen
CCNC5
2025 Electrical Load Forecasting in Smart Grid: A Personalized Federated Learning Approach
abstract
Electric load forecasting is essential for power management and stability in smart grids. This is primarily achieved via advanced metering infrastructure, utilizing smart meters (SMs) to record household energy consumption. Traditional machine learning (ML) methods are commonly employed for load forecasting but require data sharing, which raises data privacy concerns. Federated learning (FL) can address this issue by running distributed ML models at local SMs without data exchange. However, current FL-based approaches struggle to achieve efficient load forecasting due to imbalanced data distribution across heterogeneous SMs. This paper presents a novel personalized federated learning (PFL) method to load prediction under non-independent and identically distributed (non-IID) metering data settings. Specifically, we introduce meta-learning, where the learning rates are manipulated using the meta-learning idea to maximize the gradient for each client in each global round. Clients with varying processing capacities, data sizes, and batch sizes can participate in global model aggregation and improve their local load forecasting via personalized learning. Simulation results show that our approach outperforms state-of-the-art ML and FL methods in load forecasting accuracy.
Ratun Rahman, Dinh C. Nguyen
CCNC3
2025 False Data Injection Attack Detection in Edge-Based Smart Metering Networks with Federated Learning
abstract
Smart metering networks are increasingly susceptible to cyber threats, where false data injection (FDI) appears as a critical attack. Data-driven-based machine learning (ML) methods have shown immense benefits in detecting FDI attacks via data learning and prediction abilities. Literature works have mostly focused on centralized learning and deploying FDI attack detection models at the control center, which requires data collection from local utilities like meters and transformers. However, this data sharing may raise privacy concerns due to the potential disclosure of household information like energy usage patterns. This paper proposes a new privacy-preserved FDI attack detection by developing an efficient federated learning (FL) framework in the smart meter network with edge computing. Distributed edge servers located at the network edge run an ML-based FDI attack detection model and share the trained model with the grid operator, aiming to build a strong FDI attack detection model without data sharing. Simulation results demonstrate the efficiency of our proposed FL method over the conventional method without collaboration.
Ratun Rahman, Dinh C. Nguyen
CCNC3
2025 Electrical Load Forecasting Over Multihop Smart Metering Networks With Federated Learning
abstract
Electric load forecasting is essential for power management and stability in smart grids. This is mainly achieved via advanced metering infrastructure, where smart meters (SMs) record household energy data. Traditional machine learning (ML) methods are often employed for load forecasting, but require data sharing, which raises data privacy concerns. Federated learning (FL) can address this issue by running distributed ML models at local SMs without data exchange. However, current FL-based approaches struggle to achieve efficient load forecasting due to imbalanced data distribution across heterogeneous SMs. This paper presents a novel personalized federated learning (PFL) method for high-quality load forecasting in metering networks. A meta-learning-based strategy is developed to address data heterogeneity at local SMs in the collaborative training of local load forecasting models. Moreover, to minimize the load forecasting delays in our PFL model, we study a new latency optimization problem based on optimal resource allocation at SMs. A theoretical convergence analysis is also conducted to provide insights into FL design for federated load forecasting. Extensive simulations from real-world datasets show that our method outperforms existing approaches regarding better load forecasting and reduced operational latency costs.
Ratun Rahman, Pablo Moriano, Samee Ullah Khan, Dinh C. Nguyen
IEEE Internet Things J.4
2025 Multimodal Federated Learning for Air Quality Estimation With Model Personalization Over Aerial-Ground Networks
abstract
Accurate and timely air quality estimations are crucial for effective environmental management and public health protection. Most literature works primarily focus on unimodal data-based analysis, i.e., relying exclusively on spatial or temporal data. However, unimodal learning methods cannot capture the complex interdependencies between different perspectives, leading to suboptimal performance in predicting air quality. Furthermore, recent multimodal data approaches rely on centralized data collection, raising privacy concerns and delays in air quality estimations. This paper addresses these practical challenges by proposing a novel multimodal federated learning (FL) framework with model personalization tailored for aerial-ground networks, where the term ‘aerial-ground networks’ refers to the collaboration between airborne drones and mobile ground sensors. The proposed personalized model training approach enables real-time air quality estimation by integrating data from drones and ground sensors, accounting for data heterogeneity with high precision. To achieve this, we develop a collaborative model training method in a multimodal setting, allowing drones and ground sensor devices to share encoder models and build a high-quality decoder at a ground station in real-time. The experimental results from real-world datasets show that our method outperforms existing state-of-the-art methods by providing around 2.46% better prediction in air quality estimations.
Ratun Rahman, Falguni Patadia, Dinh C. Nguyen
IEEE Geosci. Remote. Sens. Lett.4
2025 Vehicle-to-Everything Cooperative Perception for Autonomous Driving
abstract
Achieving fully autonomous driving with enhanced safety and efficiency relies on vehicle-to-everything (V2X) cooperative perception (CP), which enables vehicles to share perception data, thereby enhancing situational awareness and overcoming the limitations of the sensing ability of individual vehicles. V2X CP plays a crucial role in extending the perception range, increasing detection accuracy, and supporting more robust decision-making and control in complex environments. This article provides a comprehensive survey of recent developments in V2X CP, introducing mathematical models that characterize the perception process under different collaboration strategies. Key techniques for enabling reliable perception sharing, such as agent selection, data alignment, and feature fusion, are examined in detail. In addition, major challenges are discussed, including differences in agents and models, uncertainty in perception outputs, and the impact of communication constraints such as transmission delay and data loss. This article concludes by outlining promising research directions, including privacy-preserving artificial intelligence methods, collaborative intelligence, and integrated sensing frameworks to support future advancements in V2X CP.
Tao Huang 0008, Xi Zhou 0006, Dinh C. Nguyen, Mostafa Rahimi Azghadi, Yuxuan Xia, Qing-Long Han, Sumei Sun
Proc. IEEE4
2025 SoK: Private Knowledge Sharing in Distributed Learning
abstract
The rapid advancement of Artificial Intelligence (AI) has transformed various industries, leading to the widespread distribution of AI models and data across intelligent systems. As modern data driven services increasingly integrate distributed knowledge entities, decentralized learning has become a prevalent approach to training AI models. However, this collaborative learning paradigm introduces significant security vulnerabilities and privacy challenges. This paper presents a comprehensive systematic review on private knowledge sharing in distributed learning, analyzing key knowledge components utilized in leading distributed learning architectures. We identify critical vulnerabilities associated with these components and examine defensive strategies to safeguard privacy while mitigating potential adversarial threats. Additionally, we highlight key limitations in knowledge sharing in distributed learning and propose future research directions to enhance security and efficiency in decentralized AI systems.
Yasas Supeksala, Thilina Ranbaduge, Ming Ding 0001, Dinh C. Nguyen, Bo Liu 0001, Caslon Chua, Jun Zhang 0010
Proc. Priv. Enhancing Technol.4
2024 An Software Defined Networking (SDN) Enhanced Edge Computing Framework for Internet of Healthcare Things (IoHT)
abstract
The rapid proliferation of intelligent Internet of Health Things (IoHT) applications within the context of the COVID-19 pandemic has exerted significant strain on the backhaul network infrastructure. This paper aims to introduce a novel framework that leverages software-defined networking (SDN) to enhance edge computing capabilities. This framework will expect to facilitate dynamic and adaptable communication between edge and cloud servers, specifically designed to support real-time Internet of Health Things applications. Through the establishment of a connection between servers and the Software-Defined Networking controller, the system is expected to facilitate load balancing, network optimization, and the utilization of resources in an efficient manner. This, in turn, enables the provision of real-time healthcare services. Ultimately, the efficacy of the suggested framework is assessed by analyzing its impact on service response time. The research results indicate that the proposed framework significantly benefits IoHT systems’ service response times across various workloads and traffic.
Abdellah Chehri, Chu Thi Minh Hue, Dinh C. Nguyen, Vu Khanh Quy
GLOBECOM5
2024 FedXPro: Bayesian Inference for Mitigating Poisoning Attacks in IoT Federated Learning
abstract
Federated learning (FL) has been envisioned to enable many Internet of Things (IoT) devices to perform large-scale machine learning without sharing raw data, resulting in significant privacy improvements. In a wireless IoT system, FL helps clients to secure their confidential information and achieve improved learning performance. However, the conventional FL architecture is vulnerable to Byzantine workers, possessing the potential to send malicious updates that compromise the accuracy of the global model. Previous studies have proposed various secure aggregation rules and attacker detection techniques to address this issue. However, these techniques exhibit limited effectiveness and may lead to a decrease in accuracy. To overcome these limitations, we propose a Byzantine client detection algorithm called FedXPro by combining the PC/BC-DIM neural network and Geometric Median (GM). Predictive coding (PC) is the core of the PC/BC-DIM architecture, which can perform Bayesian inference by fusing priors and likelihoods to determine posterior distributions. The GM is employed to determine the prior knowledge of legitimate clients to execute the PC/BC-DIM algorithm. During training, the framework calculates the probability distribution for a set of valid clients chosen from the GM. In testing, it attempts to reconstruct the same distribution from other clients concerning prior knowledge, and ultimately, the reconstruction power is utilized to filter the malicious clients. Our extensive simulations demonstrate the superiority of our FedXPro approach over other state-of-the-art methods in terms of accuracy, a guaranteed faster convergence rate, and attack detection under different network settings.
Pubudu L. Indrasiri, Dinh C. Nguyen, Bipasha Kashyap, Pubudu N. Pathirana, Yonina C. Eldar
IEEE Internet Things J.2
2024 Toward Privacy-Preserving Waste Classification in the Internet of Things
abstract
Diffuse waste data and associated privacy concerns present significant challenges for effective waste classification in the Internet of Things (IoT) realm. This research introduces a novel approach that leverages differential privacy (DP) and federated transfer learning (FTL) to address the issues, enabling waste classification while preserving privacy within the IoT ecosystem. By integrating Federated Learning (FL), Transfer Learning (TL), and DP, our proposed method facilitates collaborative training while ensuring data privacy. In this methodology, a pre-trained model, initially trained on the ImageNet dataset, is disseminated to IoT devices. Subsequently, these devices perform local training using the TrashNet and Garbage Classification datasets. This process allows devices to capture waste characteristics unique to their individual environments. Through the fusion of general knowledge pertaining to the trained model and local insights, the proposed approach achieves efficient waste classification. The study critically examines the implications for privacy, biases resulting from limited local data, and trade-offs between privacy and model performance. The experimental evaluation demonstrates the effectiveness of the approach and underscores the importance of ensuring privacy-sensitive waste classification. This research contributes to the discourse on FTL and encourages further research into privacy-preserving waste classification within the IoT.
Minh K. Quan, Dinh C. Nguyen, Van-Dinh Nguyen, Mayuri Wijayasundara, Sujeeva Setunge, Pubudu N. Pathirana
IEEE Internet Things J.2
2024 Network-Aided Intelligent Traffic Steering in 6G O-RAN: A Multi-Layer Optimization Framework
abstract
To enable an intelligent, programmable and multi-vendor radio access network (RAN) for 6G networks, considerable efforts have been made in standardization and development of open RAN (O-RAN). So far, however, the applicability of O-RAN in controlling and optimizing RAN functions has not been widely investigated. In this paper, we jointly optimize the flow-split distribution, congestion control and scheduling (JFCS) to enable an intelligent traffic steering application in O-RAN. Combining tools from network utility maximization and stochastic optimization, we introduce a multi-layer optimization framework that provides fast convergence, long-term utility-optimality and significant delay reduction compared to the state-of-the-art and baseline RAN approaches. Our main contributions are three-fold:$i$) we propose the novel JFCS framework to efficiently and adaptively direct traffic to appropriate radio units;$ii$) we develop low-complexity algorithms based on the reinforcement learning, inner approximation and bisection search methods to effectively solve the JFCS problem in different time scales; and$iii$) the rigorous theoretical performance results are analyzed to show that there exists a scaling factor to improve the tradeoff between delay and utility-optimization. Collectively, the insights in this work will open the door towards fully automated networks with enhanced control and flexibility. Numerical results are provided to demonstrate the effectiveness of the proposed algorithms in terms of the convergence rate, long-term utility-optimality and delay reduction.
Van-Dinh Nguyen, Thang X. Vu, Nhan Thanh Nguyen 0001, Dinh C. Nguyen, Markku Juntti, Nguyen Cong Luong 0001, Dinh Thai Hoang, Diep N. Nguyen, Symeon Chatzinotas
IEEE J. Sel. Areas Commun.4
2024 Federated Learning in Intelligent Transportation Systems: Recent Applications and Open Problems
abstract
Intelligent transportation systems (ITSs) have been fueled by the rapid development of communication technologies, sensor technologies, and the Internet of Things (IoT). Nonetheless, due to the dynamic characteristics of the vehicle networks, it is rather challenging to make timely and accurate decisions of vehicle behaviors. Moreover, in the presence of mobile wireless communications, the privacy and security of vehicle information are at constant risk. In this context, a new paradigm is urgently needed for various applications in dynamic vehicle environments. As a distributed machine learning technology, federated learning (FL) has received extensive attention due to its outstanding privacy protection properties and easy scalability. We conduct a comprehensive survey of the latest developments in FL for ITS. Specifically, we initially research the prevalent challenges in ITS and elucidate the motivations for applying FL from various perspectives. Subsequently, we review existing deployments of FL in ITS across various scenarios, and discuss specific potential issues in object recognition, traffic management, and service providing scenarios. Furthermore, we conduct a further analysis of the new challenges introduced by FL deployment and the inherent limitations that FL alone cannot fully address, including uneven data distribution, limited storage and computing power, and potential privacy and security concerns. We then examine the existing collaborative technologies that can help mitigate these challenges. Lastly, we discuss the open challenges that remain to be addressed in applying FL in ITS and propose several future research directions.
Shiying Zhang, Jun Li 0004, Long Shi 0001, Ming Ding 0001, Dinh C. Nguyen, Wuzheng Tan, Jian Weng 0001, Zhu Han 0001
IEEE Trans. Intell. Transp. Syst.5
2023 Improving the Utility of Differentially Private SGD by Employing Wavelet Transforms
abstract
Deep learning (DL) has become a powerful tool in many areas of research and industry, ranging from computer vision to natural language processing. Nonetheless, as DL models are trained on large amounts of sensitive data, concerns about data privacy have emerged. In light of this, differential privacy (DP) has emerged as a promising technique that provides strong privacy guarantees while allowing useful information to be extracted from the data. DP involves adding random noise to the training data or model parameters, which makes it difficult for an attacker to identify the contribution of any single data point to the final model. Despite the promising results, DP can significantly degrade the performance of DL models, especially when dealing with large datasets or complex models. To improve the balance between privacy and utility, this paper proposes a novel modification to the vanilla DP algorithm that uses a Haar wavelet transform. The proposed method achieves better utility while maintaining the same ($\varepsilon, \delta$) privacy guarantees as vanilla DP algorithms. The paper provides an analytical demonstration of the improved noise variance bounds compared to previous methods. The paper also provides a detailed analysis of the convergence performance of the proposed algorithm and shows that the Haar wavelet transform improves the accuracy and efficiency of the training process. The experimental evaluation demonstrates that the proposed method outperforms state-of-the-art algorithms on four widely used scientific benchmark datasets making this a significant contribution to DP techniques’ practical applications in DL.
Kanishka Ranaweera, David B. Smith 0001, Dinh C. Nguyen, Pubudu N. Pathirana, Ming Ding 0001, Thierry Rakotoarivelo, Aruna Seneviratne
IEEE Big Data3
2023 Performance Evaluation of Fog-to-Cloud Computing Schemes for IoMT Systems Using Queuing Models
abstract
The development of medicine hand-in-hand with the history of humans. The advent of 5th-generation communication networks have realized the Internet of Things concept and formed a series of smart applications in almost domains such as health-care, agriculture, transportation, retails, etc. In these contexts, the Internet of Medical Things (IoMT) is one of the most attended domains, where the service response time is a key design factor. In this study, we consider the effectiveness of this framework and compare it with the cloud-based computing framework under varying changes in the arrival rate of service requests by queuing models. The simulation results have demonstrated that the proposed fog-to-cloud based computing scheme outperforms cloud-based computing schemes in terms of response time, and meets SLA requirements for real-time IoMT systems. Finally, we discuss challenges to realising real-time IoMT systems in the Internet of Things Era.
Vu Khanh Quy, Abdellah Chehri, Dinh C. Nguyen
GLOBECOM5
2023 Enabling Intelligent Traffic Steering in A Hierarchical Open Radio Access Network
abstract
In this paper, we aim to enable an intelligent traffic (TS) steering application in the open radio access network (O-RAN) by jointly optimizing the flow-split distribution, congestion control and scheduling (i.e. so-called JFCS). To do so, we develop a multi-layer optimization framework based on network utility maximization and stochastic optimization methods. The proposed algorithm provides fast convergence, long-term utility-optimality and significantly low latency compared to state-of-the-art RAN approaches. In particular, our main contributions are as follows: i) we propose the novel JFCS framework to efficiently and adaptively route traffic to indented users in appropriate radio units, and ii) we develop low-complexity algorithms to effectively solve the JFCS problem in different time scales, enabling a closed-loop control of the TS in the O-RAN context. The insights presented in this work will pave the way for 0- RAN that are completely automated, offering improved control and flexibility.
Van-Dinh Nguyen, Thang X. Vu, Nhan Thanh Nguyen 0001, Dinh C. Nguyen, Markku Juntti, Nguyen Cong Luong 0001, Dinh Thai Hoang, Diep N. Nguyen, Symeon Chatzinotas
GLOBECOM4
2023 Intelligent Spectrum Sensing and Resource Allocation in Cognitive Networks via Deep Reinforcement Learning
abstract
Opportunistic spectrum access is a viable technique for cognitive radio (CR) networks to address the spectrum scarcity problem, where both spectrum sensing and resource allocation (SSRA) are significant to the system throughput performance. Previous works on SSRA often require complete network statistics which may not be feasible given the time-varying nature of practical CR networks. In this paper, we propose a learning-based optimization framework for SSRA in multi-band-multi-user CR networks. We develop a dynamic cooperative spectrum sensing strategy which allows secondary users to detect available spectrum bands of the primary user, followed by flexible power allocation for efficient data transmissions. To cope with the dynamic of channel and resource statistics, we propose an improved deep reinforcement learning scheme based on a maximum entropy-enabled actor critic algorithm. Numerical results demonstrate the superiority of our approach over existing schemes.
Dinh C. Nguyen, David J. Love, Christopher G. Brinton
ICC1
2023 Cooperative Task Offloading and Block Mining in Blockchain-Based Edge Computing With Multi-Agent Deep Reinforcement Learning
abstract
The convergence of mobile edge computing (MEC) and blockchain is transforming the current computing services in mobile networks, by offering task offloading solutions with security enhancement empowered by blockchain mining. Nevertheless, these important enabling technologies have been studied separately in most existing works. This article proposes a novel cooperative task offloading and block mining (TOBM) scheme for a blockchain-based MEC system where each edge device not only handles data tasks but also deals with block mining for improving the system utility. To address the latency issues caused by the blockchain operation in MEC, we develop a new Proof-of-Reputation consensus mechanism based on a lightweight block verification strategy. A multi-objective function is then formulated to maximize the system utility of the blockchain-based MEC system, by jointly optimizing offloading decision, channel selection, transmit power allocation, and computational resource allocation. We propose a novel distributed deep reinforcement learning-based approach by using a multi-agent deep deterministic policy gradient algorithm. We then develop a game-theoretic solution to model the offloading and mining competition among edge devices as a potential game, and prove the existence of a pure Nash equilibrium. Simulation results demonstrate the significant system utility improvements of our proposed scheme over baseline approaches.
Dinh C. Nguyen, Ming Ding 0001, Pubudu N. Pathirana, Aruna Seneviratne, Jun Li 0004, H. Vincent Poor
IEEE Trans. Mob. Comput.1
2022 A survey on blockchain for big data: Approaches, opportunities, and future directions
Natarajan Deepa, Quoc-Viet Pham, Dinh C. Nguyen, Sweta Bhattacharya, B. Prabadevi, G. Thippa Reddy, Praveen Kumar Reddy Maddikunta, Fang Fang 0005, Pubudu N. Pathirana
Future Gener. Comput. Syst.3
2022 Blockchain for Edge of Things: Applications, Opportunities, and Challenges
abstract
In recent years, blockchain networks have attracted significant attention in many research areas beyond cryptocurrency, one of them being the Edge of Things (EoT) that is enabled by the combination of edge computing and the Internet of Things (IoT). In this context, blockchain networks enabled with unique features, such as decentralization, immutability, and traceability, have the potential to reshape and transform the conventional EoT systems with higher security levels. Particularly, the convergence of blockchain and EoT leads to a new paradigm, calledBEoTthat has been regarded as a promising enabler for future services and applications. In this article, we present a state-of-the-art review of recent developments in the BEoT technology and discover its great opportunities in many application domains. We start our survey by providing an updated introduction to blockchain and EoT along with their recent advances. Subsequently, we discuss the use of BEoT in a wide range of industrial applications, from smart transportation, smart city, smart healthcare to smart home, and smart grid. Security challenges in the BEoT paradigm are also discussed and analyzed, with some key services, such as access authentication, data privacy preservation, attack detection, and trust management. Finally, some key research challenges and future directions are also highlighted to instigate further research in this promising area.
G. Thippa Reddy, Quoc-Viet Pham, Dinh C. Nguyen, Praveen Kumar Reddy Maddikunta, Natarajan Deepa, B. Prabadevi, Pubudu N. Pathirana, Jun Zhao 0007, Won-Joo Hwang
IEEE Internet Things J.3
2022 6G Internet of Things: A Comprehensive Survey
abstract
The sixth-generation (6G) wireless communication networks are envisioned to revolutionize customer services and applications via the Internet of Things (IoT) toward a future of fully intelligent and autonomous systems. In this article, we explore the emerging opportunities brought by 6G technologies in IoT networks and applications, by conducting a holistic survey on the convergence of 6G and IoT. We first shed light on some of the most fundamental 6G technologies that are expected to empower future IoT networks, including edge intelligence, reconfigurable intelligent surfaces, space–air–ground–underwater communications, Terahertz communications, massive ultrareliable and low-latency communications, and blockchain. Particularly, compared to the other related survey papers, we provide an in-depth discussion of the roles of 6G in a wide range of prospective IoT applications via five key domains, namely, healthcare IoTs, Vehicular IoTs and Autonomous Driving, Unmanned Aerial Vehicles, Satellite IoTs, and Industrial IoTs. Finally, we highlight interesting research challenges and point out potential directions to spur further research in this promising area.
Dinh C. Nguyen, Ming Ding 0001, Pubudu N. Pathirana, Aruna Seneviratne, Jun Li 0004, Dusit Niyato, Octavia A. Dobre, H. Vincent Poor
IEEE Internet Things J.1
2022 Federated Learning for COVID-19 Detection With Generative Adversarial Networks in Edge Cloud Computing
abstract
COVID-19 has spread rapidly across the globe and become a deadly pandemic. Recently, many artificial intelligence-based approaches have been used for COVID-19 detection, but they often require public data sharing with cloud datacentres and thus remain privacy concerns. This paper proposes a new federated learning scheme, called FedGAN, to generate realistic COVID-19 images for facilitating privacy-enhanced COVID-19 detection with generative adversarial networks (GANs) in edge cloud computing. Particularly, we first propose a GAN where a discriminator and a generator based on convolutional neural networks (CNNs) at each edge-based medical institution alternatively are trained to mimic the real COVID-19 data distribution. Then, we propose a new federated learning solution which allows local GANs to collaborate and exchange learned parameters with a cloud server, aiming to enrich the global GAN model for generating realistic COVID-19 images without the need for sharing actual data. To enhance the privacy in federated COVID-19 data analytics, we integrate a differential privacy solution at each hospital institution. Moreover, we propose a new blockchain-based FedGAN framework for secure COVID-19 data analytics, by decentralizing the FL process with a new mining solution for low running latency. Simulations results demonstrate the superiority of our approach for COVID-19 detection over the state-of-the-art schemes.
Dinh C. Nguyen, Ming Ding 0001, Pubudu N. Pathirana, Aruna Seneviratne, Albert Y. Zomaya
IEEE Internet Things J.1
2022 Aerial Computing: A New Computing Paradigm, Applications, and Challenges
abstract
In existing computing systems, such as edge computing and cloud computing, several emerging applications and practical scenarios are mostly unavailable or only partially implemented. To overcome the limitations that restrict such applications, the development of a comprehensive computing paradigm has garnered attention in both academia and industry. However, a gap exists in the literature, owing to the scarce research, and a comprehensive computing paradigm is yet to be systematically designed and reviewed. This study introduces a novel concept, calledaerial computing, via the amalgamation of aerial radio access networks and edge computing, which attempts to bridge the gap. Specifically, first, we propose a novel comprehensive computing architecture that is composed of low-altitude computing (LAC), high-altitude computing (HAC), and satellite computing platforms, along with conventional computing systems. We determine that aerial computing offers several desirable attributes: global computing service, better mobility, higher scalability and availability, and simultaneity. Second, we comprehensively discuss key technologies that facilitate aerial computing, including energy refilling, edge computing, network softwarization, frequency spectrum, multiaccess techniques, artificial intelligence, and big data. In addition, we discuss vertical domain applications (e.g., smart cities, smart vehicles, smart factories, and smart grids) supported by aerial computing. Finally, we highlight several challenges that need to be addressed and their possible solutions.
Quoc-Viet Pham, Rukhsana Ruby, Fang Fang 0005, Dinh C. Nguyen, Zhaohui Yang 0001, Mai Le, Zhiguo Ding 0001, Won-Joo Hwang
IEEE Internet Things J.4
2022 Incentive techniques for the Internet of Things: A survey
Praveen Kumar Reddy Maddikunta, Quoc-Viet Pham, Dinh C. Nguyen, Thien Huynh-The, Ons Aouedi, Gokul Yenduri, Sweta Bhattacharya, G. Thippa Reddy
J. Netw. Comput. Appl.3
2022 Latency Optimization for Blockchain-Empowered Federated Learning in Multi-Server Edge Computing
abstract
In this paper, we study a new latency optimization problem for blockchain-based federated learning (BFL) in multi-server edge computing. In this system model, distributed mobile devices (MDs) communicate with a set of edge servers (ESs) to handle both machine learning (ML) model training and block mining simultaneously. To assist the ML model training for resource-constrained MDs, we develop an offloading strategy that enables MDs to transmit their data to one of the associated ESs. We then propose a new decentralized ML model aggregation solution at the edge layer based on a consensus mechanism to build a global ML model via peer-to-peer (P2P)-based blockchain communications. Blockchain builds trust among MDs and ESs to facilitate reliable ML model sharing and cooperative consensus formation, and enables rapid elimination of manipulated models caused by poisoning attacks. We formulate latency-aware BFL as an optimization aiming to minimize the system latency via joint consideration of the data offloading decisions, MDs’ transmit power, channel bandwidth allocation for MDs’ data offloading, MDs’ computational allocation, and hash power allocation. Given the mixed action space of discrete offloading and continuous allocation variables, we propose a novel deep reinforcement learning scheme with a parameterized advantage actor critic algorithm. We theoretically characterize the convergence properties of BFL in terms of the aggregation delay, mini-batch size, and number of P2P communication rounds. Our numerical evaluation demonstrates the superiority of our proposed scheme over baselines in terms of model training efficiency, convergence rate, system latency, and robustness against model poisoning attacks.
Dinh C. Nguyen, Seyyedali Hosseinalipour, David J. Love, Pubudu N. Pathirana, Christopher G. Brinton
IEEE J. Sel. Areas Commun.1
2021 Deep Reinforcement Learning for Collaborative Offloading in Heterogeneous Edge Networks
abstract
Mobile Edge Computing (MEC) has been envisioned as an emerging paradigm to handle the overwhelming explosion of mobile applications and services, by allowing edge devices (EDs) to offload their computationally-intensive tasks to heterogeneous MEC servers. Most of the existing works focus mostly on a centralized agent or an independent multi-agent setting which cannot work well in distributed edge networks with heterogeneous computation tasks. This paper considers a more realistic setting consisting of multiple cooperative EDs and multiple MEC servers in heterogeneous edge networks (HENs). We propose a new collaborative offloading framework in a HEN where each ED acts as an intelligent agent to make offloading decisions collaboratively, aiming to achieve the optimal system utility. To this end, we formulate the collaborative offloading problem as a Markov game which is then solved by a novel multi-agent deep reinforcement learning (MADRL) approach based on a multi-agent deep deterministic policy gradient (MA-DDPG) algorithm. Numerical simulations with real-life mobile wireless datasets show that the proposed cooperative multi-agent scheme can improve the system utility by 43.6% compared to the non-cooperative offloading schemes.
Dinh C. Nguyen, Pubudu N. Pathirana, Ming Ding 0001, Aruna Seneviratne
CCGRID1
2021 Utility Optimization for Blockchain Empowered Edge Computing with Deep Reinforcement Learning
abstract
The combination of mobile edge computing (MEC) and blockchain is transforming the current computing services in Internet of Things networks, by offering task offloading solutions with security enhancement enabled by blockchain mining. Nevertheless, these important enabling technologies have been studied separately in most existing works. This article proposes a novel cooperative task offloading and block mining (TOBM) scheme to optimize the system utility in blockchain-empowered MEC. Herein, each edge device (ED) not only handles data tasks but also deals with block mining which makes the system design and optimization highly complex. Therefore, we develop a novel cooperative deep reinforcement learning (DRL) approach which allows EDs to cooperatively offload their data tasks to the MEC server and perform block mining based on a Proof-of-Reputation consensus mechanism. Simulation results demonstrate that the proposed scheme significantly improves offloading utility, reduces blockchain mining latency, and achieves better system utility, compared to other non-cooperative and cooperative schemes.
Dinh C. Nguyen, Ming Ding 0001, Pubudu N. Pathirana, Aruna Seneviratne, Jun Li 0004, H. Vincent Poor
ICC1
2021 Federated Learning Meets Blockchain in Edge Computing: Opportunities and Challenges
abstract
Mobile-edge computing (MEC) has been envisioned as a promising paradigm to handle the massive volume of data generated from ubiquitous mobile devices for enabling intelligent services with the help of artificial intelligence (AI). Traditionally, AI techniques often require centralized data collection and training in a single entity, e.g., an MEC server, which is now becoming a weak point due to data privacy concerns and high overhead of raw data communications. In this context, federated learning (FL) has been proposed to provide collaborative data training solutions, by coordinating multiple mobile devices to train a shared AI model without directly exposing their underlying data, which enjoys considerable privacy enhancement. To improve the security and scalability of FL implementation, blockchain as a ledger technology is attractive for realizing decentralized FL training without the need for any central server. Particularly, the integration of FL and blockchain leads to a new paradigm, called FLchain, which potentially transforms intelligent MEC networks into decentralized, secure, and privacy-enhancing systems. This article presents an overview of the fundamental concepts and explores the opportunities of FLchain in MEC networks. We identify several main issues in FLchain design, including communication cost, resource allocation, incentive mechanism, security and privacy protection. The key solutions and the lessons learned along with the outlooks are also discussed. Then, we investigate the applications of FLchain in popular MEC domains, such as edge data sharing, edge content caching and edge crowdsensing. Finally, important research challenges and future directions are also highlighted.
Dinh C. Nguyen, Ming Ding 0001, Quoc-Viet Pham, Pubudu N. Pathirana, Long Bao Le, Aruna Seneviratne, Jun Li 0004, Dusit Niyato, H. Vincent Poor
IEEE Internet Things J.1
2021 BEdgeHealth: A Decentralized Architecture for Edge-Based IoMT Networks Using Blockchain
abstract
The healthcare industry has witnessed significant transformations in e-health services by using mobile-edge computing (MEC) and blockchain to facilitate healthcare operations. Many MEC-blockchain-based schemes have been proposed, but some critical technical challenges still remain, such as low Quality of Services (QoS), data privacy, and system security vulnerabilities. In this article, we propose a new decentralized health architecture, called BEdgeHealth that integrates MEC and blockchain for data offloading and data sharing in distributed hospital networks. First, a data offloading scheme is proposed where mobile devices can offload health data to a nearby MEC server for efficient computation with privacy awareness. Moreover, we design a data-sharing scheme, which enables data exchanges among healthcare users by leveraging blockchain and interplanetary file system. Particularly, a smart contract-based authentication mechanism is integrated with MEC to perform decentralized user access verification at the network edge without requiring any central authority. The real-world experiment results and evaluations demonstrate the effectiveness of the proposed BEdgeHealth architecture in terms of improved QoS with data privacy and security guarantees, compared to the existing schemes.
Dinh C. Nguyen, Pubudu N. Pathirana, Ming Ding 0001, Aruna Seneviratne
IEEE Internet Things J.1
2021 Swarm intelligence for next-generation networks: Recent advances and applications
Quoc-Viet Pham, Dinh C. Nguyen, Seyedali Mirjalili, Dinh Thai Hoang, Diep N. Nguyen, Pubudu N. Pathirana, Won-Joo Hwang
J. Netw. Comput. Appl.2
2020 Blockchain and Edge Computing for Decentralized EMRs Sharing in Federated Healthcare
abstract
Blockchain and Mobile Edge Computing (MEC) are newly emerging technologies with great potential to revolutionize healthcare. This paper proposes a new decentralized healthcare architecture for distributed Electronic Medical Records (EMRs) sharing among federated hospitals based on blockchain and MEC. Unlike the existing schemes that often rely on a third-party for healthcare management, we focus on a fully decentralized access control solution by using smart contracts that enable EMRs access verification at the edge of the network without requiring any central authority. Moreover, a decentralized interplanetary file system (IPFS) platform is also integrated with smart contracts over the MEC network, which significantly reduces data retrieval latency and enhances security for EMRs sharing. The experimental results and analysis show the superior performance of the proposed scheme over the existing ones in terms of reduced data retrieval latency, enhanced blockchain performance, and security guarantees.
Dinh C. Nguyen, Pubudu N. Pathirana, Ming Ding 0001, Aruna Seneviratne
GLOBECOM1
2020 Blockchain for 5G and beyond networks: A state of the art survey
Dinh C. Nguyen, Pubudu N. Pathirana, Ming Ding 0001, Aruna Seneviratne
J. Netw. Comput. Appl.1
2020 Privacy-Preserved Task Offloading in Mobile Blockchain With Deep Reinforcement Learning
abstract
Blockchain technology with its secure, transparent and decentralized nature has been recently employed in many mobile applications. However, the process of executing extensive tasks such as computation-intensive data applications and blockchain mining requires high computational and storage capability of mobile devices, which would hinder blockchain applications in mobile systems. To meet this challenge, we propose a mobile edge computing (MEC) based blockchain network where multi-mobile users (MUs) act as miners to offload their data processing tasks and mining tasks to a nearby MEC server via wireless channels. Specially, we formulate task offloading, user privacy preservation and mining profit as a joint optimization problem which is modelled as a Markov decision process, where our objective is to minimize the long-term system offloading utility and maximize the privacy levels for all blockchain users. We first propose a reinforcement learning (RL)-based offloading scheme which enables MUs to make optimal offloading decisions based on blockchain transaction states, wireless channel qualities between MUs and MEC server and user's power hash states. To further improve the offloading performances for larger-scale blockchain scenarios, we then develop a deep RL algorithm by using deep Q-network which can efficiently solve large state space without any prior knowledge of the system dynamics. Experiment and simulation results show that the proposed RL-based offloading schemes significantly enhance user privacy, and reduce the energy consumption as well as computation latency with minimum offloading costs in comparison with the benchmark offloading schemes.
Dinh C. Nguyen, Pubudu N. Pathirana, Ming Ding 0001, Aruna Seneviratne
IEEE Trans. Netw. Serv. Manag.1