Yan Kyaw Tun

dblp:177/5482 · DBLP profile ↗
← Back
47ranked-venue papers
8as first author
36since 2021 · last 2026
0000-0002-8557-0082ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Computer networks · 37 · 8 first-author · 27 since 2021Applied, interdisciplinary, general and emerging computing · 2 · 2 since 2021Artificial intelligence and machine learning · 1 · 1 since 2021Databases, data management, data science and information retrieval · 1 · 1 since 2021
YearPublicationVenuePosition
2026 SemSpaceFL: A Collaborative Hierarchical Federated Learning Framework for Semantic Communication in 6G LEO Satellites
abstract
The advent of the sixth-generation (6G) wireless networks, enhanced by artificial intelligence, promises ubiquitous connectivity through Low Earth Orbit (LEO) satellites. These satellites are capable of collecting vast amounts of geographically diverse and real-time data, which can be immensely valuable for training intelligent models. However, limited inter-satellite communication and data privacy constraints hinder data collection on a single server for training. Therefore, we propose SemSpaceFL, a novel hierarchical federated learning (HFL) framework for LEO satellite networks, with integrated semantic communication capabilities. Our framework introduces a two-tier aggregation architecture where satellite models are first aggregated at regional gateways before final consolidation at a cloud server, which explicitly accounts for satellite mobility patterns and energy constraints. The key innovation lies in our novel aggregation approach, which dynamically adjusts the contribution of each satellite based on its trajectory and association with different gateways, which ensures stable model convergence despite the highly dynamic nature of LEO constellations. To further enhance communication efficiency, we incorporate semantic encoding-decoding techniques trained through the proposed HFL framework, which enables intelligent data compression while maintaining signal integrity. Our experimental results demonstrate that the proposed aggregation strategy achieves superior performance and faster convergence compared to existing benchmarks, while effectively managing the challenges of satellite mobility and energy limitations in dynamic LEO networks.
Loc X. Nguyen, Sheikh Salman Hassan, Yu Min Park, Yan Kyaw Tun, Zhu Han 0001, Choong Seon Hong
IEEE Trans. Commun.4
2026 Active STAR-RIS Empowered Edge System for Enhanced Energy Efficiency and Task Management
abstract
The proliferation of data-intensive, low-latency applications has driven the adoption of multi-access edge computing (MEC) to meet the demand for high-performance computing at the network edge. However, ensuring reliable communication under non-line-of-sight (NLoS) conditions remains a significant challenge. While reconfigurable intelligent surfaces (RISs) and the more recent simultaneously transmitting and reflecting RISs (STAR-RISs) offer promising solutions, their passive nature and susceptibility to multiplicative fading limit performance gains. To address these challenges, we propose a novel active STAR-RIS-assisted MEC system that enhances signal strength and adaptability by enabling amplification and joint control over signal transmission and reflection. Our objective is to minimize the energy consumption of user devices, considering both local task computation and uplink task offloading, while maintaining task queue stability. We formulate a joint energy minimization problem with system constraints and long-term queue stability requirements. This problem is decomposed into subproblems: (i) sequential fractional programming is applied to optimize user transmit power, (ii) convex optimization is used to determine partial task offloading ratios, and (iii) a modified Lyapunov optimization combined with double deep Q-networks (DDQN) is proposed to iteratively solve the active STAR-RIS parameters (amplitude and phase shift), amplification control, and task admission at the user side. Numerical results indicate that our proposed system outperforms the conventional passive STAR-RIS-assisted system by 18.64% and the conventional passive RIS-assisted system by 30.43%, respectively.
Pyae Sone Aung, Kitae Kim 0001, Yan Kyaw Tun, Eui-nam Huh, Zhu Han 0001, Choong Seon Hong
IEEE Trans. Mob. Comput.3
2026 Vision and Causal Learning Based Channel Estimation for THz Communications
abstract
The use of terahertz (THz) communications with massive multiple input multiple output (MIMO) systems in 6G can potentially provide high data rates and low latency communications. However, accurate channel estimation in THz frequencies presents significant challenges due to factors such as high propagation losses, sensitivity to environmental obstructions, and strong atmospheric absorption. These challenges are particularly pronounced in urban environments, where traditional channel estimation methods often fail to deliver reliable results, particularly in complex non-line-of-sight (NLoS) scenarios. This paper introduces a novel vision-based channel estimation technique that integrates causal reasoning into urban THz communication systems. The proposed method combines computer vision algorithms with variational causal dynamics (VCD) to analyze real-time images of the urban environment, allowing for a deeper understanding of the physical factors that influence THz signal propagation. By capturing the complex, dynamic interactions between physical objects (such as buildings, trees, and vehicles) and the transmitted signals, the model can predict the channel with up to twice the accuracy of conventional methods. This model improves estimation accuracy and demonstrates superior generalization performance. Hence, it can provide reliable predictions even in previously unseen urban environments. The effectiveness of the proposed method is particularly evident in NLoS conditions, where it significantly outperforms traditional methods such as by accounting for indirect signal paths, such as reflections and diffractions. Simulation results confirm that the proposed vision-based approach surpasses conventional artificial intelligence (AI)-based estimation techniques in accuracy and robustness, showing a substantial improvement across various dynamic urban scenarios. This framework provides a promising solution for enabling resilient THz communication, offering scalability and practicality for future 6G deployments in diverse urban landscapes.
Kitae Kim 0001, Yan Kyaw Tun, Md. Shirajum Munir, Christo Kurisummoottil Thomas, Walid Saad 0001, Choong Seon Hong
IEEE Trans. Mob. Comput.2
2025 A Contrastive Variational AutoEncoder for NSCLC Survival Prediction with Missing Modalities
abstract
Predicting survival outcomes for non-small cell lung cancer (NSCLC) patients is challenging due to the different individual prognostic features. This task can benefit from the integration of whole-slide images, bulk transcriptomics, and DNA methylation, which offer complementary views of the patient's condition at diagnosis. However, real-world clinical datasets are often incomplete, with entire modalities missing for a significant fraction of patients. State-of-the-art models rely on available data to create patient-level representations or use generative models to infer missing modalities, but they lack robustness in cases of severe missingness. We propose a Multimodal Contrastive Variational AutoEncoder (MCVAE) to address this issue: modality-specific variational encoders capture the uncertainty in each data source, and a fusion bottleneck with learned gating mechanisms is introduced to normalize the contributions from present modalities. We propose a multi-task objective that combines survival loss and reconstruction loss to regularize patient representations, along with a cross-modal contrastive loss that enforces cross-modal alignment in the latent space. During training, we apply stochastic modality masking to improve the robustness to arbitrary missingness patterns. Extensive evaluations on the TCGA-LUAD ($n=475$) and TCGA-LUSC ($n=446$) datasets demonstrate the efficacy of our approach in predicting disease-specific survival (DSS) and its robustness to severe missingness scenarios compared to two state-of-the-art models. Finally, we bring some clarifications on multimodal integration by testing our model on all subsets of modalities, finding that integration is not always beneficial to the task.
Michele Zanitti, Vanja Miskovic, Francesco Trovò, Alessandra Pedrocchi, Ming Shen 0001, Yan Kyaw Tun, Arsela Prelaj, Sokol Kosta
IEEE Big Data6
2025 Energy-Efficient Multi-UAV-Assisted Integrated Sensing, Communication, and Computing for Remote Areas
abstract
Extending wireless connectivity to remote areas is essential for delivering intelligent services in critical sectors, i.e., healthcare, agriculture, and disaster management. Unmanned aerial vehicles (UAVs) have emerged as a promising solution due to their agile mobility, low deployment cost, and line-of-sight (LoS) communication capabilities. However, efficiently managing UAV resources while integrating sensing, communication, and computing (ISCC) functionalities presents significant challenges. In this paper, we propose a multi-UAV-assisted ISCC framework that simultaneously supports wireless communication links for computational task offloading, remote computing, and active target sensing. A comprehensive system model is developed, and a joint optimization problem is formulated to minimize the weighted sum energy consumption of UAVs and remote users, subject to constraints on latency, power budget, and UAV mobility. To solve the resulting non-convex problem, we design a decomposition-based solution that integrates a convex optimization technique with the deep deterministic policy gradient (DDPG) algorithm. Simulation results demonstrate the effectiveness of the proposed framework in achieving energy-efficient operation under practical system constraints.
Yan Kyaw Tun, Nway Nway Ei, Sheikh Salman Hassan, Madyan Alsenwi, Cedomir Stefanovic, Zhu Han 0001, Choong Seon Hong
GLOBECOM1
2025 Prototype-Guided Federated Knowledge Distillation Approach in LEO Satellite-HAP System
abstract
Low Earth orbit (LEO) satellites nowadays play a pivotal role in collecting images for the Earth observation. However, the images collected by satellites are possibly tremendous, which causes challenges in dealing with the satellite images. Those challenges include: 1) the unrealistic of transmitting those massive image data to the ground station for centralized analysis because of restricted satellite communication bandwidth and the data privacy issue, and 2) satellite data may be non-independent and identically distributed (non-IID). In this paper, we propose a prototype-guided federated knowledge distillation (Pro-FedKD) approach in an LEO Satellite-high altitude platform (HAP) system, which is designed based on self-knowledge distillation (SKD), federated prototype learning (FedProto) and federated learning (FL). Owing to the adoption of FL, the first challenge can be handled since FL does not require data to leave the local side. To cope with the second challenge, SKD and FedProto are employed. In addition, both model aggregation and prototype aggregation are employed on a pre-defined HAP. To enhance the effectiveness, a top-$N$model aggregation mechanism is proposed, in which among all models,$N$local models that can achieve the top$N$maximum accuracies over the validation dataset of the pre-defined HAP will be selected for aggregation. Experiments demonstrate the error rate gained by the proposed Pro-FedKD method is separately 3.76×, 3.17×, 1.55×, and 1.18× smaller than FedExP, MOON, FedProto, and pFedSD over the EuroSAT dataset, demonstrating a significant reduction. The proposed method also exhibits preeminence in other datasets.
Luyao Zou, Yan Kyaw Tun, Apurba Adhikary, Dong Uk Kim, Zhu Han 0001, Choong Seon Hong
ICC2
2025 Towards Satellite Non-IID Imagery: A Spectral Clustering-Assisted Federated Learning Approach
abstract
Low Earth orbit (LEO) satellites are capable of gathering abundant Earth observation data (EOD) to enable different Internet of Things (IoT) applications. However, to accomplish an effective EOD processing mechanism, it is imperative to investigate: 1) the challenge of processing the observed data without transmitting those large-size data to the ground because the connection between the satellites and the ground stations is intermittent, and 2) the challenge of processing the non-independent and identically distributed (non-IID) satellite data. In this paper, to cope with those challenges, we propose an orbit-based spectral clustering-assisted clustered federated self-knowledge distillation (OSC-FSKD) approach for each orbit of an LEO satellite constellation, which retains the advantage of FL that the observed data does not need to be sent to the ground. Specifically, we introduce normalized Laplacian-based spectral clustering (NLSC) into federated learning (FL) to create clustered FL in each round to address the challenge resulting from non-IID data. Particularly, NLSC is adopted to dynamically group clients into several clusters based on cosine similarities calculated by model updates. In addition, self-knowledge distillation is utilized to construct each local client, where the most recent updated local model is used to guide current local model training. Experiments demonstrate that the observation accuracy obtained by the proposed method is separately$1. 01\times, 2.15\times, 1.10\times$, and$1.03\times$higher than that of pFedSD, FedProx, FedAU, and FedALA approaches using the SAT4 dataset. The proposed method also shows superiority when using other datasets.
Luyao Zou, Yu Min Park, Chu Myaet Thwal, Yan Kyaw Tun, Zhu Han 0001, Choong Seon Hong
NOMS4
2025 Optimized Satellite Participation in Federated Learning over LEO Constellation Networks
abstract
This paper presents an intelligent device selection framework for Federated Learning (FL) in Low Earth Orbit (LEO) satellite constellation networks. In particular, the high mobility, intermittent connectivity and long communication delays in LEO satellite networks significantly impact FL convergence and model performance. To address these challenges, we formulate a device selection optimization problem that determines the optimal subset of LEO satellites to participate in global model aggregation at each round. The objective is to minimize the average loss while satisfying latency constraints. To solve the formulated problem, we develop a deep reinforcement learning (DRL)-based solution that enables adaptive satellite selection considering the stochastic nature of satellite connectivity and channel variability. The proposed framework selects participating satellites dynamically based on their communication latency and computational capabilities to improve the overall efficiency of the FL process. Simulation results show that the proposed approach accelerates convergence compared to conventional synchronous FL while maintaining model accuracy.
Madyan Alsenwi, Eva Lagunas, Jorge Querol, Mohammed Alansi, Dinh-Hieu Tran, Yan Kyaw Tun, Symeon Chatzinotas
PIMRC6
2025 Resource Allocation Under Uncertainty in LEO Satellite Constellation Networks
abstract
Low Earth Orbit (LEO) satellite constellations consist of numerous satellites orbiting at different altitudes to serve diverse terrestrial users. Efficient resource management in such dynamic and large-scale networks presents a significant challenge. This paper studies Resource Blocks (RBs) and transmit power allocation at each LEO satellite, aiming at enhancing network performance while meeting Quality of Service (QoS) requirements. A stochastic optimization problem is formulated where the required QoS by each user is expressed as a chance constraint of the minimum data rate requirements considering network dynamics and uncertainties in channel conditions and traffic demands. The Conditional Value at Risk (CVaR) is employed to reformulate the chance constraint into a convex form and achieve a robust solution. Then, an alternating optimization approach is applied to solve the optimization problem. Through simulations using real data from the Starlink constellation, we demonstrate the efficacy of the proposed approach in improving network data rates while maintaining the required QoS levels.
Madyan Alsenwi, Eva Lagunas, Jorge Querol, Yan Kyaw Tun, Symeon Chatzinotas
WCNC4
2025 Design Optimization of NOMA Aided Multi-STAR-RIS for Indoor Environments: A Convex Approximation Imitated Reinforcement Learning Approach
abstract
Non-orthogonal multiple access (NOMA) enables multiple users to share the same frequency band, and simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS) provides 360-degree full-space coverage, optimizing both transmission and reflection for improved network performance and dynamic control of the indoor environment. However, deploying STAR-RIS indoors presents challenges in interference mitigation, power consumption, and real-time configuration. In this work, a novel network architecture utilizing multiple access points (APs), STAR-RISs, and NOMA is proposed for indoor communication. To address these, we formulate an optimization problem involving user assignment, access point (AP) beamforming, and STAR-RIS phase control. A decomposition approach is used to solve the complex problem efficiently, employing a many-to-one matching algorithm for user-AP assignment and K-means clustering for resource management. Additionally, multi-agent deep reinforcement learning (MADRL) is leveraged to optimize the control of the STAR-RIS. Within the proposed MADRL framework, a novel approach is introduced in which each decision variable acts as an independent agent, enabling collaborative learning and decision making. The MADRL framework is enhanced by incorporating convex approximation (CA), which accelerates policy learning through suboptimal solutions from successive convex approximation (SCA), leading to faster adaptation and convergence. Simulations demonstrate significant improvements in network utility compared to baseline approaches.
Yu Min Park, Sheikh Salman Hassan, Yan Kyaw Tun, Eui-nam Huh, Walid Saad 0001, Choong Seon Hong
IEEE Trans. Mob. Comput.3
2025 Joint UAV Deployment and Resource Allocation in THz-Assisted MEC-Enabled Integrated Space-Air-Ground Networks
abstract
Multi-access edge computing (MEC)-enabled integrated space-air-ground (SAG) networks have drawn much attention recently, as they can provide communication and computing services to wireless devices in areas that lack terrestrial base stations (TBSs). Leveraging the ample bandwidth in the terahertz (THz) spectrum, in this paper, we propose MEC-enabled integrated SAG networks with collaboration among unmanned aerial vehicles (UAVs). We then formulate the problem of minimizing the energy consumption of devices and UAVs in the proposed MEC-enabled integrated SAG networks by optimizing tasks offloading decisions, THz sub-bands assignment, transmit power control, and UAVs deployment. The formulated problem is a mixed-integer nonlinear programming (MILP) problem with a non-convex structure, which is challenging to solve. We thus propose a block coordinate descent (BCD) approach to decompose the problem into four sub-problems: 1) device task offloading decision problem, 2) THz sub-band assignment and power control problem, 3) UAV deployment problem, and 4) UAV task offloading decision problem. We then propose to use a matching game, concave-convex procedure (CCP) method, successive convex approximation (SCA), and block successive upper-bound minimization (BSUM) approaches for solving the individual subproblems. Finally, extensive simulations are performed to demonstrate the effectiveness of our proposed algorithm.
Yan Kyaw Tun, György Dán, Yu Min Park, Choong Seon Hong
IEEE Trans. Mob. Comput.1
2025 Semantic Communication Enabled 6G-NTN Framework: A Novel Denoising and Gateway Hop Integration Mechanism
abstract
The sixth-generation (6G) non-terrestrial networks (NTNs) are crucial for real-time monitoring in critical applications like disaster relief. However, limited bandwidth, latency, rain attenuation, long propagation delays, and co-channel interference pose challenges to efficient satellite communication. Therefore, semantic communication (SC) has emerged as a promising solution to improve transmission efficiency and address these issues. In this paper, we explore the potential of SC as a bandwidth-efficient, latency-minimizing strategy specifically suited to 6G satellite communications. The existing SC methods have demonstrated efficacy in direct satellite-terrestrial transmissions; however, they still encounter certain limitations. Specifically, some ground users (GUs) experience poor signal-to-noise ratios (SNR), making direct satellite communication challenging. To address these issues, we propose a novel framework that optimizes gateway hop-relay selection for GUs with low SNR and integrates gateway-based denoising mechanisms to ensure high-quality-of-service (QoS) in satellite-based SC networks. This approach directly mitigates distortion, leading to significant improvements in satellite service performance by delivering customized services tailored to the unique signal conditions of each GU. Our findings represent a critical advancement in reliable and efficient data transmission from the Earth observation satellites, thereby enabling fast and effective responses to urgent events. Simulation results demonstrate that our proposed strategy significantly enhances overall network performance, outperforming conventional methods by offering tailored communication services based on specific GU conditions.
Loc X. Nguyen, Sheikh Salman Hassan, Yan Kyaw Tun, Kitae Kim 0001, Zhu Han 0001, Choong Seon Hong
IEEE Trans. Wirel. Commun.3
2024 Novel Aerial User Equipment Task Offloading Optimization in Integrated 6G Terrestrial and Non-Terrestrial Networks: A Deep Reinforcement Learning Approach
abstract
This paper investigates a novel network architecture – the 6G integrated terrestrial-non-terrestrial network (ITNTN) with multi-access edge computing (ITNT-MEC). This system aims to bridge the connectivity gap between terrestrial infrastructure and non-terrestrial networks while offering real-time data processing through edge computing. We consider a scenario where aerial user equipments (AUEs) share resources of terrestrial base stations (TBSs) with terrestrial UEs (TUEs). We formulate an optimization problem to minimize the total energy consumption of both AUEs and TUEs. This problem involves joint optimization of AUE association (i.e., TBS or low Earth orbit (LEO) satellite), AUE trajectories, and TBS bandwidth allocation. Due to the dynamic network environment and non-convex optimization characteristics, solving this problem presents a significant challenge. To address this, we propose a novel algorithm that combines block coordinate descent (BCD) with deep deterministic policy gradient (DDPG) and a convex optimization method. Simulation results demonstrate the significant reductions in total energy consumption compared to baseline approaches, achieving improvements of 23%, 36.6%, and 46.5% against DQN-TO, RA, and FT, respectively.
Nway Nway Ei, Sheikh Salman Hassan, Yan Kyaw Tun, Zhu Han 0001, Choong Seon Hong
GLOBECOM3
2024 Semantic Enabled 6G LEO Satellite Communication for Earth Observation: A Resource-Constrained Network Optimization
abstract
Earth observation satellites generate large amounts of real-time data for monitoring and managing time-critical events such as disaster relief missions. This presents a major challenge for satellite-to-ground communications operating under limited bandwidth capacities. This paper explores semantic communication (SC) as a potential alternative to traditional communication methods. The rationality for adopting SC is its inherent ability to reduce communication costs and make spectrum efficient for 6G non-terrestrial networks (6G-NTNs). We focus on the critical satellite imagery downlink communications latency optimization for Earth observation through SC techniques. We formulate the latency minimization problem with SC quality-of-service (SC-QoS) constraints and address this problem with a meta-heuristic discrete whale optimization algorithm (DWOA) and a one-to-one matching game. The proposed approach for captured image processing and transmission includes the integration of joint semantic and channel encoding to ensure downlink sum-rate optimization and latency minimization. Empirical results from experiments demonstrate the efficiency of the proposed framework for latency optimization while preserving high-quality data transmission when compared to baselines.
Sheikh Salman Hassan, Loc X. Nguyen, Yan Kyaw Tun, Zhu Han 0001, Choong Seon Hong
GLOBECOM3
2024 Pilot Optimization and Channel Estimation Scheme for Semantic Communication: A Framework for Edge Intelligence
abstract
The semantic communication system has become one of the promising communication technologies to support high data-intensive artificial intelligence (AI) applications and services such as meta-verse, 3D maps, and so on for achieving low communication overhead. Unlike traditional communication system, accurate channel estimation is a vital issue in semantic wireless communication since a semantic transmitter is required to send the core meaning of a message rather than an entire bit streams for the receiver. Thus, designing a semantic communication framework is challenging due to the dependencies of the semantic encoder and decoder over the orthogonal frequency division multiplexing (OFDM) setting. Therefore, first, this work designs a holistic semantic communication system model that is composed of a semantic encoder, a 3GPP-defined cluster delay line (CDL) wireless channel model, and a semantic decoder for AI services. Second, this paper proposes a semantic communication framework for AI services, 1) a masked autoencoder (MAE)-based channel estimation, and 2) a hierarchical reinforcement learning (HRL)-based pilot allocation method. Third, the proposed semantic communication framework is trained in an end-to-end manner, combined with OFDM layers, considering the image reconstruction and the performance of vision AI applications. Finally, the proposed MAE-based channel estimation and HRL-based pilot allocation RL agent are integrated into the semantic communication framework. Finally, Experimental results show that the proposed semantic framework demonstrates up to a 21.25% performance improvement in image segmentation tasks. Furthermore, the proposed channel estimator and pilot allocator also show higher channel estimation accuracy compared to existing channel estimators and pilot allocation methods.
Kitae Kim 0001, Yan Kyaw Tun, Md. Shirajum Munir, Walid Saad 0001, Choong Seon Hong
NOMS2
2024 Joint User Pairing and Beamforming Design of Multi-STAR-RISs-Aided NOMA in the Indoor Environment via Multi-Agent Reinforcement Learning
abstract
To increase the quality of the 6G / B5G network, conventional cellular networks based on terrestrial base stations are geographically and economically restricted. Meanwhile, Non-Orthogonal Multiple Access (NOMA) allows multiple users to share the same resources, which improves the spectral efficiency of the system and has the advantage of supporting a larger number of users. Additionally, by intelligently manipulating the phase and amplitude of both the reflected and transmitted signals, Simultaneously Transmitting and Reflecting RISs (STAR-RISs) can achieve improved coverage, increased spectral efficiency, and enhanced communication reliability. However, STAR-RISs must simultaneously optimize the amplitude and phase shift corresponding to reflection and transmission, which makes existing terrestrial networks more complicated and is considered a major challenge. Motivated by the above, we study the joint user pairing for NOMA and the beamforming design of Multi-STAR-RISs in an indoor environment. Then, we formulate the optimization problem with the objective of maximizing the total throughput of mobile users (MUs) by jointly optimizing the decoding order, user pairing, active beamforming, and passive beamforming. However, the formulated problem is a mixed-integer non-linear programming (MINLP). To address this challenge, we first introduce the decoding order for NOMA networks. Next, we decompose the original problem into two subproblems, namely: 1) MU pairing and 2) Beamforming optimization under the optimal decoding order. For the first subproblem, we employ correlation-based K-means clustering to solve the user pairing problem. Then, to jointly deal with beamforming vector optimizations, we propose Multi-Agent Proximal Policy Optimization (MAPPO), which can make quick decisions in the given environment owing to its low complexity. Finally, simulation results prove that our proposed MAPPO algorithm is superior to Proximal Policy Optimization (PPO) and Advanced Actor-Critic (A2C) by a maximum of 1% and 6%, respectively. Furthermore, the proposed algorithm converges 1.5 times faster than the typical PPO algorithm.
Yu Min Park, Yan Kyaw Tun, Choong Seon Hong
NOMS2
2024 Deep Reinforcement Learning-Based Joint Spectrum Allocation and Configuration Design for STAR-RIS-Assisted V2X Communications
abstract
Vehicle-to-everything (V2X) communications is pivotal for modern transportation systems, but the challenges arise in scenarios with buildings, leading to signal obstruction and limited coverage. To alleviate these challenges, reconfigurable intelligent surface (RIS) is regarded as an effective solution for communication performance by tuning passive signal reflection. RIS has acquired prominence in 6G networks due to its improved spectral efficiency, simple deployment, and cost-effectiveness. Nevertheless, conventional RIS solutions have coverage limitations. Researchers are exploring on the promising concept of simultaneously transmitting and reflecting RIS (STAR-RIS), which provides 360° coverage while utilizing the advantages of RIS technology. In this article, an STAR-RIS-assisted V2X communication system is investigated. An optimization problem is formulated to maximize the achievable data rate for vehicle-to-infrastructure (V2I) users while satisfying the latency and reliability requirements of vehicle-to-vehicle (V2V) pairs by jointly optimizing the spectrum allocation, amplitude and phase shift values of STAR-RIS elements, digital beamforming vectors for V2I links, and transmit power for V2V pairs. Since it is challenging to solve in polynomial time, we decompose our problem into two subproblems. For the first subproblem, we model the control variables as a Markov Decision Process and propose a combined double deep$Q$-network (DDQN) with an attention mechanism so that the model can potentially focus on relevant inputs. For the latter, a standard optimization-based approach is implemented to provide a real-time solution, reducing computational costs. Numerical results demonstrate that our solution approach outperforms the vanilla DDQN approach by 5.2%, and our proposed system outperforms the conventional RIS by 39%.
Pyae Sone Aung, Loc X. Nguyen, Yan Kyaw Tun, Zhu Han 0001, Choong Seon Hong
IEEE Internet Things J.3
2024 SpaceRIS: LEO Satellite Coverage Maximization in 6G Sub-THz Networks by MAPPO DRL and Whale Optimization
abstract
Satellite systems face a significant challenge in effectively utilizing limited communication resources to meet the demands of ground network traffic, characterized by asymmetrical spatial distribution and time-varying characteristics. Moreover, the coverage range and signal transmission distance of low Earth orbit (LEO) satellites are restricted by notable propagation attenuation, molecular absorption, and space losses in sub-terahertz (THz) frequencies. This paper introduces a novel approach to maximize LEO satellite coverage by leveraging reconfigurable intelligent surface (RIS) within 6G sub-THz networks. Optimization objectives include improving end-to-end (E2E) data rate, optimizing satellite-remote user equipment (RUE) associations, data packet routing within satellite constellations, RIS phase shift, and ground base station (GBS) transmit power (i.e., active beamforming). The formulated joint optimization problem poses significant challenges because of its time-varying environment, non-convex characteristics, and NP-hard complexity. To address these challenges, we propose a block coordinate descent (BCD) algorithm that integrates balanced K-means clustering, multi-agent proximal policy optimization (MAPPO) deep reinforcement learning (DRL), and whale optimization algorithm (WOA) techniques. The performance of the proposed approach is demonstrated through comprehensive simulation results, demonstrating its superiority over existing baseline methods in the literature.
Sheikh Salman Hassan, Yu Min Park, Yan Kyaw Tun, Walid Saad 0001, Zhu Han 0001, Choong Seon Hong
IEEE J. Sel. Areas Commun.3
2024 Satellite-Based ITS Data Offloading & Computation in 6G Networks: A Cooperative Multi-Agent Proximal Policy Optimization DRL With Attention Approach
abstract
The proliferation of intelligent transportation systems (ITS) has led to increasing demand for diverse network applications. However, conventional terrestrial access networks (TANs) are inadequate in accommodating various applications for remote ITS nodes, i.e., airplanes and ships. In contrast, satellite access networks (SANs) offer supplementary support for TANs, in terms of coverage flexibility and availability. In this study, we propose a novel approach to ITS data offloading and computation services based on SANs. We use low-Earth orbit (LEO) and cube satellites (CubeSats) as independent mobile edge computing (MEC) servers that schedule the processing of data generated by ITS nodes. To optimize offloading task selection, computing, and bandwidth resource allocation for different satellite servers, we formulate a joint delay and rental price minimization problem that is mixed-integer non-linear programming (MINLP) and NP-hard. We propose a cooperative multi-agent proximal policy optimization (Co-MAPPO) deep reinforcement learning (DRL) approach with an attention mechanism to deal with intelligent offloading decisions. We also decompose the remaining subproblem into three independent subproblems for resource allocation and use convex optimization techniques to obtain their optimal closed-form analytical solutions. We conduct extensive simulations and compare our proposed approach to baselines, resulting in performance improvements of 9.9%, 5.2%, and 4.2%, respectively.
Sheikh Salman Hassan, Yu Min Park, Yan Kyaw Tun, Walid Saad 0001, Zhu Han 0001, Choong Seon Hong
IEEE Trans. Mob. Comput.3
2023 Sum-Rate Maximization in Integrated Space-Air-Ground Networks under Backhaul Capacity Constraints
abstract
Integrated space-air-ground (ISAG) networks have emerged as a promising technology for next-generation commu-nication networks, which demand higher throughput and wider coverage. However, several challenges must be addressed, such as wireless resource and interference management, transmit power control, and optimal deployment of unmanned aerial vehicles (UAV s) to achieve higher throughput. To this end, in this paper, we propose the joint transmit power control and the deployment UAV problem in the ISAG network to maximize the sum-rate of devices while guaranteeing the minimum rate requirement of each device and the wireless backhaul link constraints between UAV s and the satellite. However, solving the resulting problem is challenging since it has a non-convex structure. As a solution, we propose to decompose the problem into two subproblems. We then transform the decomposed subproblems into convex forms and solve them using successive convex approximation (SCA). Finally, we conduct extensive simulations to show the effectiveness of the proposed method, and the numerical results show that the proposed method achieves a performance gain: up to 8.35%, and 4.08% in comparison to FPA and C-UAVs schemes.
Yan Kyaw Tun, György Dán
GLOBECOM1
2023 Deep Reinforcement Learning based Spectral Efficiency Maximization in STAR-RIS-Assisted Indoor Outdoor Communication
abstract
The significant growth in data consumption among mobile users necessitates the development of new architecture to meet the increasing demand. On the other hand, reconfigurable intelligent surface (RIS) has grown in popularity in 6G due to its improved spectral efficiency, simplicity of deployment, and low cost. However, with the constrained limitation of the coverage by conventional RIS, the research direction has turned towards simultaneously transmitting and reflecting RIS (STAR-RIS) to provide 360° coverage alongside the benefits of RIS. In this paper, a STAR-RIS-assisted downlink communication system for both indoor and outdoor users is investigated. Then, the optimization problem to maximize the spectral efficiency while jointly controlling the beamforming power for each user and phase shift values of the STAR-RIS is formulated. Since the formulated problem is NP-hard and challenging to solve in polynomial time, a policy gradient method for reinforcement learning named proximal policy optimization (PPO) is implemented to solve the problem. To demonstrate the effectiveness of our proposed algorithm, extensive simulation results are executed. Numerical results prove that our proposed algorithm outperforms several benchmark schemes in the literature.
Pyae Sone Aung, Loc X. Nguyen, Yan Kyaw Tun, Zhu Han 0001, Choong Seon Hong
NOMS3
2023 Energy Efficient Leaderless Softwarized UAV Network: Joint Intelligent User Association and Resource Allocation Design
abstract
Unmanned aerial vehicles (UAVs) have been conceived as an available solution to substitute terrestrial base stations (TBSs) to provide downloading services for user equipment (i.e. mobile devices) that have difficulty communicating directly with TBSs. However, the mobility of user equipment (UE) and the random nature of the number of UE will cause several challenges including 1) the hardness of determining optimal user association and UAV resource (i.e., bandwidth and transmit power) allocation decision, 2) the burden of network function maintenance owing to the necessity of shutting down the entire system. Therefore, in this article, joint user association and resource allocation are designed for a software-defined network (SDN)-adopted leaderless softwarized UAV network, where each UAV is regarded as a flying SDN controller to enhance the control ability of the considered network. The purpose is to maximize energy efficiency (EE) with satisfying the quality of service (QoS). To this end, a joint method based on hierarchical agglomerative clustering (HAGC) and multi-agent deep deterministic policy gradient (MADDPG) is proposed. Specifically, the HAGC approach is utilized to determine the optimal MDs association with UAVs. Afterward, MADDPG approach is leveraged to obtain the best policy for resource allocation, aiming to achieve the maximum EE. Finally, the effectiveness of the proposed method is confirmed by the evaluation results.
Luyao Zou, Sheikh Salman Hassan, Yan Kyaw Tun, Zhu Han 0001, Choong Seon Hong
NOMS3
2023 Seamless and Energy-Efficient Maritime Coverage in Coordinated 6G Space-Air-Sea Non-Terrestrial Networks
abstract
Non-terrestrial networks (NTNs), which integrate space and aerial networks with terrestrial systems, are a key area in the emerging sixth-generation (6G) wireless networks. As part of 6G, NTNs must provide pervasive connectivity to a wide range of devices, including smartphones, vehicles, sensors, robots, and maritime users. However, due to the high mobility and deployment of NTNs, managing the space-air–sea (SAS) NTN resources, i.e., energy, power, and channel allocation, is a major challenge. The design of an SAS-NTN for energy-efficient resource allocation is investigated in this study. The goal is to maximize system energy efficiency (EE) by collaboratively optimizing user equipment (UE) association, power control, and unmanned aerial vehicle (UAV) deployment. Given the limited payloads of UAVs, this work focuses on minimizing the total energy cost of UAVs (trajectory and transmission) while meeting EE requirements. A mixed-integer nonlinear programming problem is proposed, followed by the development of an algorithm to decompose, and solve each problem distributedly. The binary (UE association) and continuous (power, deployment) variables are separated using the Bender decomposition (BD), and then the Dinkelbach algorithm (DA) is used to convert fractional programming into an equivalent solvable form in the subproblem. A standard optimization solver is utilized to deal with the complexity of the master problem for binary variables. The alternating direction method of multipliers (ADMM) algorithm is used to solve the subproblem for the continuous variables. Our proposed algorithm provides a suboptimal solution, and simulation results demonstrate that the algorithm achieves better EE and spectral efficiency (SE) than baselines.
Sheikh Salman Hassan, DoHyeon Kim, Yan Kyaw Tun, Nguyen Hoang Tran, Walid Saad 0001, Choong Seon Hong
IEEE Internet Things J.3
2023 Dependency Tasks Offloading and Communication Resource Allocation in Collaborative UAV Networks: A Metaheuristic Approach
abstract
Nowadays, unmanned aerial vehicles (UAVs)-assisted mobile-edge computing (MEC) systems have been exploited as a promising solution for providing computation services to mobile users outside of terrestrial networks. However, it remains challenging for standalone UAVs to meet the computation requirement of numerous users due to their limited computation capacity and battery lives. Therefore, we propose a collaborative scheme among UAVs to share the workload between them. Furthermore, this work is the first to consider the task topology of offloading in MEC-enabled UAVs networks while restricting their power consumption. We study the task topology, in which a task consists of a set of subtasks, and each subtask has dependencies upon other subtasks. In the real world, subtasks with dependencies must wait for their preceding subtasks to complete before being executed, and this affects the offloading strategy. Next, we formulate an optimization problem to minimize the average latency of users by jointly controlling the offloading decision for dependent tasks and allocating the communication resources of UAVs. The formulated problem is NP-hard and cannot be solved in polynomial time. Therefore, we divide the problem into two subproblems: 1) offloading decision problem and 2) communication resource allocation problem. Then, a metaheuristic method is proposed to find the suboptimal solution to the former problem, while the latter problem is solved by using convex optimization. Finally, we conduct simulation experiments to prove that our proposed offloading technique outperforms several benchmark schemes in minimizing the average latency of users for dependency tasks and achieving higher uplink transmission rates.
Loc X. Nguyen, Yan Kyaw Tun, Nguyen Dang Tri, Yu Min Park, Zhu Han 0001, Choong Seon Hong
IEEE Internet Things J.2
2023 A Contract-Theory-Based Incentive Mechanism for UAV-Enabled VR-Based Services in 5G and Beyond
abstract
The proliferation of novel infotainment services such as Virtual Reality(VR)-based services has fundamentally changed the existing mobile networks. These bandwidth-hungry services expanded at a tremendously rapid pace, thus, generating a burden of data traffic in the mobile networks. To cope with this issue, one can use Multi-access Edge Computing (MEC) to bring the resource to the edge. By doing so, we can release the burden of the core network by taking the communication, computation, and caching resources nearby the end-users (UEs). Nevertheless, due to the vast adoption of VR-enabled devices, MEC resources might be insufficient in peak times or dense settings. To overcome these challenges, we propose a system model where the service provider (SP) might rent Unmanned Area Vehicles (UAVs) from UAV service providers (USPs) to serve as micro-based stations (UBSs) that expand the service area and improve the spectrum efficiency. In which, UAV can pre-cached certain sets of VR-based contents and serve UEs via air-to-ground (A2G) communication. Furthermore, future intelligent devices are capable of 5G and B5G communication interfaces, and thus, they can communicate with UAVs via A2G links. By doing so, we can significantly reduce a considerable amount of data traffic in mobile networks. In order to successfully enable such kinds of services, an attractive incentive mechanism is required. Therefore, we propose a contract theory-based incentive mechanism for UAV-assisted MEC in VR-based infotainment services, in which the MEC offers an amount reward to a UAV for serving as a UBS in a specific location for certain time slots. We then derive an optimal contract-based scheme with individual rationality and incentive compatibility conditions. The numerical findings show that our proposed approach outperforms the Linear Pricing (LP) technique and is close to the optimal solution in terms of social welfare. Additionally, our proposed scheme significantly enhanced the fairness of utility for UAVs in asymmetric information problems.
Nguyen Dang Tri, Aunas Manzoor, Yan Kyaw Tun, S. M. Ahsan Kazmi, Zhu Han 0001, Choong Seon Hong
IEEE Internet Things J.3
2023 When Hierarchical Federated Learning Meets Stochastic Game: Toward an Intelligent UAV Charging in Urban Prosumers
abstract
Unmanned aerial vehicles (UAVs) nowadays are developing rapidly for various applications such as UAV taxis and delivery drones. However, the limited battery energy restricts the flight distance of the UAVs. Thus, urban prosumers equipped with drone recharge stations are introduced to provide charging services for the UAVs. In this article, first, a day-ahead energy scheduling problem for UAV charging-enabled urban prosumers is studied, where the objective is to maximize the overall energy satisfaction of the prosumers with ensuring the Quality of Service (QoS) of the charged UAVs. Specifically, to deal with the considered problem, we decompose it into two stages: 1) the day-ahead energy requirement data prediction stage and 2) energy scheduling stage per prosumer. Thus, second, a joint method based on hierarchical federated learning (HFL) on long short-term memory (LSTM) architecture (HFL-LSTM) and stochastic game-based multi-agent double deep$Q$-learning (MADDQN) with community agent-independent approach is proposed. In particular, the HFL-LSTM approach is leveraged to forecast each prosumer’s energy requirement data without centralized collecting local prosumers’ data such that to protect data privacy. Then, the stochastic game is adopted to analyze the formulated problem, aiming to find the Nash equilibrium (NE) strategy. Afterward, MADDQN with a community agent-independent method is utilized to achieve the best energy scheduling strategy per prosumer. Finally, the experimental results demonstrate the superiority of the proposed joint method that can achieve the lowest mean squared error with the value of 0.0152 and the highest energy satisfaction$(36388)$achieved by the NE policy compared with the benchmarks.
Luyao Zou, Md. Shirajum Munir, Yan Kyaw Tun, Sheikh Salman Hassan, Pyae Sone Aung, Choong Seon Hong
IEEE Internet Things J.3
2023 Toward Multiple Federated Learning Services Resource Sharing in Mobile Edge Networks
abstract
Federated Learning is a new learning scheme for collaborative training a shared prediction model while keeping data locally on participating devices. In this paper, we study a new model of multiple federated learning services at the multi-access edge computing server. Accordingly, the sharing of CPU resources among learning services at each mobile device for the local training process and allocating communication resources among mobile devices for exchanging learning information must be considered. Furthermore, the convergence performance of different learning services depends on the hyper-learning rate parameter that needs to be precisely decided. Towards this end, we propose a joint resource optimization and hyper-learning rate control problem, namely${{\sf MS-FEDL}}$, regarding the energy consumption of mobile devices and overall learning time. We design a centralized algorithm based on the block coordinate descent method and a decentralized JP-miADMM algorithm for solving the${{\sf MS-FEDL}}$problem. Different from the centralized approach, the decentralized approach requires many iterations to obtain but it allows each learning service to independently manage the local resource and learning process without revealing the learning service information. Our simulation results demonstrate the convergence performance of our proposed algorithms and the superior performance of our proposed algorithms compared to the heuristic strategy.
Minh N. H. Nguyen, Nguyen Hoang Tran, Yan Kyaw Tun, Zhu Han 0001, Choong Seon Hong
IEEE Trans. Mob. Comput.3
2022 Energy-Efficiency Maximization of Multiple RISs-Enabled Communication Networks by Deep Reinforcement Learning
abstract
Reconfigurable Intelligent Surfaces (RISs) have become an emerging paradigm to improve the average sum-rate, enhance energy efficiency and extend coverage areas in wireless communications. In this paper, a multiple RISs-enabled energy-efficient downlink communication system is investigated. Then, to maximize energy efficiency for the proposed system, the joint optimization problem of user-RIS association, reflective elements ON/OFF states, phase shift, and transmit power is formulated. However, as the formulated problem is mixed-integer, non-convex, and NP-hard, it is challenging to solve in polynomial time. To overcome the challenge, by using the Block Coordinate Descent (BCD) method, the formulated problem is decomposed into two sub-problems: 1) joint user-RIS association, reflective elements ON/OFF states, and phase shift problem, and 2) power control problem. Then, the deep reinforcement learning (DRL) algorithm and convex optimization technique are deployed in order to solve the decomposed sub-problems alternatively to find close optimal solutions. Finally, comprehensive simulation results are established to demonstrate the effectiveness of our proposed algorithms.
Pyae Sone Aung, Yan Kyaw Tun, Zhu Han 0001, Choong Seon Hong
ICC2
2022 3TO: THz-Enabled Throughput and Trajectory Optimization of UAVs in 6G Networks by Proximal Policy Optimization Deep Reinforcement Learning
abstract
Next-generation networks need to meet ubiquitous and high data-rate demand. Therefore, this paper considers the throughput and trajectory optimization of terahertz (THz)-enabled unmanned aerial vehicles (UAVs) in the sixth-generation (6G) communication networks. In the considered scenario, multiple UAVs must provide on-demand terabits per second (TB/s) services to an urban area along with existing terrestrial networks. However, THz-empowered UAVs pose some new constraints, e.g., dynamic THz-channel conditions for ground users (GUs) association and UAV trajectory optimization to fulfill GU’s throughput demands. Thus, a framework is proposed to address these challenges, where a joint UAVs-GUs association, transmit power, and the trajectory optimization problem is studied. The formulated problem is mixed-integer non-linear programming (MINLP), which is NP-hard to solve. Consequently, an iterative algorithm is proposed to solve three sub-problems iteratively, i.e., UAVs-GUs association, transmit power, and trajectory optimization. Simulation results demonstrate that the proposed algorithm increased the throughput by up to 10%, 68.9%, and 69.1% respectively compared to baseline algorithms.
Sheikh Salman Hassan, Yu Min Park, Yan Kyaw Tun, Walid Saad 0001, Zhu Han 0001, Choong Seon Hong
ICC3
2022 Joint Resources and Phase-Shift Optimization of MEC-Enabled UAV in IRS-Assisted 6G THz Networks
abstract
Terahertz (THz) communication has the promise of enabling ultra-high data speeds in the sixth-generation (6G) wireless networks. Meanwhile, an intelligent reflecting surface (IRS) may influence incident electromagnetic wave propagation by changing the phase shifts with passive reflecting components. It can enhance spectrum efficiency and coverage capability, and minimize blockage vulnerability caused by severe THz wave propagation attenuation and poor diffraction. Recently, unmanned aerial vehicles (UAVs) have provided the services of aerial-based multi-access edge computing (MEC) ubiquitously. Motivated by above facts, this paper considers the IRS-assisted MEC-enabled UAV system for 6G THz communications networks. To that aim, the joint optimization of UAV computation power, IRS phase shift, and THz sub-band allocation are being explored to reduce total network latency. However, the designed problem is mixed-integer non-linear programming (MINLP), which is challenging to solve in polynomial time. Therefore, an iterative algorithm based on the Hungarian algorithm and the Whale-Optimization algorithm (WOA) is proposed to address this problem. The Hungarian algorithm optimizes the sub-band allocation while WOA optimizes the IRS phase shift. Finally, simulation results show that the proposed algorithm can reduce network latency by up to 50% compared to baseline algorithms.
Yu Min Park, Sheikh Salman Hassan, Yan Kyaw Tun, Zhu Han 0001, Choong Seon Hong
NOMS3
2022 Collaboration in the Sky: A Distributed Framework for Task Offloading and Resource Allocation in Multi-Access Edge Computing
abstract
Recently, unmanned aerial vehicles (UAVs)-assisted multi-access edge computing (MEC) systems emerged as a promising solution for providing computation services to mobile users outside of terrestrial infrastructure coverage. As each UAV operates independently, however, it is challenging to meet the computation demands of the mobile users due to the limited computing capacity at the UAV’s MEC server as well as the UAV’s energy constraint. Therefore, collaboration among UAVs is needed. In this article, a collaborative multi-UAV-assisted MEC system integrated with an MEC-enabled terrestrial base station (BS) is proposed. Then, the problem of minimizing the total latency experienced by the mobile users in the proposed system is studied by optimizing the offloading decision as well as the allocation of communication and computing resources while satisfying the energy constraints of both mobile users and UAVs. The proposed problem is shown to be a nonconvex, mixed-integer nonlinear programming (MINLP) problem that is intractable. Therefore, the formulated problem is decomposed into three subproblems: 1) users tasks offloading decision problem; 2) communication resource allocation problem; and 3) UAV-assisted MEC decision problem. Then, the Lagrangian relaxation and alternating direction method of multipliers (ADMMs) methods are applied to solve the decomposed problems, alternatively. Simulation results show that the proposed approach reduces the average latency by up to 40.7% and 4.3% compared to the greedy and exhaustive search methods.
Yan Kyaw Tun, Nguyen Dang Tri, Kitae Kim 0001, Madyan Alsenwi, Walid Saad 0001, Choong Seon Hong
IEEE Internet Things J.1
2022 Energy-Efficient Resource Allocation in Multi-UAV-Assisted Two-Stage Edge Computing for Beyond 5G Networks
abstract
Unmanned aerial vehicle (UAV)-assisted multi-access edge computing (MEC) has become one promising solution for energy-constrained devices to run the applications with high computation demand and stringent delay requirement in beyond 5G era. In this work, we study a multi-UAV-assisted two-stage MEC system in which UAVs provide the computing and relaying services to the mobile devices. Due to the limited computing resources, each UAV executes only a portion of the offloaded tasks from its associated MDs in the first stage. Hence, in the second stage, each UAV relays the portions of the tasks to the terrestrial base station (TBS) which has rich computing resources enough to handle all the tasks relayed to it. In this regard, we formulate a joint task offloading, communication and computation resource allocation problem to minimize the energy consumption of MDs and UAVs by considering the limited resources of UAVs and the tolerable latency of the tasks. The formulated problem is a mixed-integer non-convex problem which is NP hard. To solve the formulated optimization problem, we apply the Block Successive Upper-bound Minimization (BSUM) method which guarantees to obtain the stationary points of the non-convex objective function. Finally, the extensive evaluation results are conducted to show the superior performance of our proposed framework.
Nway Nway Ei, Madyan Alsenwi, Yan Kyaw Tun, Zhu Han 0001, Choong Seon Hong
IEEE Trans. Intell. Transp. Syst.3
2022 Intelligent EV Charging for Urban Prosumer Communities: An Auction and Multi-Agent Deep Reinforcement Learning Approach
abstract
Recently, the deployment of electric vehicles supply equipment (EVSE) and its market is expanding rapidly to support the massive penetration of electric vehicles (EVs). However, to accomplish an effective EV charging mechanism for urban prosumer communities, it is imperative to tackle the challenges of distinct energy generation among the communities, dependency of the total purchasable energy price of each EV based on the distance between EV and EVSE, and extreme uncertainty among the energy demand and generation. Therefore, in this paper, the problem of EV charging of urban prosumer communities is studied. In particular, a joint optimization problem is proposed to maximize both the social welfare and EV charging achieved rate of the considered urban prosumer communities. Consequently, the formulated problem is decomposed into 1) truthful double auction problem for determining the unit price and winners by maximizing social welfare, and 2) EV auction losers charging problem for improving EVs charging achieved rate by purchasing energy from the power grid. Then the breakeven-based double auction (BDA) mechanism is proposed to find the unit price and EV winners’ for charging. Sequentially, a multi-agent deep reinforcement learning-based asynchronous advantage actor-critic algorithm with a long short-term memory layer (A3C-LSTM) is adopted to achieve the optimal grid energy buying decision for ensuring the charging of the losers. Finally, the experimental results demonstrate the efficacy of the proposed model that can increase the number of EV charging up to 57.31%, and prosumer communities have gained 86.04% of their income compared to baseline methods.
Luyao Zou, Md. Shirajum Munir, Yan Kyaw Tun, Choong Seon Hong
IEEE Trans. Netw. Serv. Manag.3
2021 An Efficient Resource Sharing Model for Multi-UAV-Assisted Wireless Networks
abstract
The network capacity is fastened by utilizing unmanned aerial vehicles (UAVs) and mobile users can get feasible services independent of the infrastructure coverage. Furthermore, with the help of network virtualization technology, mobile network operators (MNOs) can lease their cellular network infrastructures and wireless network resources to the service providers (SPs) who are providing specific services to their mobile users. Wireless resource leasing among SPs, on the other hand, is problematic because each aims to maximize its own profit whilst assuring the QoS requirement of their users. Thus, in this paper, we propose a wireless resource sharing problem in the UAVs-assisted virtualized wireless networks with the goal of maximizing the total profit of SPs whilst guaranteeing the QoS requirement of each mobile user and satisfying the resource constraint of the UAVs. Then, we deploy the Lagrangian relaxation-based solution approach in order to address our proposed problem. Finally, we provide detailed numerical results to show the effectiveness of our proposed algorithm.
Yan Kyaw Tun, Kitae Kim 0001, Pyae Sone Aung, Madyan Alsenwi, Choong Seon Hong
APNOMS1
2021 Blue Data Computation Maximization in 6G Space-Air-Sea Non-Terrestrial Networks
abstract
Non-terrestrial networks (NTN), encompassing space and air platforms, are a key component of the upcoming sixth-generation (6G) cellular network. Meanwhile, maritime network traffic has grown significantly in recent years due to sea transportation used for national defense, research, recreational activities, domestic and international trade. In this paper, the seamless and reliable demand for communication and computation in maritime wireless networks is investigated. Two types of marine user equipment (UEs), i.e., low-antenna gain and high-antenna gain UEs, are considered. A joint task computation and time allocation problem for weighted sum-rate maximization is formulated as mixed-integer linear programming (MILP). The goal is to design an algorithm that enables the network to efficiently provide backhaul resources to an unmanned aerial vehicle (UAV) and offload HUEs tasks to LEO satellite for blue data (i.e., marine user's data). To solve this MILP, a solution based on the Bender and primal decomposition is proposed. The Bender decomposes MILP into the master problem for binary task decision and subproblem for continuous-time resource allocation. Moreover, primal decomposition deals with a coupling constraint in the subproblem. Finally, numerical results demonstrate that the proposed algorithm provides the maritime UEs coverage demand in polynomial time computational complexity and achieves a near-optimal solution.
Sheikh Salman Hassan, Yan Kyaw Tun, Walid Saad 0001, Zhu Han 0001, Choong Seon Hong
GLOBECOM2
2021 An Incentive Mechanism for Federated Learning in Wireless Cellular Networks: An Auction Approach
abstract
Federated Learning (FL) is a distributed learning framework that can deal with the distributed issue in machine learning and still guarantee high learning performance. However, it is impractical that all users will sacrifice their resources to join the FL algorithm. This motivates us to study the incentive mechanism design for FL. In this paper, we consider a FL system that involves one base station (BS) and multiple mobile users. The mobile users use their own data to train the local machine learning model, and then send the trained models to the BS, which generates the initial model, collects local models and constructs the global model. Then, we formulate the incentive mechanism between the BS and mobile users as an auction game where the BS is an auctioneer and the mobile users are the sellers. In the proposed game, each mobile user submits its bids according to the minimal energy cost that the mobile users experiences in participating in FL. To decide winners in the auction and maximize social welfare, we propose the primal-dual greedy auction mechanism. The proposed mechanism can guarantee three economic properties, namely, truthfulness, individual rationality and efficiency. Finally, numerical results are shown to demonstrate the performance effectiveness of our proposed mechanism.
Tra Huong Thi Le, Nguyen Hoang Tran, Yan Kyaw Tun, Minh N. H. Nguyen, Shashi Raj Pandey, Zhu Han 0001, Choong Seon Hong
IEEE Trans. Wirel. Commun.3
2020 Energy-Efficient Offloading and User Association in UAV-assisted Vehicular Ad Hoc Network
abstract
Task offloading scheme provides opportunistic energy saving for computation-intensive on-vehicle applications. The evolution of the Vehicular Edge Computing (VEC) paradigm has contributed a vast potential that can enhance the performance of such vehicles with energy-hungry and delay-sensitive services. However, determining how much workload to compute locally or offload to the VEC server is still quite challenging. Moreover, when all the vehicles try to offload their computation tasks to the same VEC server, it leads to deterioration in the performance gain due to overburden. Recently, unmanned aerial vehicle (UAV) as the edge server has gained huge attraction due to its well maneuverability and cost efficiency. In this paper, we study the energy-efficient offloading as well as association of the vehicles between the road side unit (RSU) and UAV. First, we formulate the joint offloading and association problem. Next, we decompose the formulated mixed integer linear (MIL) problem into two subproblems and then solve them by using standard convex optimization. Finally, we compare our proposed algorithm with benchmark schemes and the numerical results demonstrate that our algorithm outperforms the benchmark solutions.
Pyae Sone Aung, Yan Kyaw Tun, Nway Nway Ei, Choong Seon Hong
APNOMS2
2020 Optimized Deployment of Multi-UAV based on Machine Learning in UAV-HST Networking
abstract
A new communications infrastructure is needed for users to experience the contents of 5G-based VR/AR in High-Speed Train (HST). Therefore, it is proposed that the Unmanned Aerial Vehicle (UAV) can be used as a communication equipment on behalf of the general Rail-side Units (RSUs) supporting the communication of the HST. To maintain reliable communications, initial deployment and trajectory considered altitude and direction of UAV are determined. Also, limited energy in UAV is an important constraint on trajectory optimization. Thus, this paper proposes initial deployment and trajectory optimization techniques for stable communication between HST and Multi-UAV with the energy constraints of UAV. This paper uses Soft Actor-Critic (SAC), one of the methods of reinforcement learning, as a way to optimize the UAV trajectory. It also uses the Support Vector Machine to carry out optimal initial deployment based on data on the maximum UAV communication distance according to the speed of HST and the energy of UAV, which is the result of trajectory optimization. As a result, this study quickly and accurately derives the optimal trajectory of Multi-Uav according to the speed of HST and the energy of UAV and also maintain stable communication by optimal initial deployment.
Yu Min Park, Yan Kyaw Tun, Choong Seon Hong
APNOMS2
2020 Sharing Incentive Mechanism, Task Assignment and Resource Allocation for Task Offloading in Vehicular Mobile Edge Computing
abstract
Vehicular Mobile Edge Computing is a promising technology to leverage the bottleneck at a base station (BS) at peak hours. However, to deploy Vehicular Mobile Edge Computing requires to deal with the challenges in how to incentive vehicles to resource sharing and how to assign tasks and computation resource to minimize the total network delay. In this paper, we develop a two-stage incentive mechanism and task assignment and resource allocation scheme by combining auction game, matching theory, and convex optimization method. In the first stage, we present the incentive problem between the BS and nearby vehicles, which leverages a reserve auction. Then we study the network delay minimization problem. The problem is decoupled into two subproblems for determining task assignment and computing resource allocation, respectively. Finally, numerical results show the effectiveness and efficiency of our scheme.
Tra Huong Thi Le, Nguyen Hoang Tran, Yan Kyaw Tun, Oanh Tran Thi Kim, Kitae Kim 0001, Choong Seon Hong
NOMS3
2020 Auction based Incentive Design for Efficient Federated Learning in Cellular Wireless Networks
abstract
Federated learning is an prominent machine learning technique that model is trained distributively by using local data of mobile users, which can preserve the privacy of users and still guarantee high learning performance. In this paper, we deal with the problem of incentive mechanism design for motivating users to participate in training. In this paper, we employ the randomized auction framework for incentive mechanism design in which the base station is a seller and mobile users are buyers. Concerning the energy cost incurred due to join the training, the users need to decide how many uplink subchannels, transmission power and CPU cycle frequency and then claim them in submitted bids to the base station. After receiving the submitted bids, the base station needs algorithms to select winners and determine the corresponding rewards so that the social cost is minimized. The proposed mechanism can guarantee three economic properties, i.e., truthfulness, individual rationality and efficiency. Finally, numerical results are provided to demonstrate the effectiveness, and efficiency of our scheme.
Tra Huong Thi Le, Nguyen Hoang Tran, Yan Kyaw Tun, Zhu Han 0001, Choong Seon Hong
WCNC3
2020 A Crowdsourcing Framework for On-Device Federated Learning
abstract
Federated learning (FL) rests on the notion of training a global model in a decentralized manner. Under this setting, mobile devices perform computations on their local data before uploading the required updates to improve the global model. However, when the participating clients implement an uncoordinated computation strategy, the difficulty is to handle the communication efficiency (i.e., the number of communications per iteration) while exchanging the model parameters during aggregation. Therefore, a key challenge in FL is how users participate to build a high-quality global model with communication efficiency. We tackle this issue by formulating a utility maximization problem, and propose a novel crowdsourcing framework to leverage FL that considers the communication efficiency during parameters exchange. First, we show an incentive-based interaction between the crowdsourcing platform and the participating client's independent strategies for training a global learning model, where each side maximizes its own benefit. We formulate a two-stage Stackelberg game to analyze such scenario and find the game's equilibria. Second, we formalize an admission control scheme for participating clients to ensure a level of local accuracy. Simulated results demonstrate the efficacy of our proposed solution with up to 22% gain in the offered reward.
Shashi Raj Pandey, Nguyen Hoang Tran, Mehdi Bennis, Yan Kyaw Tun, Aunas Manzoor, Choong Seon Hong
IEEE Trans. Wirel. Commun.4
2019 A Hopfield Neural Networks Based Mechanism for Coexistence of LTE-U and WiFi Networks in Unlicensed Spectrum
abstract
Long-Term Evolution in the unlicensed spectrum (LTE-U) is considered as an indispensable technique to mitigate the spectrum scarcity in wireless networks. Typical LTE transmissions are contention-free and centrally controlled by the base station (BS); however, the wireless networks that work in unlicensed bands use contention-based protocols for channel access, which raises the need to derive an efficient and fair coexistence mechanism among different radio access networks. In this work, we propose a novel neural networks (NNs) based mechanism for the coexistence of an LTE-U base station (BS) in the unlicensed spectrum alongside with a WiFi access point (WAP). Specifically, we model the coexistence problem as a Hopfield Neural Network (HNN) based optimization problem that aims a fair coexistence considering both the LTE-U data rate and the QoS requirements of the WiFi network. Using the energy function of HNN, precise investigation of its minimization property can directly provide the solution of the optimization problem. Numerical results show that the proposed mechanism allows the LTE-U BS to work efficiently in the unlicensed spectrum while protecting the WiFi network.
Madyan Alsenwi, Yan Kyaw Tun, Shashi Raj Pandey, Choong Seon Hong
APNOMS2
2019 Energy Efficient Multi-Tenant Resource Slicing in Virtualized Multi-Access Edge Computing
abstract
With the help of multi-access edge computing (MEC) system, traditional mobile network operators (MNOs) can provide various services to their mobile users with the minimum delay by installing micro-datacenters at the base stations (BSs)(i.e., at the edge of the radio access network). However, the capital and operational expenditures become significant challenge for the MNOs. Fortunately, multiple MNOs can coexist on the same infrastructure and share the network resources with the help of upcoming technologies such as network virtualization (i.e., network slicing) and software defined networking (SDN). In this work, we introduce a virtualized MEC system in which an infrastructure provider (InP) deploys a BS integrated with a micro-datacenter and owns the wireless network resource i.e., bandwidth. Then, InP creates the virtual network by slicing its network resources including bandwidth and the computation resource of the MEC server, and shares these resource slices to multiple virtual network operators (MVNOs) where MVNOs provide specific services to their mobile users. To solve our proposed problem, we first decompose the original problem into two subproblems. Then, we apply the Karush-Kuhn-Tucker (KKT) conditions to solve each subproblem. Moreover, simulation results prove that our proposed algorithm for joint communication and computation resources sharing outperforms the existing schemes.
Yan Kyaw Tun, Madyan Alsenwi, Shashi Raj Pandey, Chit Wutyee Zaw, Choong Seon Hong
APNOMS1
2019 Incentivize to Build: A Crowdsourcing Framework for Federated Learning
abstract
Federated learning (FL) rests on the notion of training a global model in a decentralized manner. Under this setting, mobile devices perform computations on their local data before uploading the required updates to the central aggregator for improving the global model. However, a key challenge is to maintain communication efficiency (i.e., the number of communications per iteration) when participating clients implement uncoordinated computation strategy during aggregation of model parameters. We formulate a utility maximization problem to tackle this difficulty, and propose a novel crowdsourcing framework, involving a number of participating clients with local training data to leverage FL. We show the incentive-based interaction between the crowdsourcing platform and the participating client's independent strategies for training a global learning model, where each side maximizes its own benefit. We formulate a two-stage Stackelberg game to analyze such scenario and find the game's equilibria. Further, we illustrate the efficacy of our proposed framework with simulation results. Results show that the proposed mechanism outperforms the heuristic approach with up to 22% gain in the offered reward to attain a level of target accuracy.
Shashi Raj Pandey, Nguyen Hoang Tran, Mehdi Bennis, Yan Kyaw Tun, Zhu Han 0001, Choong Seon Hong
GLOBECOM4
2019 Wireless Network Slicing: Generalized Kelly Mechanism-Based Resource Allocation
abstract
Wireless network slicing (i.e., network virtualization) is one of the potential technologies for addressing the issue of rapidly growing demand in mobile data services related to 5G cellular networks. It logically decouples the current cellular networks into two entities: infrastructure providers (InPs) and mobile virtual network operators (MVNOs). The resources of base stations (e.g., resource blocks, transmission power, and antennas), which are owned by the InP, are shared with multiple MVNOs who need resources for their mobile users. Specifically, the physical resources of an InP are abstracted into multiple isolated network slices, which are then allocated to MVNO's mobile users. In this paper, two-level allocation problem in network slicing is examined while enabling efficient resource utilization, inter-slice isolation (i.e., no interference among slices), and intra-slice isolation (i.e., no interference between users in the same slice). A generalized Kelly mechanism (GKM) is also designed, based on which the upper level of the resource allocation issue (i.e., between the InP and MVNOs) is addressed. The benefit of using such a resource bidding and allocation framework is that the seller (InP) does not need to know the true valuation of the bidders (MVNOs). For solving the lower level of resource allocation issue (i.e., between MVNOs and their mobile users), the optimal resource allocation is derived from each MVNO to its mobile users by using Karush-Kuhn-Tucker (KKT) conditions. Then, bandwidth resources are allocated to the users of MVNOs. Finally, the results of the simulation are presented to verify the theoretical analysis of our proposed two-level resource allocation problem in wireless network slicing.
Yan Kyaw Tun, Nguyen Hoang Tran, Duy Trong Ngo, Shashi Raj Pandey, Zhu Han 0001, Choong Seon Hong
IEEE J. Sel. Areas Commun.1
2017 DownlinK power allocation in virtualized wireless networks
abstract
Virtualized wireless networks is one of the techniques to satisfy the increasing demand of mobile data services and for future wireless network. Nework virtualization enables efficient resource utilization and it also reduces capital expenditures and operational expenditures of mobile network operators (MNOs). In this paper, we present virtualized wireless network where users of each service provider (SP) are served by an infrastructure provider (InP) who owns a set eNBs. We propose the problem of power allocation of each user that belongs to service providers. We aim to maximize the total rate of mobile users with limited power. We introduce Dual decomposition technique to address the optimization problem.
Yan Kyaw Tun, Chit Wutyee Zaw, Choong Seon Hong
APNOMS1
2017 User clustering based on correlation in 5G using semidefinite programming
abstract
For 5G cellular networks, non-orthogonal multiple access (NOMA) has been recognized as a promising technique. NOMA allows multiple users to access the same channel by adapting successive interference cancellation (SIC) and multiplexing in power domain. This causes the clustering problem to become critical as higher channel gain users need to cancel out the signals of lower channel gain users while the latter has to receive less interference. In this paper, we formulate the user clustering as a correlation clustering problem. We transform the problem by relaxing the clustering variables, and solve using semidefinite programming (SDP). Moreover, a simple iterative power allocation algorithm is nominated. In the simulation results, it can be seen that the correlation clustering using semidefinite programming outperforms the random clustering of users.
Chit Wutyee Zaw, Yan Kyaw Tun, Choong Seon Hong
APNOMS2