Internet of Things (IoT) applications, such as augmented/virtual reality, tactile Internet, immersive gaming, etc., are currently experiencing an unprecedented growth in their demand. IoT devices are constrained by limited computation and power features and might experience excessive computational latency to support resource-intensive tasks. Multiaccess edge computing (MEC) appears to be a promising solution in this regard to expedite the computations of resource-intensive tasks by offloading them to the edge of the network. This article considers a scenario where a base station (BS) serves traffic streams from multiple IoT devices. The packets from each stream arrive at the BS (following a stochastic process) and then forwarded to their respective destinations after they are processed by the MEC node. The scheduling decisions are aimed to keep the information fresh at the destination. The information freshness is captured by Age of Information (AoI) metric. We aim to minimize the expected sum AoI for the MEC-assisted IoT network and provide mathematically traceable expressions for the AoI. First, an optimization problem is formulated to find the optimal scheduling policy in order to minimize the expected sum AoI. The optimization problem is an integer linear programming (LP) problem, which is generally difficult to solve. Hence, we provide a simpler formulation of the problem and derive a more traceable expression for the expected sum AoI. With this approach, the joint impact of stochastic arrivals, scheduling policy, and unreliable channel conditions on the AoI is assessed. We also propose low-complexity algorithms to obtain results for larger networks. Finally, through extensive simulations, we demonstrate the effectiveness of our proposed methods as compared to other existing strategies in terms of achievable AoI.

This article considers unmanned aerial vehicle (UAV) assisted Internet of Things (IoT) networks, where low resource IoT devices periodically sample a stochastic process and need to upload more recent information to a Base Station (BS). Among the myriad of applications, there is a need for timely delivery of data (for example, status-updates) before the data becomes outdated and loses its value. Since transmission capabilities of IoT devices are limited, it may not always be feasible to transmit over one hop transmission to the BS. To address this challenge, UAVs with virtual queues are deployed as middle layer between IoT devices and the BS to relay recent information over unreliable channels. In the absence of channel conditions, the optimal online scheduling policy is investigated as well as dynamic UAV altitude control that maintains a fresh status of information at the BS. The objective of this paper is to minimize the Expected Weighted Sum Age of Information (EWSA) for IoT devices. First, the problem is formulated as an optimization problem that is however generally hard to solve. Second, an online model free Deep Reinforcement Learning (DRL) is proposed, where the deployed UAV obtains instantaneous channel state information (CSI) in real time along with any adjustment to its deployment altitude. Third, we formulate the online problem as a Markov Decision Process (MDP) and Proximal Policy Optimization (PPO) algorithm, which is a highly stable state-of-the-art DRL algorithm, is leveraged to solve the formulated problem. Finally, extensive simulations are conducted to verify findings and comprehensive comparisons with other baseline approaches are provided to demonstrate the effectiveness of the proposed design.

Unmanned Aerial Vehicles (UAVs) are gaining growing interests due to the paramount roles they play, particularly these days, in enabling new services that help modernize our transportation, supply chain, search and rescue, among others. They are capable of positively influencing wireless systems through enabling and fostering emerging technologies such as autonomous driving, vertical industries, virtual reality and so many others. The Internet of Vehicles is a prime sector benefiting from the services offered by future cellular systems in general and UAVs in particular, and this paper considers the problem of content delivery to vehicles on road segments with either overloaded or no available communication infrastructure. Incoming vehicles demand service from a library of contents that is partially cached at the UAV; the content of the library is also assumed to change as new vehicles carrying more popular contents arrive. Each inbound vehicle makes a request and the UAV decides on its best trajectory to provide service while maximizing a certain operational utility. Given the energy limitation at the UAV, we seek an energy efficient solution. Hence, our problem consists of jointly finding caching decisions, UAV trajectory and radio resource allocation which is formulated mathematically as a Mixed Integer Non-Linear Problem (MINLP). However, owing to uncertainties in the environment (e.g., random arrival of vehicles, their requests for contents and their existing contents), it is often hard and impractical to solve using standard optimization techniques. To this end, we formulate our problem as a Markov Decision Process (MDP) and we resort to tools such as Proximal Policy Optimization (PPO), a very promising Reinforcement Learning method, along with a set of crafted algorithms to solve our problem. Finally, we conduct simulation-based experiments to analyze and demonstrate the superiority of our solution approach compared with four counterparts and baseline schemes.

The success in transitioning towards smart cities relies on the availability of information and communication technologies that meet the demands of this transformation. The terrestrial infrastructure presents itself as a preeminent component in this change. Unmanned aerial vehicles (UAVs) empowered with artificial intelligence (AI) are expected to become an integral component of future smart cities that provide seamless coverage for vehicles on highways with poor cellular infrastructure. Motivated by the above, in this paper, we introduce UAVs cell-free network for providing coverage to vehicles entering a highway that is not covered by other infrastructure. However, UAVs have limited energy resources and cannot serve the entire highway all the time. Furthermore, the deployed UAVs have insufficient knowledge about the environment (e.g., the vehicles' instantaneous location). Therefore, it is challenging to control a swarm of UAVs to achieve efficient communication coverage. To address these challenges, we formulate the trajectories decisions making as a Markov decision process (MDP) where the system state space considers the vehicular network dynamics. Then, we leverage deep reinforcement learning (DRL) to propose an approach for learning the optimal trajectories of the deployed UAVs to efficiently maximize the vehicular coverage, where we adopt Actor-Critic algorithm to learn the vehicular environment and its dynamics to handle the complex continuous action space. Finally, simulations results are provided to verify our findings and demonstrate the effectiveness of the proposed design and show that during the mission time, the deployed UAVs adapt their velocities in order to cover the vehicles.

The global evolution of wireless technologies and intelligent sensing devices are transforming the realization of smart cities. Among the myriad of use cases, there is a need to support applications whereby low-resource IoT devices need to upload their sensor data to a remote control centre by target hard deadlines; otherwise, the data becomes outdated and loses its value, for example, in emergency or industrial control scenarios. In addition, the IoT devices can be either located in remote areas with limited wireless coverage or in dense areas with relatively low quality of service. This motivates the utilization of UAVs to offload traffic from existing wireless networks by collecting data from time-constrained IoT devices with performance guarantees. To this end, we jointly optimize the trajectory of a UAV and the radio resource allocation to maximize the number of served IoT devices, where each device has its own target data upload deadline. The formulated optimization problem is shown to be mixed integer non-convex and generally NP-hard. To solve it, we first propose the high-complexity branch, reduce and bound (BRB) algorithm to find the global optimal solution for relatively small scale scenarios. Then, we develop an effective sub-optimal algorithm based on successive convex approximation in order to obtain results for larger networks. Next, we propose an extension algorithm to further minimize the UAV's flight distance for cases where the initial and final UAV locations are known a priori. We demonstrate the favourable characteristics of the algorithms via extensive simulations and analysis as a function of various system parameters, with benchmarking against two greedy algorithms based on distance and deadline metrics.

In recent years, providing connectivity to fast-moving vehicles on highways has been the focus of the wireless research community. In this paper, in the context of V2X, we propose using unmanned aerial vehicles (UAVs) to serve vehicles on a highway, where a UAV is dispatched in disaster situations (such as floods or earthquakes) to serve these vehicles, or to provide better coverage when vehicles are out of reach of road side units. We consider free flow scenario where vehicles moving between two road-side units and where the infrastructure is partially or totally unavailable. Our goal is to guarantee a certain Quality of Service (QoS) for each vehicle on the highway by jointly optimizing the UAV trajectory and the radio resource allocation. We show that during the UAV flight time, the UAV adapts its velocity to the velocities of the vehicles in the served cluster, to maximize the minimum average rate for each vehicle. Our findings are verified through Monte-Carlo simulation where we demonstrate the effectiveness of our proposed design under different UAVs types.

Cognitive radio (CR) has been proposed for spectral efficiency improvement while avoiding interference with licensed users. The offset quadrature amplitude modulation‐based filter bank multicarrier (OQAM‐FBMC) modulation is a promising candidate for CR‐based systems. Although it behaves better in many aspects than orthogonal frequency division multiplexing (OFDM), the application of some techniques with FBMC becomes more challenging due to the imaginary interference, as in the case of multiple‐input multiple‐output (MIMO) technique. Here, the authors first propose a new MIMO‐based FBMC transceiver structure for CR systems. The proposed structure is based on QAM transmission to handle the interference presented in conventional OQAM‐FBMC systems. The authors also introduce two different methods to satisfy the orthogonality conditions and cancel the residual interference in QAM‐FBMC systems. Both methods are based on discrete cosine transform (DCT) to achieve superior spectrum confinement and hence better spectral efficiency. Moreover, the authors present a resource allocation algorithm for the proposed structure. Simulation results demonstrate that the proposed structure outperforms the conventional FBMC‐based MIMO techniques in terms of bit error rate (BER) and computational complexity. The results also show that the spectral efficiency of the proposed structure could be further improved by applying the proposed resource allocation algorithm.

This paper shows that the unwanted In-phase/quadrature (IQ) imbalance can be exploited to achieve a diversity gain for Alamouti space-time coding orthogonal frequency division multiplexing (AL-OFDM) systems. In addition, we propose a novel iterative algorithm to jointly estimate the channel impulse response (CIR) and IQ imbalance occurring at both the transmitter and receiver. A pilot sequence is employed for initial estimation and detection. Then, soft information is exchanged between the detector and the estimator iteratively in order to enhance the system performance. Simulation results confirm the effectiveness of the proposed algorithms.