This paper investigates the framework of wireless rechargeable sensor network (WRSN) assisted by multiple mobile unmanned vehicles (MUVs) and laser-charged unmanned aerial vehicles (UAVs). On the basis of framework, we cooperatively investigate the trajectory optimization of multi-UAVs and multi-MUVs for charging WRSN (TOUM) problem, whose goal aims at designing the optimal travel plan of UAVs and MUVs cooperatively to charge WRSN such that the remaining energy of each sensor in WRSN is greater than or equal to the threshold and the time consumption of UAV that takes the most time of all UAVs is minimized. The TOUM problem is proved NP-hard. To solve the TOUM problem, we first investigate the multiple UAVs-based TSP (MUTSP) problem to balance the charging tasks assigned to every UAV. Then, based on the MUTSP problem, we propose the TOUM algorithm (TOUMA) to design the detailed travel plan of UAVs and MUVs. We also present an algorithm named TOUM-DQN to make intelligent decisions about the travel plan of UAVs and MUVs by extracting valuable information from the network. The effectiveness of proposed algorithms is verified through extensive simulation experiments. The results demonstrate that the TOUMA algorithm outperforms the solar charging method, the base station charging method, and the TOUM-DQN algorithm in terms of time efficiency. Simultaneously, the experimental results show that the execution time of TOUM-DQN algorithm is significantly lower than TOUMA algorithm.

Unmanned Aerial Vehicle (UAV) can be used as wireless aerial mobile base station for collecting data from sensors in UAV-based Wireless Sensor Networks (WSNs), which is crucial for providing seamless services and improving the performance in the next generation wireless networks. However, since the UAV are powered by batteries with limited energy capacity, the UAV can not complete data collection tasks of all sensors without energy replenishment when a large number of sensors are deployed over large monitoring areas. To overcome this problem, we study the Real-time Data Collection with Laser-charging UAV (RDCL) problem, where the UAV is utilized to collect data from a specified WSN and is recharged using Laser Beam Directors (LBDs). This problem aims to collect all sensory data from the WSN and transport it to the base station by optimizing the flight trajectory of UAV such that real-time data performance is ensured It has been proven that the RDCL problem is NP-hard. To address this, we initially focus on studying two sub-problems, the Trajectory Optimization of UAV for Data Collection (TODC) problem and the Charging Trajectory Optimization of UAV (CTO) problem, whose objectives are to find the optimal flight plans of UAV in the data collection areas and charging areas, respectively. Then we propose an approximation algorithm to solve each of them with the constant factor. Subsequently, we present an approximation algorithm that utilizes the solutions obtained from TODC and CTO problems to address the RDCL problem. Finally, the proposed algorithm is verified by extensive simulations.

The development of wireless energy transmission technology has significantly propelled the advancement of wireless rechargeable sensor networks (WRSNs). Energy constraint is one of the most critical challenges in application of WRSNs. Integrating unmanned aerial vehicle (UAV) with wireless energy transmission technology has emerged as a promising approach to overcome the energy constraint problem in WRSNs, leveraging the advantages of UAV such as flexibility and maneuverability. In this paper, we consider the system of WRSN assisted by UAV and mobile utility vehicle (MUV), where the UAV serves as a mobile charger for replenishing energy of sensors and the MUV serves as a mobile base station for replacing the battery of UAV with insufficient energy. In the system, we focus on minimizing the death time of sensors and optimizing the energy consumption of UAV. To address this problem, a multi-objective deep Q-network (DQN) algorithm is employed, where the UAV makes online charging scheduling decisions based on real-time network status and utilizes experience replay for optimization. Experimental results demonstrate that the proposed algorithm significantly reduces the sensors’ death time and effectively decreases the energy consumption of UAV. Specially, the performance of proposed algorithm outperforms the three other classical algorithms: genetic algorithm, greedy algorithm, and Q-learning algorithm.

Edge computing is a computational paradigm that brings resources closer to the network edge, such as base stations or gateways, in order to provide quick and efficient computing services for mobile devices while relieving pressure on the core network. However, the current computing power of edge servers are insufficient to handle the high number of tasks generated by access devices. Additionally, some mobile devices may not fully utilize their computing resources. To maximize the use of resources, we propose a novel edge computing system architecture consisting of a resource-constrained edge server and three computing groups. Tasks from each group can be offloaded to either the edge server or the corresponding computing group for execution. We focus on optimizing the computation offloading of devices to minimize the maximum overall task processing latency in the system. This problem is proved to be NP-hard. To solve it, we propose a DQN-based resource utilization task scheduling (DQNRTS) algorithm that has two desirable characteristics: 1) it effectively utilizes the computing resources in the system and 2) it uses deep reinforcement learning to make intelligent scheduling decisions based on system state information. Experimental results demonstrate that the DQNRTS algorithm is capable of reducing the processing latency of the system by converging to optimal solutions.