Trajectory Design and Resource Allocation for Multi-UAV Networks : Deep Reinforcement Learning Approaches
Chang, Z., Deng, H., You, L., Min, G., Garg, S., & Kaddoum, G. (2022). Trajectory Design and Resource Allocation for Multi-UAV Networks : Deep Reinforcement Learning Approaches. IEEE Transactions on Network Science and Engineering, Early Access. https://doi.org/10.1109/tnse.2022.3171600
Published in
IEEE Transactions on Network Science and EngineeringDate
2022Copyright
© 2022 the Authors
The future mobile communication system is expected to provide ubiquitous connectivity and unprecedented services over billions of devices. The unmanned aerial vehicle (UAV), which is prominent in its flexibility and low cost, emerges as a significant network entity to realize such ambitious targets. In this work, novel machine learning-based trajectory design and resource allocation schemes are presented for a multi-UAV communications system. In the considered system, the UAVs act as aerial Base Stations (BSs) and provide ubiquitous coverage. In particular, with the objective to maximize the system utility over all served users, a joint user association, power allocation and trajectory design problem is presented. To solve the problem caused by high dimensionality in state space, we first propose a machine learning-based strategic resource allocation algorithm which comprises of reinforcement learning and deep learning to design the optimal policy of all the UAVs. Then, we also present a multi-agent deep reinforcement learning scheme for distributed implementation without knowing a priori knowledge of the dynamic nature of networks. Extensive simulation studies are conducted and illustrated to evaluate the advantages of the proposed scheme.
...


Publisher
Institute of Electrical and Electronics Engineers (IEEE)ISSN Search the Publication Forum
2327-4697Keywords
Publication in research information system
https://converis.jyu.fi/converis/portal/detail/Publication/144231417
Metadata
Show full item recordCollections
Additional information about funding
This work is partly supported by the National Natural Science Foundation of China (NSFC) under Grant 62071105. The work of Li You was supported in part by the Young Elite Scientist Sponsorship Program by China Institute of Communications, the Jiangsu Province Basic Research Project under Grant BK20192002, and the Fundamental Research Funds for the Central Universities.License
Related items
Showing items with similar title or keywords.
-
Age of Information Based URLLC-enabled UAV Wireless Communications System
Basnayaka Chathuranga M. Wijerathna; Jayakody Dushantha Nalin, K.; Chang Zheng (Institute of Electrical and Electronics Engineers (IEEE), 2021)This paper considers an unmanned aerial vehicles (UAV) communication network, where UAV operate as an aerial mobile relay between a source and a destination of the network. To capture the “timelines” of the received ... -
Drones in cyber security environment
Lehto, Martti (Cyberwatch Finland Oy, 2019)Aerial unmanned vehicles (AUV) are currently used for a wide range of operations such as border surveillance, surveillance, reconnaissance, transport, aerial photography, traffic control, earth observation, communications, ... -
Spectrum and energy efficient solutions for OFDMA collaborative wireless networks
Chang, Zheng (University of Jyväskylä, 2013) -
Tree species classification of drone hyperspectral and RGB imagery with deep learning convolutional neural networks
Nezami, Somayeh; Khoramshahi, Ehsan; Nevalainen, Olli; Pölönen, Ilkka; Honkavaara, Eija (MDPI AG, 2020)Interest in drone solutions in forestry applications is growing. Using drones, datasets can be captured flexibly and at high spatial and temporal resolutions when needed. In forestry applications, fundamental tasks include ... -
Drones as information system artifacts supporting environmental sustainability in Finnish forest industry
Kuusela, Antti (2020)Ympäristöllisen kestävyyden heikkeneminen on yksi merkittävimmistä uhista elämälle maapallolla. Biodiversiteetin kaventuminen, ilmastonmuutoksen kiihtyminen, ympäristösaasteiden lisääntyminen, napajäätiköiden ...