Skip to main navigation Skip to search Skip to main content

Delay Minimization in Multi-UAV Assisted Wireless Networks: A Reinforcement Learning Approach

  • School of Electronics and Information Engineering, Harbin Institute of Technology
  • International Innovation Institute of HIT in Huizhou
  • Peng Cheng Laboratory

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Unmanned Aerial Vehicles (UAVs) assisted communications are promising technology for meeting the demand of unprecedented demands for wireless services. In this paper, we propose a novel framework for delay minimization driven deployment of multiple UAVs. The problem of joint non-convex three dimensional (3D) deployment for minimizing average delay is formulated and solved by Deep Q network (DQN), which is a reinforcement learning based algorithm. Firstly, we obtain the cell partition by K-means algorithm. Then, we find the optimal 3D position for each UAV in each cluster to provide low delay service. Finally, when users are roaming, the UAVs are still able to track the real-time users. Numerical results show that the proposed DQN-based delay algorithm shows a fast convergence after a small number of iterations. Additionally, the proposed deployment algorithm outperforms several benchmarks in terms of average delay.

Original languageEnglish
Title of host publicationArtificial Intelligence for Communications and Networks - 2nd EAI International Conference, AICON 2020, Proceedings
EditorsShuo Shi, Liang Ye, Yu Zhang
PublisherSpringer Science and Business Media Deutschland GmbH
Pages249-259
Number of pages11
ISBN (Print)9783030690656
DOIs
StatePublished - 2021
Externally publishedYes
Event2nd EAI International Conference on Artificial Intelligence for Communications and Networks, AICON 2020 - Harbin, China
Duration: 19 Dec 202020 Dec 2020

Publication series

NameLecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
Volume356 LNICST
ISSN (Print)1867-8211
ISSN (Electronic)1867-822X

Conference

Conference2nd EAI International Conference on Artificial Intelligence for Communications and Networks, AICON 2020
Country/TerritoryChina
CityHarbin
Period19/12/2020/12/20

Keywords

  • Delay minimization
  • Deployment
  • Reinforcement learning
  • Unmanned Aerial Vehicles

Fingerprint

Dive into the research topics of 'Delay Minimization in Multi-UAV Assisted Wireless Networks: A Reinforcement Learning Approach'. Together they form a unique fingerprint.

Cite this