Publication
Data-driven Deep Reinforcement Learning for Online Flight Resource Allocation in UAVaided Wireless Powered Sensor Networks
| dc.contributor.author | Li, Kai | |
| dc.contributor.author | Ni, Wei | |
| dc.contributor.author | Kurunathan, Harrison | |
| dc.contributor.author | Dressler, Falko | |
| dc.date.accessioned | 2022-10-03T14:13:03Z | |
| dc.date.available | 2022-10-03T14:13:03Z | |
| dc.date.issued | 2022-05-16 | |
| dc.description.abstract | In wireless powered sensor networks (WPSN), data of ground sensors can be collected or relayed by an unmanned aerial vehicle (UAV) while the battery of the ground sensor can be charged via wireless power transfer. A key challenge of resource allocation in UAV-aided WPSN is to prevent battery drainage and buffer overflow of the ground sensors in the presence of highly dynamic lossy airborne channels which can result in packet reception errors. Moreover, state and action spaces of the resource allocation problem are large, which is hardly explored online. To address the challenges, a new data-driven deep reinforcement learning framework, DDRL-RA, is proposed to train flight resource allocation online so that the data packet loss is minimized. Due to time-varying airborne channels, DDRL-RA firstly leverages long short-term memory (LSTM) with pre-collected offline datasets for channel randomness predictions. Then, Deep Deterministic Policy Gradient (DDPG) is studied to control the flight trajectory of the UAV, and schedule the ground sensor to transmit data and harvest energy. To evaluate the performance of DDRL-RA, a UAV-ground sensor testbed is built, where real-world datasets of channel gains are collected. DDRL-RA is implemented on Tensorflow, and numerical results show that DDRL-RA achieves 19\% lower packet loss than other learning-based frameworks. | pt_PT |
| dc.description.sponsorship | This work was partially supported by National Funds through FCT/MCTES (Portuguese Foundation for Science and Technology), within the CISTER Research Unit (UIDP/UIDB/04234/2020); also by national funds through the FCT, under CMU Portugal partnership, within project CMU/TIC/0022/2019 (CRUAV). This work was in part supported by the Federal Ministry of Education and Research (BMBF, Germany) as part of the 6G Research and Innovation Cluster 6G-RIC under Grant 16KISK020K. | pt_PT |
| dc.description.version | info:eu-repo/semantics/publishedVersion | pt_PT |
| dc.identifier.doi | 10.1109/ICC45855.2022.9838967 | pt_PT |
| dc.identifier.uri | http://hdl.handle.net/10400.22/20902 | |
| dc.language.iso | eng | pt_PT |
| dc.publisher | IEEE | pt_PT |
| dc.relation | UIDP/UIDB/04234/2020 | pt_PT |
| dc.rights.uri | http://creativecommons.org/licenses/by-nc-nd/4.0/ | pt_PT |
| dc.subject | UAV | pt_PT |
| dc.subject | WPSN | pt_PT |
| dc.subject | Deep reinforcement learning | pt_PT |
| dc.subject | LSTM | pt_PT |
| dc.subject | Wireless power transfer | pt_PT |
| dc.title | Data-driven Deep Reinforcement Learning for Online Flight Resource Allocation in UAVaided Wireless Powered Sensor Networks | pt_PT |
| dc.title.alternative | 220102 | pt_PT |
| dc.type | journal article | |
| dspace.entity.type | Publication | |
| oaire.awardURI | info:eu-repo/grantAgreement/FCT/3599-PPCDT/CMU%2FTIC%2F0022%2F2019/PT | |
| oaire.citation.title | ICC 2022 - IEEE International Conference on Communications | pt_PT |
| oaire.fundingStream | 3599-PPCDT | |
| person.familyName | Li | |
| person.familyName | Kurunathan | |
| person.givenName | Kai | |
| person.givenName | John Harrison | |
| person.identifier | 1490257 | |
| person.identifier.ciencia-id | EE10-B822-16ED | |
| person.identifier.ciencia-id | 4E1B-CFFC-07A8 | |
| person.identifier.orcid | 0000-0002-0517-2392 | |
| person.identifier.orcid | 0000-0002-1270-1213 | |
| project.funder.identifier | http://doi.org/10.13039/501100001871 | |
| project.funder.name | Fundação para a Ciência e a Tecnologia | |
| rcaap.rights | openAccess | pt_PT |
| rcaap.type | article | pt_PT |
| relation.isAuthorOfPublication | 21f3fb85-19c2-4c89-afcd-3acb27cedc5e | |
| relation.isAuthorOfPublication | f16021ed-349d-4a21-be66-1ee3ef42b8c4 | |
| relation.isAuthorOfPublication.latestForDiscovery | f16021ed-349d-4a21-be66-1ee3ef42b8c4 | |
| relation.isProjectOfPublication | 5e8fdb33-467f-437c-b64b-bb179074c88c | |
| relation.isProjectOfPublication.latestForDiscovery | 5e8fdb33-467f-437c-b64b-bb179074c88c |