Publicação
VIRIATO: Visual-Action Reinforcement Integrator for Actor-Critic with Temporal Observations
| datacite.subject.fos | Engenharia e Tecnologia::Engenharia Eletrotécnica, Eletrónica e Informática | |
| datacite.subject.sdg | 09:Indústria, Inovação e Infraestruturas | |
| datacite.subject.sdg | 12:Produção e Consumo Sustentáveis | |
| dc.contributor.author | Campanhã, João | |
| dc.contributor.author | Neves, Francisco | |
| dc.contributor.author | Pinto, Andry | |
| dc.contributor.author | BENEDITA CAMPOS NEVES MALHEIRO, MARIA | |
| dc.contributor.editor | Fonseca, Pedro | |
| dc.contributor.editor | Moreira, António | |
| dc.contributor.editor | Neto, Pedro | |
| dc.contributor.editor | Morais, Pedro | |
| dc.contributor.editor | Lima, José | |
| dc.date.accessioned | 2026-07-10T13:44:19Z | |
| dc.date.available | 2026-07-10T13:44:19Z | |
| dc.date.issued | 2026-04-22 | |
| dc.description.abstract | The Visual-Action Reinforcement Integrator for Actor-Critic with Temporal Observations (VIRIATO) is a compact multi-input feature-extractor architecture designed to enable robust visual navigation of Unmanned Aerial Vehicles (UAVs) conducting close-range inspection of photovoltaic arrays. The target task of low-altitude flight over dynamic, visually variable surfaces without privileged information is inherently partially observable. VIRIATO augments stacked image observations with a short history of recent past actions, producing a richer latent state for the Soft Actor-Critic (SAC) agent. Training is performed with domain randomization to expose the policy to diverse lighting, backgrounds and panel layouts. In simulation, VIRIATO yields faster learning and improved sample efficiency compared to a standard image-only Convolutional Neural Network (CNN) feature extractor, achieving lower position and yaw errors and substantially better robustness under image perturbations while retaining high task completion rates. The architecture is intentionally simple and general: it improves temporal awareness without adding complex recurrence, and it could be adapted to other perception-driven robotic tasks. These results demonstrate that integrating historical action data with visual encoding, together with domain randomization, is an effective way to achieve reliable autonomous vision-based navigation. | eng |
| dc.identifier.citation | J. Campanhã, F. Neves, B. Malheiro and A. Pinto, "VIRIATO: Visual-Action Reinforcement Integrator for Actor-Critic with Temporal Observations," 2026 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), Barcelos, Portugal, 2026, pp. 214-221, doi: 10.1109/ICARSC70216.2026.11523320. | |
| dc.identifier.doi | 10.1109/icarsc70216.2026.11523320 | |
| dc.identifier.isbn | 979-8-3195-1711-1 | |
| dc.identifier.uri | http://hdl.handle.net/10400.22/32569 | |
| dc.language.iso | eng | |
| dc.peerreviewed | yes | |
| dc.publisher | IEEE | |
| dc.relation.hasversion | https://ieeexplore.ieee.org/document/11523320 | |
| dc.relation.ispartof | 2026 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC) | |
| dc.relation.ispartofseries | IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC) | |
| dc.rights.uri | N/A | |
| dc.subject | Reinforcement Learning (RL) | |
| dc.subject | Visual navigation | |
| dc.subject | Unmanned Aerial Vehicles (UAVs) | |
| dc.subject | Domain Randomization | |
| dc.subject | Photovoltaic (PV) array inspection | |
| dc.subject | Simulation | |
| dc.title | VIRIATO: Visual-Action Reinforcement Integrator for Actor-Critic with Temporal Observations | eng |
| dc.type | conference paper | |
| dspace.entity.type | Publication | |
| oaire.citation.conferenceDate | 2026-04-23 | |
| oaire.citation.conferencePlace | Barcelos, Portugal | |
| oaire.citation.endPage | 221 | |
| oaire.citation.startPage | 214 | |
| oaire.citation.title | 2026 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC) | |
| oaire.version | http://purl.org/coar/version/c_ab4af688f83e57aa | |
| person.familyName | BENEDITA CAMPOS NEVES MALHEIRO | |
| person.givenName | MARIA | |
| person.identifier.ciencia-id | 7A15-08FC-4430 | |
| person.identifier.orcid | 0000-0001-9083-4292 | |
| relation.isAuthorOfPublication | babd4fda-654a-4b59-952d-6113eebbb308 | |
| relation.isAuthorOfPublication.latestForDiscovery | babd4fda-654a-4b59-952d-6113eebbb308 |
