Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Publicações

Publicações por CRAS

2024

Enhancing Underwater Inspection Capabilities: A Learning-Based Approach for Automated Pipeline Visibility Assessment

Autores
Mina, J; Leite, PN; Carvalho, J; Pinho, L; Gonçalves, EP; Pinto, AM;

Publicação
ROBOT 2023: SIXTH IBERIAN ROBOTICS CONFERENCE, VOL 2

Abstract
Underwater scenarios pose additional challenges to perception systems, as the collected imagery from sensors often suffers from limitations that hinder its practical usability. One crucial domain that relies on accurate underwater visibility assessment is underwater pipeline inspection. Manual assessment is impractical and time-consuming, emphasizing the need for automated algorithms. In this study, we focus on developing learning-based approaches to evaluate visibility in underwater environments. We explore various neural network architectures and evaluate them on data collected within real subsea scenarios. Notably, the ResNet18 model outperforms others, achieving a testing accuracy of 93.5% in visibility evaluation. In terms of inference time, the fastest model is MobileNetV3 Small, estimating a prediction within 42.45 ms. These findings represent significant progress in enabling unmanned marine operations and contribute to the advancement of autonomous underwater surveillance systems.

2024

Artificial Intelligence for Automated Marine Growth Segmentation

Autores
Carvalho, J; Leite, PN; Mina, J; Pinho, L; Gonçalves, EP; Pinto, AM;

Publicação
ROBOT 2023: SIXTH IBERIAN ROBOTICS CONFERENCE, VOL 2

Abstract
Marine growth impacts the stability and integrity of offshore structures, while simultaneously preventing inspection procedures. In consequence, companies need to employ specialists that manually assess each impacted part of the structure. Due to harsh sub-sea environments, acquiring large quantities of quality underwater data becomes difficult. To mitigate these challenges a new data augmentation algorithm is proposed that generates new images by performing localized crops on regions of interest from the original data, expanding the total size of the dataset approximately 6 times. This research also proposes a learning-based algorithm capable of automatically delineating marine growth in underwater images, achieving up to 0.389 IoU and 0.508 Dice Loss. Advances in this area contribute for reducing the manual labour necessary to schedule maintenance operations in man-made submerged structures, while increasing the reliability and automation of the process.

2024

UAV Shore-to-Ship Parcel Delivery: Gust-Aware Trajectory Planning

Autores
Pensado, E; López, F; Jorge, H; Pinto, A;

Publicação
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS

Abstract
This article presents a real-time trajectory optimizer for shore-to-ship operations using Unmanned Aerial Vehicles (UAVs). This concept aims to improve the efficiency of the transportation system by using UAVs to carry out parcel deliveries to offshore ships. During these operations, UAVs would fly relatively close to manned vessels, posing significant risks to the crew in the event of any incident. Additionally, in these areas, UAVs are exposed to meteorological phenomena such as wind gusts, which may compromise the stability of the flight and lead to potential collisions. Furthermore, this is a phenomenon difficult to predict, which poses a risk that must be considered in the operations. For these reasons, this work proposes a gust-aware multi-objective optimization solution for calculating fast and safe trajectories, considering the risk of flying in areas prone to the formation of intense gusts. Moreover, the system establishes a risk buffer with respect to all vessels to ensure compliance with EASA (European Union Aviation Safety Agency) regulations. For this purpose, Automatic Identification System (AIS) data are used to determine the position and velocity of the different vessels, and trajectory calculations are periodically updated based on their motion. The system computes the minimum-cost trajectory between the ground base and a moving destination ship while keeping these risk buffer constraints. The problem was solved through an Optimal Control formulation discretized on a dynamic graph with time-dependent costs and constraints. The solution was obtained using a Reaching Method that allowed efficient and real-time computations.

2024

Wave-motion compensation for USV–UAV cooperation: A model predictive controller approach

Autores
Martins, J; Pereira, P; Campilho, R; Pinto, A;

Publicação
MESA 2024 - 20th International Conference on Mechatronic, Embedded Systems and Applications, Proceedings

Abstract
Due to the difficult access to the maritime environment, cooperation between different robotic platforms operating in different domains provides numerous advantages when considering Operations and Maintenance (O&M) missions. The nest Uncrewed Surface Vehicle (USV) is equipped with a parallel platform, serving as a landing pad for Uncrewed Aerial Vehicle (UAV) landings in dynamic sea states. This work proposes a methodology for short term forecasting of wave-behaviour using Fast Fourier Transforms (FFT) and a low-pass Butterworth filter to filter out noise readings from the Inertial Measurement Unit (IMU) and applying an Auto-Regressive (AR) model for the forecast, showing good results within an almost 10-second window. These predictions are then used in a Model Predictive Control (MPC) approach to optimize trajectory planning of the landing pad roll and pitch, in order to increase horizontality, consistently mitigating around 80% of the wave induced motion. ©2024 IEEE.

2024

A Multimodal Learning-based Approach for Autonomous Landing of UAV

Autores
Neves, S; Branco, M; Pereira, I; Claro, M; Pinto, M;

Publicação
MESA 2024 - 20th International Conference on Mechatronic, Embedded Systems and Applications, Proceedings

Abstract
In the field of autonomous Unmanned Aerial Vehicles (UAVs) landing, conventional approaches fall short in delivering not only the required precision but also the resilience against environmental disturbances. Yet, learning-based algorithms can offer promising solutions by leveraging their ability to learn the intelligent behaviour from data. On one hand, this paper introduces a novel multimodal transformer-based Deep Learning detector, that can provide reliable positioning for precise autonomous landing. It surpasses standard approaches by addressing individual sensor limitations, achieving high reliability even in diverse weather and sensor failure conditions. It was rigorously validated across varying environments, achieving optimal true positive rates and average precisions of up to 90%. On the other hand, it is proposed a Reinforcement Learning (RL) decision-making model, based on a Deep Q-Network (DQN) rationale. Initially trained in simulation, its adaptive behaviour is successfully transferred and validated in a real outdoor scenario. Furthermore, this approach demonstrates rapid inference times of approximately 5ms, validating its applicability on edge devices. ©2024 IEEE.

2024

A Multimodal Perception System for Precise Landing of UAVs in Offshore Environments

Autores
Claro, RM; Neves, FSP; Pinto, AMG;

Publicação

Abstract
The integration of precise landing capabilities into UAVs is crucial for enabling autonomous operations, particularly in challenging environments such as the offshore scenarios. This work proposes a heterogeneous perception system that incorporates a multimodal fiducial marker, designed to improve the accuracy and robustness of autonomous landing of UAVs in both daytime and nighttime operations. This work presents ViTAL-TAPE, a visual transformer-based model, that enhance the detection reliability of the landing target and overcomes the changes in the illumination conditions and viewpoint positions, where traditional methods fail. VITAL-TAPE is an end-to-end model that combines multimodal perceptual information, including photometric and radiometric data, to detect landing targets defined by a fiducial marker with 6 degrees-of-freedom. Extensive experiments have proved the ability of VITAL-TAPE to detect fiducial markers with an error of 0.01 m. Moreover, experiments using the RAVEN UAV, designed to endure the challenging weather conditions of offshore scenarios, demonstrated that the autonomous landing technology proposed in this work achieved an accuracy up to 0.1 m. This research also presents the first successful autonomous operation of a UAV in a commercial offshore wind farm with floating foundations installed in the Atlantic Ocean. These experiments showcased the system’s accuracy, resilience and robustness, resulting in a precise landing technology that extends mission capabilities of UAVs, enabling autonomous and Beyond Visual Line of Sight offshore operations.

  • 3
  • 173