2024
Authors
Agostinho, L; Pereira, D; Hiolle, A; Pinto, A;
Publication
ROBOTICS AND AUTONOMOUS SYSTEMS
Abstract
Ego -motion estimation plays a critical role in autonomous driving systems by providing accurate and timely information about the vehicle's position and orientation. To achieve high levels of accuracy and robustness, it is essential to leverage a range of sensor modalities to account for highly dynamic and diverse scenes, and consequent sensor limitations. In this work, we introduce TEFu-Net, a Deep -Learning -based late fusion architecture that combines multiple ego -motion estimates from diverse data modalities, including stereo RGB, LiDAR point clouds and GNSS/IMU measurements. Our approach is non -parametric and scalable, making it adaptable to different sensor set configurations. By leveraging a Long Short -Term Memory (LSTM), TEFu-Net produces reliable and robust spatiotemporal ego -motion estimates. This capability allows it to filter out erroneous input measurements, ensuring the accuracy of the car's motion calculations over time. Extensive experiments show an average accuracy increase of 63% over TEFu-Net's input estimators and on par results with the state-of-the-art in real -world driving scenarios. We also demonstrate that our solution can achieve accurate estimates under sensor or input failure. Therefore, TEFu-Net enhances the accuracy and robustness of ego -motion estimation in real -world driving scenarios, particularly in challenging conditions such as cluttered environments, tunnels, dense vegetation, and unstructured scenes. As a result of these enhancements, it bolsters the reliability of autonomous driving functions.
2024
Authors
Santos, T; Cunha, T; Dias, A; Moreira, AP; Almeida, J;
Publication
SENSORS
Abstract
Inspecting and maintaining power lines is essential for ensuring the safety, reliability, and efficiency of electrical infrastructure. This process involves regular assessment to identify hazards such as damaged wires, corrosion, or vegetation encroachment, followed by timely maintenance to prevent accidents and power outages. By conducting routine inspections and maintenance, utilities can comply with regulations, enhance operational efficiency, and extend the lifespan of power lines and equipment. Unmanned Aerial Vehicles (UAVs) can play a relevant role in this process by increasing efficiency through rapid coverage of large areas and access to difficult-to-reach locations, enhanced safety by minimizing risks to personnel in hazardous environments, and cost-effectiveness compared to traditional methods. UAVs equipped with sensors such as visual and thermographic cameras enable the accurate collection of high-resolution data, facilitating early detection of defects and other potential issues. To ensure the safety of the autonomous inspection process, UAVs must be capable of performing onboard processing, particularly for detection of power lines and obstacles. In this paper, we address the development of a deep learning approach with YOLOv8 for power line detection based on visual and thermographic images. The developed solution was validated with a UAV during a power line inspection mission, obtaining mAP@0.5 results of over 90.5% on visible images and over 96.9% on thermographic images.
2024
Authors
Oliveira, A; Dias, A; Santos, T; Rodrigues, P; Martins, A; Almeida, J;
Publication
Drones
Abstract
2024
Authors
Almeida, J; Soares, E; Almeida, C; Matias, B; Pereira, R; Sytnyk, D; Silva, P; Ferreira, A; Machado, D; Martins, P; Martins, A;
Publication
Oceans Conference Record (IEEE)
Abstract
This paper addresses the problem of high-bandwidth communication and data recovery from deep-sea semi-permanent robotic landers. These vehicles are suitable for long-term monitoring of underwater activities and to support the operation of other robotic assets in Operation & Maintenance (O&M) of offshore renewables. Limitations of current commu-nication solutions underwater deny the immediate transmission of the collected data to the surface, which is alternatively stored locally inside each lander. Therefore, data recovery often implies the interruption of the designated tasks so that the vehicle can return to the surface and transmit the collected data. Resorting to a short-range and high-bandwidth optical link, an alternative underwater strategy for flexible data exchange is presented. It involves the usage of an AUV satellite approaching each underwater node until an optical communication channel is established. At this point, high-bandwidth communication with the remote lander becomes available, offering the possibility to perform a variety of operations, including the download of previously recorded information, the visualisation of video streams from the lander on-board cameras, or even performing remote motion control of the lander. All these three operations were tested and validated with the experimental setup reported here. The experiments were performed in the Atlantic Ocean, at Setúbal underwater canyon, reaching the operation depth of 350m meters. Two autonomous robotic platforms were used in the experiments, namely the TURTLE3 lander and the EVA Hybrid Autonomous Underwater Vehicle. Since EVA kept a tether fibre optic connection to the Mar Profundo support vessel, it was possible to establish a full communication chain between a land-based control centre and the remote underwater nodes. © 2024 IEEE.
2024
Authors
Minhoto, V; Santos, T; Silva, LTE; Rodrigues, P; Arrais, A; Amaral, A; Dias, A; Almeida, J; Cunha, JPS;
Publication
ROBOT 2023: SIXTH IBERIAN ROBOTICS CONFERENCE, VOL 2
Abstract
Over the last few years, Man-Machine collaborative systems have been increasingly present in daily routines. In these systems, one operator usually controls the machine through explicit commands and assesses the information through a graphical user interface. Direct & implicit interaction between the machine and the user does not exist. This work presents a man-machine symbiotic concept & system where such implicit interaction is possible targeting search and rescue scenarios. Based on measuring physiological variables (e.g. body movement or electrocardiogram) through wearable devices, this system is capable of computing the psycho-physiological state of the human and autonomously identify abnormal situations (e.g. fall or stress). This information is injected into the control loop of the machine that can alter its behavior according to it, enabling an implicit man-machine communication mechanism. A proof of concept of this system was tested at the ARTEX (ARmy Technological EXperimentation) exercise organized by the Portuguese Army involving a military agent and a drone. During this event the soldier was equipped with a kit of wearables that could monitor several physiological variables and automatically detect a fall during a mission. This information was continuously sent to the drone that successfully identified this abnormal situation triggering the take-off and a situation awareness fly-by flight pattern, delivering a first-aid kit to the soldier in case he did not recover after a pre-determined time period. The results were very positive, proving the possibility and feasibility of a symbiotic system between humans and machines.
2024
Authors
Barbosa, S; Dias, N; Almeida, C; Amaral, G; Ferreira, A; Camilo, A; Silva, E;
Publication
Abstract
The access to the final selection minute is only available to applicants.
Please check the confirmation e-mail of your application to obtain the access code.