Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

Publications by Sandro Augusto Magalhães

2023

Deep Learning YOLO-Based Solution for Grape Bunch Detection and Assessment of Biophysical Lesions

Authors
Pinheiro, I; Moreira, G; da Silva, DQ; Magalhaes, S; Valente, A; Oliveira, PM; Cunha, M; Santos, F;

Publication
AGRONOMY-BASEL

Abstract
The world wine sector is a multi-billion dollar industry with a wide range of economic activities. Therefore, it becomes crucial to monitor the grapevine because it allows a more accurate estimation of the yield and ensures a high-quality end product. The most common way of monitoring the grapevine is through the leaves (preventive way) since the leaves first manifest biophysical lesions. However, this does not exclude the possibility of biophysical lesions manifesting in the grape berries. Thus, this work presents three pre-trained YOLO models (YOLOv5x6, YOLOv7-E6E, and YOLOR-CSP-X) to detect and classify grape bunches as healthy or damaged by the number of berries with biophysical lesions. Two datasets were created and made publicly available with original images and manual annotations to identify the complexity between detection (bunches) and classification (healthy or damaged) tasks. The datasets use the same 10,010 images with different classes. The Grapevine Bunch Detection Dataset uses the Bunch class, and The Grapevine Bunch Condition Detection Dataset uses the OptimalBunch and DamagedBunch classes. Regarding the three models trained for grape bunches detection, they obtained promising results, highlighting YOLOv7 with 77% of mAP and 94% of the F1-score. In the case of the task of detection and identification of the state of grape bunches, the three models obtained similar results, with YOLOv5 achieving the best ones with an mAP of 72% and an F1-score of 92%.

2023

Design and Control Architecture of a Triple 3 DoF SCARA Manipulator for Tomato Harvesting

Authors
Tinoco, V; Silva, MF; Santos, FN; Magalhaes, S; Morais, R;

Publication
2023 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS, ICARSC

Abstract
The increasing world population, growing need for agricultural products, and labour shortages have driven the growth of robotics in agriculture. Tasks such as fruit harvesting require extensive hours of work during harvest periods and can be physically exhausting. Autonomous robots bring more efficiency to agricultural tasks with the possibility of working continuously. This paper proposes a stackable 3 DoF SCARA manipulator for tomato harvesting. The manipulator uses a custom electronic circuit to control DC motors with an endless gear at each joint and uses a camera and a Tensor Processing Unit (TPU) for fruit detection. Cascaded PID controllers are used to control the joints with magnetic encoders for rotational feedback, and a time-of-flight sensor for prismatic movement feedback. Tomatoes are detected using an algorithm that finds regions of interest with the red colour present and sends these regions of interest to an image classifier that evaluates whether or not a tomato is present. With this, the system calculates the position of the tomato using stereo vision obtained from a monocular camera combined with the prismatic movement of the manipulator. As a result, the manipulator was able to position itself very close to the target in less than 3 seconds, where an end-effector could adjust its position for the picking.

2022

Benchmarking Edge Computing Devices for Grape Bunches and Trunks Detection using Accelerated Object Detection Single Shot MultiBox Deep Learning Models

Authors
Magalhães, SC; dos Santos, FN; Machado, P; Moreira, AP; Dias, J;

Publication
CoRR

Abstract

2022

Omnidirectional robot modeling and simulation

Authors
Magalhães, SC; Moreira, AP; Costa, P;

Publication
CoRR

Abstract

2023

Tethered Unmanned Aerial Vehicles-A Systematic Review

Authors
Marques, MN; Magalhaes, SA; Dos Santos, FN; Mendonca, HS;

Publication
ROBOTICS

Abstract
In recent years, there has been a remarkable surge in the development and research of tethered aerial systems, thus reflecting a growing interest in their diverse applications. Long-term missions involving aerial vehicles present significant challenges due to the limitations of current battery solutions. Tethered vehicles can circumvent such restrictions by receiving their power from an element on the ground such as a ground station or a mobile terrestrial platform. Tethered Unmanned Aerial Vehicles (UAVs) can also be applied to load transportation achieved by a single or multiple UAVs. This paper presents a comprehensive systematic literature review, with a special focus on solutions published in the last five years (2017-2022). It emphasizes the key characteristics that are capable of grouping publications by application scope, propulsion method, energy transfer solution, perception sensors, and control techniques adopted. The search was performed in six different databases, thereby resulting in 1172 unique publications, from which 182 were considered for inclusion in the data extraction phase of this review. Among the various aircraft types, multirotors emerged as the most widely used category. We also identified significant variations in the application scope of tethered UAVs, thus leading to tailored approaches for each use case, such as the fixed-wing model being predominant in the wind generation application and the lighter-than-air aircraft in the meteorology field. Notably, the classical Proportional-Integral-Derivative (PID) control scheme emerged as the predominant control methodology across the surveyed publications. Regarding energy transfer techniques, most publications did not explicitly describe their approach. However, among those that did, high-voltage DC energy transfer emerged as the preferred solution. In summary, this systematic literature review provides valuable insights into the current state of tethered aerial systems, thereby showcasing their potential as a robust and sustainable alternative to address the challenges associated with long-duration aerial missions and load transportation.

2023

Automated Infield Grapevine Inflorescence Segmentation Based on Deep Learning Models

Authors
Moreira, G; Magalhães, SA; dos Santos, FN; Cunha, M;

Publication
IECAG 2023

Abstract

  • 4
  • 5