Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Publicações

Publicações por Filipe Neves Santos

2022

Unscrambling spectral interference and matrix effects in Vitis vinifera Vis-NIR spectroscopy: Towards analytical grade 'in vivo' sugars and acids quantification

Autores
Martins, RC; Barroso, TG; Jorge, P; Cunha, M; Santos, F;

Publicação
COMPUTERS AND ELECTRONICS IN AGRICULTURE

Abstract
Analytical grade 'in vivo' plant metabolic quantification using spectroscopy is a key enabling technology for precision agriculture.Current methods such as PLS, ANN and LS-SVM are non-optimal for resolving spectral interference and matrix effects to provide similar results to the analytical chemistry laboratory. This research presents a new self-learning artificial intelligence (SL-AI) method based on the search of covariance modes. These isolate the different modes of interference present in spectral data, allowing the consistent quantification of constituents. A review of the state-of-the-art methods with the figures of merit mean absolute standard error percentage (MASEP) and Pearson correlation coefficient (R) is presented for comparison and discussion. 707 grapes were quantified for glucose, fructose, malic and tartaric acids in five wine-making and one table grape varieties, and used to benchmark the new method against the state-of-the-art methodologies: partial least squares, local partial least squares, artificial neural networks and least squares support vector machines. SL-AI provides consistent quantifications, whereas previous methods exhibit data-driven performance dependence. Pearson correlations of 0.93 to 0.99 and MASEP of 3.70% to 7.33% were obtained with the new methodology. Local partial least squares, the method with the best benchmarks from literature, achieved correlations of 0.81 to 0.94 and MASEP of 8.00% to 13.4%. The covariance mode isolates a particular interference, providing a direct relationship between spectral inference and constituent concentrations, consistent with the Beer-Lambert law. Such quantifies non-dominant absorbance constituents (e.g. sugars and acids), which is a significant step towards 'in vivo' plant physiology-based precision agriculture.

2022

Benchmark of Deep Learning and a Proposed HSV Colour Space Models for the Detection and Classification of Greenhouse Tomato

Autores
Moreira, G; Magalhaes, SA; Pinho, T; dos Santos, FN; Cunha, M;

Publicação
AGRONOMY-BASEL

Abstract
The harvesting operation is a recurring task in the production of any crop, thus making it an excellent candidate for automation. In protected horticulture, one of the crops with high added value is tomatoes. However, its robotic harvesting is still far from maturity. That said, the development of an accurate fruit detection system is a crucial step towards achieving fully automated robotic harvesting. Deep Learning (DL) and detection frameworks like Single Shot MultiBox Detector (SSD) or You Only Look Once (YOLO) are more robust and accurate alternatives with better response to highly complex scenarios. The use of DL can be easily used to detect tomatoes, but when their classification is intended, the task becomes harsh, demanding a huge amount of data. Therefore, this paper proposes the use of DL models (SSD MobileNet v2 and YOLOv4) to efficiently detect the tomatoes and compare those systems with a proposed histogram-based HSV colour space model to classify each tomato and determine its ripening stage, through two image datasets acquired. Regarding detection, both models obtained promising results, with the YOLOv4 model standing out with an F1-Score of 85.81%. For classification task the YOLOv4 was again the best model with an Macro F1-Score of 74.16%. The HSV colour space model outperformed the SSD MobileNet v2 model, obtaining results similar to the YOLOv4 model, with a Balanced Accuracy of 68.10%.

2022

Collision Avoidance Considering Iterative Bezier Based Approach for Steep Slope Terrains

Autores
Santos, LC; Santos, FN; Valente, A; Sobreira, H; Sarmento, J; Petry, M;

Publicação
IEEE ACCESS

Abstract
The Agri-Food production requirements needs a more efficient and autonomous processes, and robotics will play a significant role in this process. Deploying agricultural robots on the farm is still a challenging task. Particularly in slope terrains, where it is crucial to avoid obstacles and dangerous steep slope zones. Path planning solutions may fail under several circumstances, as the appearance of a new obstacle. This work proposes a novel open-source solution called AgRobPP-CA to autonomously perform obstacle avoidance during robot navigation. AgRobPP-CA works in real-time for local obstacle avoidance, allowing small deviations, avoiding unexpected obstacles or dangerous steep slope zones, which could impose a fall of the robot. Our results demonstrated that AgRobPP-CA is capable of avoiding obstacles and high slopes in different vineyard scenarios, with low computation requirements. For example, in the last trial, AgRobPP-CA avoided a steep ramp that could impose a fall to the robot.

2022

SCARA Self Posture Recognition Using a Monocular Camera

Autores
Tinoco, V; Silva, MF; Santos, FN; Morais, R; Filipe, V;

Publicação
IEEE ACCESS

Abstract
Robotic manipulators rely on feedback obtained from rotary encoders for control purposes. This article introduces a vision-based feedback system that can be used in an agricultural context, where the shapes and sizes of fruits are uncertain. We aim to mimic a human, using vision and touch as manipulator control feedback. This work explores the use of a fish-eye lens camera to track a SCARA manipulator with coloured markers on its joints for the position estimation with the goal to reduce costs and increase reliability. The Kalman Filter and the Particle Filter are compared and evaluated in terms of accuracy and tracking abilities of the marker's positions. The estimated image coordinates of the markers are converted to world coordinates using planar homography, as the SCARA manipulator has co-planar joints and the coloured markers share the same plane. Three laboratory experiments were conducted to evaluate the system's performance in joint angle estimation of a manipulator. The obtained results are promising, for future cost effective agricultural robotic arms developments. Besides, this work presents solutions and future directions to increase the joint position estimation accuracy.

2022

VineInspector: The Vineyard Assistant

Autores
Mendes, J; Peres, E; dos Santos, FN; Silva, N; Silva, R; Sousa, JJ; Cortez, I; Morais, R;

Publicação
AGRICULTURE-BASEL

Abstract
Proximity sensing approaches with a wide array of sensors available for use in precision viticulture contexts can nowadays be considered both well-know and mature technologies. Still, several in-field practices performed throughout different crops rely on direct visual observation supported on gained experience to assess aspects of plants' phenological development, as well as indicators relating to the onset of common plagues and diseases. Aiming to mimic in-field direct observation, this paper presents VineInspector: a low-cost, self-contained and easy-to-install system, which is able to measure microclimatic parameters, and also to acquire images using multiple cameras. It is built upon a stake structure, rendering it suitable for deployment across a vineyard. The approach through which distinguishable attributes are detected, classified and tallied in the periodically acquired images, makes use of artificial intelligence approaches. Furthermore, it is made available through an IoT cloud-based support system. VineInspector was field-tested under real operating conditions to assess not only the robustness and the operating functionality of the hardware solution, but also the AI approaches' accuracy. Two applications were developed to evaluate Vinelnspector's consistency while a viticulturist' assistant in everyday practices. One was intended to determine the size of the very first grapevines' shoots, one of the required parameters of the well known 3-10 rule to predict primary downy mildew infection. The other was developed to tally grapevine moth males captured in sex traps. Results show that VineInspector is a logical step in smart proximity monitoring by mimicking direct visual observation from experienced viticulturists. While the latter traditionally are responsible for a set of everyday practices in the field, these are time and resource consuming. VineInspector was proven to be effective in two of these practices, performing them automatically. Therefore, it enables both the continuous monitoring and assessment of a vineyard's phenological development in a more efficient manner, making way to more assertive and timely practices against pests and diseases.

2022

Active Perception Fruit Harvesting Robots - A Systematic Review

Autores
Magalhaes, SA; Moreira, AP; dos Santos, FN; Dias, J;

Publicação
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS

Abstract
This paper studies the state-of-the-art of active perception solutions for manipulation in agriculture and suggests a possible architecture for an active perception system for harvesting in agriculture. Research and developing robots for agricultural context is a challenge, particularly for harvesting and pruning context applications. These applications normally consider mobile manipulators and their cognitive part has many challenges. Active perception systems look reasonable approach for fruit assessment robustly and economically. This systematic literature review focus in the topic of active perception for fruits harvesting robots. The search was performed in five different databases. The search resumed into 1034 publications from which only 195 publications where considered for inclusion in this review after analysis. We conclude that the most of researches are mainly about fruit detection and segmentation in two-dimensional space using evenly classic computer vision strategies and deep learning models. For harvesting, multiple viewpoint and visual servoing are the most commonly used strategies. The research of these last topics does not look robust yet, and require further analysis and improvements for better results on fruit harvesting.

  • 12
  • 22