Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

Publications by CRIIS

2022

An overview of pruning and harvesting manipulators

Authors
Tinoco, V; Silva, MF; Santos, FN; Valente, A; Rocha, LF; Magalhaes, SA; Santos, LC;

Publication
INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION

Abstract
Purpose The motivation for robotics research in the agricultural field has sparked in consequence of the increasing world population and decreasing agricultural labor availability. This paper aims to analyze the state of the art of pruning and harvesting manipulators used in agriculture. Design/methodology/approach A research was performed on papers that corresponded to specific keywords. Ten papers were selected based on a set of attributes that made them adequate for review. Findings The pruning manipulators were used in two different scenarios: grapevines and apple trees. These manipulators showed that a light-controlled environment could reduce visual errors and that prismatic joints on the manipulator are advantageous to obtain a higher reach. The harvesting manipulators were used for three types of fruits: strawberries, tomatoes and apples. These manipulators revealed that different kinematic configurations are required for different kinds of end-effectors, as some of these tools only require movement in the horizontal axis and others are required to reach the target with a broad range of orientations. Originality/value This work serves to reduce the gap in the literature regarding agricultural manipulators and will support new developments of novel solutions related to agricultural robotic grasping and manipulation.

2022

Towards a Closed-loop Neuro-Robotic Approach to DBS Electrode Implantation based on Real-Time Wrist Rigidity Evaluation

Authors
Baptista T.S.; Rito M.; Chamadoira C.; Rocha L.F.; Evans G.; Cunha J.P.S.;

Publication
Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS

Abstract
The iHandU system is a wearable device that quantitatively evaluates changes in wrist rigidity during Deep Brain Stimulation (DBS) surgery, allowing clinicians to find optimal stimulation settings that reduce patient symptoms. Robotic accuracy is also especially relevant in DBS surgery, as accurate electrode placement is required to increase effectiveness and reduce side effects. The main goal of this work is to integrate the advantages of each system in a closed-loop system between an industrial robot and the iHandU system. For this purpose, a comparative analysis of a Leksell stereotactic frame and neuro-robotic system accuracies was performed using a lab-made phantom. The neuro-robotic system reached 90% of trajectories, while the stereotactic frame reached all trajectories. There are significant differences in accuracy errors between these trajectories (p < 0.0001), which can be explained by the high correlation between the neuro-robotic system errors and the distance from the trajectory to the origin of the Leksell coordinate system (?=0.72). Overall accuracy is comparable to existing neuro-robotic systems, achieving a deviation of (1.0 ± 0.5) mm at the target point. The accuracy of DBS electrode positioning and stimulation parameters choice leads to better long-term clinical outcomes in Parkinson's disease patients. Our neuro-robotic system combines real-time feedback assessment of the patient's symptomatic response and automatic positioning of the DBS electrode in a specific brain area.

2022

FollowMe - A Pedestrian Following Algorithm for Agricultural Logistic Robots

Authors
Sarmento, J; Dos Santos, FN; Aguiar, AS; Sobreira, H; Regueiro, CV; Valente, A;

Publication
2022 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC)

Abstract
In Industry 4.0 and Agriculture 4.0, there are logistics areas where robots can play an important role, for example by following a person at a certain distance. These robots can transport heavy tools or simply help collect certain items, such as harvested fruits. The use of Ultra Wide Band (UWB) transceivers as range sensors is becoming very common in the field of robotics, i.e. for localising goods and machines. Since UWB technology has very accurate time resolution, it is advantageous for techniques such as Time Of Arrival (TOA), which can estimate distance by measuring the time between message frames. In this work, UWB transceivers are used as range sensors to track pedestrians/operators. In this work we propose the use of two algorithms for relative localization, between a person and robot. Both algorithms use a similar 2dimensional occupancy grid, but differ in filtering. The first is based on a Extended Kalman Filter (EKF) that fuses the range sensor with odometry. The second is based on an Histogram Filter that calculates the pedestrian position by discretizing the state space in well-defined regions. Finally, a controller is implemented to autonomously command the robot. Both approaches are tested and compared on a real differential drive robot. Both proposed solutions are able to follow a pedestrian at speeds of 0.1m/s, and are promising solutions to complement other solutions based on cameras and LiDAR.

2022

Unscrambling spectral interference and matrix effects in Vitis vinifera Vis-NIR spectroscopy: Towards analytical grade 'in vivo' sugars and acids quantification

Authors
Martins, RC; Barroso, TG; Jorge, P; Cunha, M; Santos, F;

Publication
COMPUTERS AND ELECTRONICS IN AGRICULTURE

Abstract
Analytical grade 'in vivo' plant metabolic quantification using spectroscopy is a key enabling technology for precision agriculture.Current methods such as PLS, ANN and LS-SVM are non-optimal for resolving spectral interference and matrix effects to provide similar results to the analytical chemistry laboratory. This research presents a new self-learning artificial intelligence (SL-AI) method based on the search of covariance modes. These isolate the different modes of interference present in spectral data, allowing the consistent quantification of constituents. A review of the state-of-the-art methods with the figures of merit mean absolute standard error percentage (MASEP) and Pearson correlation coefficient (R) is presented for comparison and discussion. 707 grapes were quantified for glucose, fructose, malic and tartaric acids in five wine-making and one table grape varieties, and used to benchmark the new method against the state-of-the-art methodologies: partial least squares, local partial least squares, artificial neural networks and least squares support vector machines. SL-AI provides consistent quantifications, whereas previous methods exhibit data-driven performance dependence. Pearson correlations of 0.93 to 0.99 and MASEP of 3.70% to 7.33% were obtained with the new methodology. Local partial least squares, the method with the best benchmarks from literature, achieved correlations of 0.81 to 0.94 and MASEP of 8.00% to 13.4%. The covariance mode isolates a particular interference, providing a direct relationship between spectral inference and constituent concentrations, consistent with the Beer-Lambert law. Such quantifies non-dominant absorbance constituents (e.g. sugars and acids), which is a significant step towards 'in vivo' plant physiology-based precision agriculture.

2022

Benchmark of Deep Learning and a Proposed HSV Colour Space Models for the Detection and Classification of Greenhouse Tomato

Authors
Moreira, G; Magalhaes, SA; Pinho, T; dos Santos, FN; Cunha, M;

Publication
AGRONOMY-BASEL

Abstract
The harvesting operation is a recurring task in the production of any crop, thus making it an excellent candidate for automation. In protected horticulture, one of the crops with high added value is tomatoes. However, its robotic harvesting is still far from maturity. That said, the development of an accurate fruit detection system is a crucial step towards achieving fully automated robotic harvesting. Deep Learning (DL) and detection frameworks like Single Shot MultiBox Detector (SSD) or You Only Look Once (YOLO) are more robust and accurate alternatives with better response to highly complex scenarios. The use of DL can be easily used to detect tomatoes, but when their classification is intended, the task becomes harsh, demanding a huge amount of data. Therefore, this paper proposes the use of DL models (SSD MobileNet v2 and YOLOv4) to efficiently detect the tomatoes and compare those systems with a proposed histogram-based HSV colour space model to classify each tomato and determine its ripening stage, through two image datasets acquired. Regarding detection, both models obtained promising results, with the YOLOv4 model standing out with an F1-Score of 85.81%. For classification task the YOLOv4 was again the best model with an Macro F1-Score of 74.16%. The HSV colour space model outperformed the SSD MobileNet v2 model, obtaining results similar to the YOLOv4 model, with a Balanced Accuracy of 68.10%.

2022

SCARA Self Posture Recognition Using a Monocular Camera

Authors
Tinoco, V; Silva, MF; Santos, FN; Morais, R; Filipe, V;

Publication
IEEE ACCESS

Abstract
Robotic manipulators rely on feedback obtained from rotary encoders for control purposes. This article introduces a vision-based feedback system that can be used in an agricultural context, where the shapes and sizes of fruits are uncertain. We aim to mimic a human, using vision and touch as manipulator control feedback. This work explores the use of a fish-eye lens camera to track a SCARA manipulator with coloured markers on its joints for the position estimation with the goal to reduce costs and increase reliability. The Kalman Filter and the Particle Filter are compared and evaluated in terms of accuracy and tracking abilities of the marker's positions. The estimated image coordinates of the markers are converted to world coordinates using planar homography, as the SCARA manipulator has co-planar joints and the coloured markers share the same plane. Three laboratory experiments were conducted to evaluate the system's performance in joint angle estimation of a manipulator. The obtained results are promising, for future cost effective agricultural robotic arms developments. Besides, this work presents solutions and future directions to increase the joint position estimation accuracy.

  • 42
  • 330