Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Publicações

Publicações por Filipe Neves Santos

2023

In-Field Hyperspectral Proximal Sensing for Estimating Grapevine Water Status to Support Smart Precision Viticulture

Autores
David, E; Tosin, R; Gonçalves, I; Rodrigues, L; Barbosa, C; Santos, F; Pinheiro, H; Martins, R; Cunha, M;

Publicação
The 3rd International Electronic Conference on Agronomy

Abstract

2023

Sound-Based Anomalies Detection in Agricultural Robotics Application

Autores
Baltazar, AR; dos Santos, FN; Soares, SP; Moreira, AP; Cunha, JB;

Publicação
PROGRESS IN ARTIFICIAL INTELLIGENCE, EPIA 2023, PT II

Abstract
Agricultural robots are exposed to adverse conditions reducing the components' lifetime. To reduce the number of inspection, repair and maintenance activities, we propose using audio-based systems to diagnose and detect anomalies in these robots. Audio-based systems are non-destructive/intrusive solutions. Besides, it provides a significant amount of data to diagnose problems and for a wiser scheduler for preventive activities. So, in this work, we installed two microphones in an agricultural robot with a mowing tool. Real audio data was collected with the robotic mowing tool operating in several conditions and stages. Besides, a Sound-based Anomalies Detector (SAD) is proposed and tested with this dataset. The SAD considers a short-time Fourier transform (STFT) computation stage connected to a Support Vector Machine (SVM) classifier. The results with the collected dataset showed an F1 score between 95% and 100% in detecting anomalies in a mowing robot operation.

2024

Fusion of Time-of-Flight Based Sensors with Monocular Cameras for a Robotic Person Follower

Autores
Sarmento, J; dos Santos, FN; Aguiar, AS; Filipe, V; Valente, A;

Publicação
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS

Abstract
Human-robot collaboration (HRC) is becoming increasingly important in advanced production systems, such as those used in industries and agriculture. This type of collaboration can contribute to productivity increase by reducing physical strain on humans, which can lead to reduced injuries and improved morale. One crucial aspect of HRC is the ability of the robot to follow a specific human operator safely. To address this challenge, a novel methodology is proposed that employs monocular vision and ultra-wideband (UWB) transceivers to determine the relative position of a human target with respect to the robot. UWB transceivers are capable of tracking humans with UWB transceivers but exhibit a significant angular error. To reduce this error, monocular cameras with Deep Learning object detection are used to detect humans. The reduction in angular error is achieved through sensor fusion, combining the outputs of both sensors using a histogram-based filter. This filter projects and intersects the measurements from both sources onto a 2D grid. By combining UWB and monocular vision, a remarkable 66.67% reduction in angular error compared to UWB localization alone is achieved. This approach demonstrates an average processing time of 0.0183s and an average localization error of 0.14 meters when tracking a person walking at an average speed of 0.21 m/s. This novel algorithm holds promise for enabling efficient and safe human-robot collaboration, providing a valuable contribution to the field of robotics.

2024

Reagentless Vis-NIR Spectroscopy Point-of-Care for Feline Total White Blood Cell Counts

Autores
Barroso, TG; Queirós, C; Monteiro Silva, F; Santos, F; Gregório, AH; Martins, RC;

Publicação
BIOSENSORS-BASEL

Abstract
Spectral point-of-care technology is reagentless with minimal sampling (<10 mu L) and can be performed in real-time. White blood cells are non-dominant in blood and in spectral information, suffering significant interferences from dominant constituents such as red blood cells, hemoglobin and billirubin. White blood cells of a bigger size can account for 0.5% to 22.5% of blood spectra information. Knowledge expansion was performed using data augmentation through the hybridization of 94 real-world blood samples into 300 synthetic data samples. Synthetic data samples are representative of real-world data, expanding the detailed spectral information through sample hybridization, allowing us to unscramble the spectral white blood cell information from spectra, with correlations of 0.7975 to 0.8397 and a mean absolute error of 32.25% to 34.13%; furthermore, we achieved a diagnostic efficiency between 83% and 100% inside the reference interval (5.5 to 19.5 x 10(9) cell/L), and 85.11% for cases with extreme high white blood cell counts. At the covariance mode level, white blood cells are quantified using orthogonal information on red blood cells, maximizing sensitivity and specificity towards white blood cells, and avoiding the use of non-specific natural correlations present in the dataset; thus, the specifity of white blood cells spectral information is increased. The presented research is a step towards high-specificity, reagentless, miniaturized spectral point-of-care hematology technology for Veterinary Medicine.

2024

Bi-directional hyperspectral reconstruction of cherry tomato: diagnosis of internal tissues maturation stage and composition

Autores
Tosin, R; Cunha, M; Monteiro Silva, F; Santos, F; Barroso, T; Martins, R;

Publicação
FRONTIERS IN PLANT SCIENCE

Abstract
Introduction: Precision monitoring maturity in climacteric fruits like tomato is crucial for minimising losses within the food supply chain and enhancing pre- and post-harvest production and utilisation. Objectives: This paper introduces an approach to analyse the precision maturation of tomato using hyperspectral tomography-like. Methods: A novel bi-directional spectral reconstruction method is presented, leveraging visible to near-infrared (Vis-NIR) information gathered from tomato spectra and their internal tissues (skin, pulp, and seeds). The study, encompassing 118 tomatoes at various maturation stages, employs a multi-block hierarchical principal component analysis combined with partial least squares for bi-directional reconstruction. The approach involves predicting internal tissue spectra by decomposing the overall tomato spectral information, creating a superset with eight latent variables for each tissue. The reverse process also utilises eight latent variables for reconstructing skin, pulp, and seed spectral data. Results: The reconstruction of the tomato spectra presents a mean absolute percentage error of 30.44 % and 5.37 %, 5.25 % and 6.42 % and Pearson's correlation coefficient of 0.85, 0.98, 0.99 and 0.99 for the skin, pulp and seed, respectively. Quality parameters, including soluble solid content (%), chlorophyll (a.u.), lycopene (a.u.), and puncture force (N), were assessed and modelled with PLS with the original and reconstructed datasets, presenting a range of R2 higher than 0.84 in the reconstructed dataset. An empirical demonstration of the tomato maturation in the internal tissues revealed the dynamic of the chlorophyll and lycopene in the different tissues during the maturation process. Conclusion: The proposed approach for inner tomato tissue spectral inference is highly reliable, provides early indications and is easy to operate. This study highlights the potential of Vis-NIR devices in precision fruit maturation assessment, surpassing conventional labour-intensive techniques in cost-effectiveness and efficiency. The implications of this advancement extend to various agronomic and food chain applications, promising substantial improvements in monitoring and enhancing fruit quality. [GRAPHICS] .

2024

Plant Disease Diagnosis Based on Hyperspectral Sensing: Comparative Analysis of Parametric Spectral Vegetation Indices and Nonparametric Gaussian Process Classification Approaches

Autores
Pereira, MR; Verrelst, J; Tosin, R; Caicedo, JPR; Tavares, F; dos Santos, FN; Cunha, M;

Publicação
AGRONOMY-BASEL

Abstract
Early and accurate disease diagnosis is pivotal for effective phytosanitary management strategies in agriculture. Hyperspectral sensing has emerged as a promising tool for early disease detection, yet challenges remain in effectively harnessing its potential. This study compares parametric spectral Vegetation Indices (VIs) and a nonparametric Gaussian Process Classification based on an Automated Spectral Band Analysis Tool (GPC-BAT) for diagnosing plant bacterial diseases using hyperspectral data. The study conducted experiments on tomato plants in controlled conditions and kiwi plants in field settings to assess the performance of VIs and GPC-BAT. In the tomato experiment, the modeling processes were applied to classify the spectral data measured on the healthy class of plants (sprayed with water only) and discriminate them from the data captured on plants inoculated with the two bacterial suspensions (108 CFU mL-1). In the kiwi experiment, the standard modeling results of the spectral data collected on nonsymptomatic plants were compared to the ones obtained using symptomatic plants' spectral data. VIs, known for their simplicity in extracting biophysical information, successfully distinguished healthy and diseased tissues in both plant species. The overall accuracy achieved was 63% and 71% for tomato and kiwi, respectively. Limitations were observed, particularly in differentiating specific disease infections accurately. On the other hand, GPC-BAT, after feature reduction, showcased enhanced accuracy in identifying healthy and diseased tissues. The overall accuracy ranged from 70% to 75% in the tomato and kiwi case studies. Despite its effectiveness, the model faced challenges in accurately predicting certain disease infections, especially in the early stages. Comparative analysis revealed commonalities and differences in the spectral bands identified by both approaches, with overlaps in critical regions across plant species. Notably, these spectral regions corresponded to the absorption regions of various photosynthetic pigments and structural components affected by bacterial infections in plant leaves. The study underscores the potential of hyperspectral sensing in disease diagnosis and highlights the strengths and limitations of VIs and GPC-BAT. The identified spectral features hold biological significance, suggesting correlations between bacterial infections and alterations in plant pigments and structural components. Future research avenues could focus on refining these approaches for improved accuracy in diagnosing diverse plant-pathogen interactions, thereby aiding disease diagnosis. Specifically, efforts could be directed towards adapting these methodologies for early detection, even before symptom manifestation, to better manage agricultural diseases.

  • 19
  • 21