Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
About

About

Professor Auxiliar com Agregação da Universidade de Trás-os-Montes e Alto Douro (UTAD) e doutorado em Ciências da Engenharia Geográfica, pela Universidade do Porto e pela Universidade de Delft (Holanda), tendo apresenta a tese “Potential of integrating PSInSAR Methodologies in the Detection of Surface Deformation”. Atualmente, é Investigador (membro integrado) do Centre for Robotics in Industry and Intelligent Systems (CRISS), do INESC TEC/Polo UTAD, e investigador (colaborador) do CITAB (Centre for the Research and Technology of Agro-Environmental and Biological Sciences). Nos últimos anos tem-se dedicado, sobretudo, à utilização de Veículos Aéreos Não Tripulados (UAV) para aplicações agroflorestais. Utiliza imagens aéreas de elevada resolução, obtidas por diferentes sensores (RGB, NIR, Multiespectrais, Hiperespectrais e Térmicos) para, usando técnicas de processamento de imagem e desenvolvimento de algoritmos, extrair informações e parâmetros relevantes, sobretudo, na vinha, soutos e olivais. Estas técnicas são, no entanto, extensíveis à deteção e monitorização de grande parte das espécies arbóreas, que integram as nossas florestas, e de vegetação rasteira. É autor de várias publicações em revistas internacionais da especialidade do Remote Sensing. Participa em vários projetos de investigação, destacando-se o PARRA (Plataforma integrAda de monitoRização e avaliação da doença da flavescência douRada na vinha), em que é líder por parte da UTAD (SI I&DT, aviso Nº 08/SI/2015, Projeto em Co-Promoção, parceiros do projeto: TEKEVER ASDS - empresa líder, UTAD, Instituto Politécnico de Viana do Castelo, INIAV, Agrociência. Montante total atribuído 1.602.245,58€) e é membro do projeto Plataforma de Inovação da Vinha e do Vinho, linha Remote sensing and detection of grapevine diseases (Projeto I&DT pelo Norte2020, com um financiamento global de 4.500.000,00 €).

Interest
Topics
Details

Details

  • Name

    Joaquim João Sousa
  • Role

    Senior Researcher
  • Since

    01st January 2014
004
Publications

2023

A Systematic Review on Automatic Insect Detection Using Deep Learning

Authors
Teixeira, AC; Ribeiro, J; Morais, R; Sousa, JJ; Cunha, A;

Publication
AGRICULTURE-BASEL

Abstract
Globally, insect pests are the primary reason for reduced crop yield and quality. Although pesticides are commonly used to control and eliminate these pests, they can have adverse effects on the environment, human health, and natural resources. As an alternative, integrated pest management has been devised to enhance insect pest control, decrease the excessive use of pesticides, and enhance the output and quality of crops. With the improvements in artificial intelligence technologies, several applications have emerged in the agricultural context, including automatic detection, monitoring, and identification of insects. The purpose of this article is to outline the leading techniques for the automated detection of insects, highlighting the most successful approaches and methodologies while also drawing attention to the remaining challenges and gaps in this area. The aim is to furnish the reader with an overview of the major developments in this field. This study analysed 92 studies published between 2016 and 2022 on the automatic detection of insects in traps using deep learning techniques. The search was conducted on six electronic databases, and 36 articles met the inclusion criteria. The inclusion criteria were studies that applied deep learning techniques for insect classification, counting, and detection, written in English. The selection process involved analysing the title, keywords, and abstract of each study, resulting in the exclusion of 33 articles. The remaining 36 articles included 12 for the classification task and 24 for the detection task. Two main approaches-standard and adaptable-for insect detection were identified, with various architectures and detectors. The accuracy of the classification was found to be most influenced by dataset size, while detection was significantly affected by the number of classes and dataset size. The study also highlights two challenges and recommendations, namely, dataset characteristics (such as unbalanced classes and incomplete annotation) and methodologies (such as the limitations of algorithms for small objects and the lack of information about small insects). To overcome these challenges, further research is recommended to improve insect pest management practices. This research should focus on addressing the limitations and challenges identified in this article to ensure more effective insect pest management.

2023

Deep Learning Models for the Classification of Crops in Aerial Imagery: A Review

Authors
Teixeira, I; Morais, R; Sousa, JJ; Cunha, A;

Publication
AGRICULTURE-BASEL

Abstract
In recent years, the use of remote sensing data obtained from satellite or unmanned aerial vehicle (UAV) imagery has grown in popularity for crop classification tasks such as yield prediction, soil classification or crop mapping. The ready availability of information, with improved temporal, radiometric, and spatial resolution, has resulted in the accumulation of vast amounts of data. Meeting the demands of analysing this data requires innovative solutions, and artificial intelligence techniques offer the necessary support. This systematic review aims to evaluate the effectiveness of deep learning techniques for crop classification using remote sensing data from aerial imagery. The reviewed papers focus on a variety of deep learning architectures, including convolutional neural networks (CNNs), long short-term memory networks, transformers, and hybrid CNN-recurrent neural network models, and incorporate techniques such as data augmentation, transfer learning, and multimodal fusion to improve model performance. The review analyses the use of these techniques to boost crop classification accuracy by developing new deep learning architectures or by combining various types of remote sensing data. Additionally, it assesses the impact of factors like spatial and spectral resolution, image annotation, and sample quality on crop classification. Ensembling models or integrating multiple data sources tends to enhance the classification accuracy of deep learning models. Satellite imagery is the most commonly used data source due to its accessibility and typically free availability. The study highlights the requirement for large amounts of training data and the incorporation of non-crop classes to enhance accuracy and provide valuable insights into the current state of deep learning models and datasets for crop classification tasks.

2023

Almond cultivar identification using machine learning classifiers applied to UAV-based multispectral data

Authors
Guimaraes, N; Padua, L; Sousa, JJ; Bento, A; Couto, P;

Publication
INTERNATIONAL JOURNAL OF REMOTE SENSING

Abstract
In Portugal, almonds are a very important crop, due to their nutritional properties. In the northeastern part of the country, the almond sector has endured over time, with strong cultural traditions and key economic significance. In these areas, several cultivars are used. In effect, the presence of various almond cultivars implies differentiated management in irrigation, disease control, pruning system, and harvest planning. Therefore, cultivar classification is essential over large agricultural areas. Over the last decades, remote-sensing data have led to important breakthroughs in the classification of different cultivars for several crops. Nonetheless, for almonds, studies are incipient. Thus, this study aims to fill this knowledge gap and explore the classification of almond cultivars in an almond orchard. High-resolution multispectral data were acquired by an unmanned aerial vehicle (UAV). Vegetation indices (VIs) and tree structural parameters were, subsequently, estimated. To obtain an accurate cultivar identification, four machine learning classifiers, such as K-nearest neighbour (kNN), support vector machine (SVM), random forest (RF), and extreme gradient boosting (XGBoost), were applied and optimized through the fine-tuning process. The accuracy of machine learning classifiers was analysed. SVM and RF performed best with OAs of 76% and 74% using VIs and spectral bands (GREEN, GRVI, GN, REN, ClRE). Adding the canopy height model (CHM) improved performance, with RF and XGBoost having OAs of 88% and 84%. kNN performed worst with an OA of 73% using only VIs and spectral bands, 80% with VIs, spectral bands and CHM, and 93% with VIs, CHM, and tree crown area (TCA). The best performance was achieved by RF and XGBoost with OAs of 99% using VIs, CHM, and TCA. These results demonstrate the importance of the feature selection process. Moreover, this study reveals the feasibility of remote-sensing data and machine learning classifiers in the classification of almond cultivars.

2023

MT-InSAR and Dam Modeling for the Comprehensive Monitoring of an Earth-Fill Dam: The Case of the Benínar Dam (Almería, Spain)

Authors
Marchamalo-Sacristán, M; Ruiz-Armenteros, AM; Lamas-Fernández, F; González-Rodrigo, B; Martínez-Marín, R; Delgado-Blasco, JM; Bakon, M; Lazecky, M; Perissin, D; Papco, J; Sousa, JJ;

Publication
Remote Sensing

Abstract
The Benínar Dam, located in Southeastern Spain, is an earth-fill dam that has experienced filtration issues since its construction in 1985. Despite the installation of various monitoring systems, the data collected are sparse and inadequate for the dam’s lifetime. The present research integrates Multi-Temporal Interferometric Synthetic Aperture Radar (MT-InSAR) and dam modeling to validate the monitoring of this dam, opening the way to enhanced integrated monitoring systems. MT-InSAR was proved to be a reliable and continuous monitoring system for dam deformation, surpassing previously installed systems in terms of precision. MT-InSAR allowed the almost-continuous monitoring of this dam since 1992, combining ERS, Envisat, and Sentinel-1A/B data. Line-of-sight (LOS) velocities of settlement in the crest of the dam evolved from maximums of -6 mm/year (1992–2000), -4 mm/year (2002–2010), and -2 mm/year (2015–2021) with median values of -2.6 and -3.0 mm/year in the first periods (ERS and Envisat) and -1.3 mm/year in the Sentinel 1-A/B period. These results are consistent with the maximum admissible modeled deformation from construction, confirming that settlement was more intense in the dam’s early stages and decreased over time. MT-InSAR was also used to integrate the monitoring of the dam basin, including critical slopes, quarries, and infrastructures, such as roads, tracks, and spillways. This study allows us to conclude that MT-InSAR and dam modeling are important elements for the integrated monitoring systems of embankment dams. This conclusion supports the complete integration of MT-InSAR and 3D modeling into the monitoring systems of embankment dams, as they are a key complement to traditional geotechnical monitoring and can overcome the main limitations of topographical monitoring.

2023

Using machine learning and satellite data from multiple sources to analyze mining, water management, and preservation of cultural heritage

Authors
Sousa, JJ; Lin, JH; Wang, Q; Liu, G; Fan, JH; Bai, SB; Zhao, HL; Pan, HY; Wei, WJ; Rittlinger, V; Mayrhofer, P; Sonnenschein, R; Steger, S; Reis, LP;

Publication
GEO-SPATIAL INFORMATION SCIENCE

Abstract
Remote sensing, particularly satellite-based, can play a valuable role in monitoring areas prone to geohazards. The high spatial and temporal coverage provided by satellite data can be used to reconstruct past events and continuously monitor sensitive areas for potential hazards. This paper presents a range of techniques and methods that were applied for in-depth analysis and utilization of Earth observation data, with a particular emphasis on: (1) detecting mining subsidence, where a novel approach is proposed by combining an improved U-Net model and Interferometry Synthetic Aperture Radar (InSAR) technology. The results showed that the Efficient Channel Attention (ECA) U-Net model performed better than the U-Net (baseline) model in terms of Mean Intersection over Union (MIoU) and Intersection over Union (IoU) indicators; (2) monitoring water conservancy and hydropower engineering. The Xiaolangdi multipurpose dam complex was monitored using Small BAsline Subsets (SBAS) InSAR method on Sentinel-1 time series data and four small regions with high deformation rates were identified on the slope of the reservoir bank on the north side. The dam body also showed obvious deformation with a velocity exceeding 60 mm/a; (3) the evaluation of the potential of InSAR results to integrate monitoring and warning systems for valuable heritage and architectural preservation. The overall outcome of these methods showed that the use of Artificial Intelligence (AI) techniques in combination with InSAR data leads to more efficient analysis and interpretation, resulting in improved accuracy and prompt identification of potential hazards; and (4) finally, this study also presents a method for detecting landslides in mountainous regions, using optical imagery. The new temporal landslide detection method is evaluated over a 7-year analysis period and unlike conventional bi-temporal change detection methods, this approach does not depend on any prior-knowledge and can potentially detect landslides over extended periods of time such as decades.

Supervised
thesis

2023

Representation of virtual choreographies in learning dashboards of interoperable LMS and SCORM analytics

Author
Diogo Alexandre Ramos Marques Costa

Institution
UP-FEUP

2023

The Immersive Learning Brain

Author
Elton Cândido Sampaio

Institution
UP-FEUP

2022

Feature Selection in Imbalance Domain Learning Problems: A Case Study on Scrapping of Tires

Author
Pedro Manuel Moreira Unas

Institution
UP-FCUP

2022

Modelos espaciais de previsão de preços de transação habitacionais

Author
João Lucas Faria de Pires

Institution
UP-FCUP

2022

Monitoring Greenhouses with Satellite Images and Machine Learning

Author
Pedro Miguel Pereira Cardoso

Institution
UP-FCUP