Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

Publications by Joaquim João Sousa

2021

Deformation Fringes Detection in SAR interferograms Using Deep Learning

Authors
Silva, B; Sousa, JJ; Lazecky, M; Cunha, A;

Publication
Procedia Computer Science

Abstract
The success achieved by using SAR data in the study of the Earth led to a firm commitment from space agencies to develop more and better space-borne SAR sensors. This involvement of the space agencies makes us believe that it is possible to increase the potential of SAR interferometry (InSAR) to near real-time monitoring. Among this ever-increasing number of sensors, the ESA's Sentinel-1 (C-band) mission stands out and appears to be disruptive. This mission is acquiring vast volumes of data making current analyzing approaches inviable. This amount of data can no longer be analyzed and studied using classic methods raising the need to use and create new techniques. We believe that Machine Learning techniques can be the solution to overcome this issue since they allow to train Deep Learning models to automate human processes for a vast volume of data. In this paper, we use deep learning models to automatically find and locate deformation areas in InSAR interferograms without atmospheric correction. We train three state-of-the-art classification models for detection deformation areas, achieving an AUC of 0.864 for the best model (VGG19 for wrapped interferograms). Additionally, we use the same models as encoders to train U-net models, achieving a Dice score of 0.54 for InceptionV3. It is necessary more data to achieve better results in segmentation.

2021

A Convolutional Neural Network-based Ancient Sundanese Character Classifier with Data Augmentation

Authors
Carneiro, GS; Ferreira, A; Morais, R; Sousa, JJ; Cunha, A;

Publication
5TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND COMPUTATIONAL INTELLIGENCE 2020

Abstract
With an increasing interest in the digitization effort of ancient manuscripts, ancient character recognition becomes one of the most important areas in the automated document image analysis. In this regard, we propose a Convolutional Neural Network (CNN)-based classifier to recognize the ancient Sundanese characters obtained from a digital collection of Southeast Asian palm leaf manuscripts. In this work, we utilize two different preprocessing techniques for the dataset. The first technique involves the use of geometric transformations, noise background addition, and brightness adjustment to augment the imbalanced samples to be fed into the classifier. The second technique makes use of the Otsu's threshold method to binarize the characters and only uses the usual geometric transformations for the data augmentation. The proposed network with different data augmentation processes is trained on the training set and tested on the testing set. Image binarization from the second technique can outperform the performance of the CNN-based classifier upon the first technique by achieving a testing accuracy of 97.74%. (C) 2021 The Authors. Published by Elsevier B.V.

2021

Automatic detection of Flavescense Dorée grapevine disease in hyperspectral images using machine learning

Authors
Silva, DM; Bernardin, T; Fanton, K; Nepaul, R; Pádua, L; Sousa, JJ; Cunha, A;

Publication
Procedia Computer Science

Abstract
The technological revolution that we have been witnessing recently has allowed components miniaturization and made electronic components accessible. Hyperspectral sensors benefited from these advances and could be mounted on unmanned aerial vehicles, which was unthinkable until recently. This fact significantly increased the applications of hyperspectral data, namely in agriculture, especially in the detection of diseases at an early stage. The vineyard is one of the agricultural sectors that has the most to gain from the use of this type of data, both by the economic value and by the number of diseases the plants are exposed to. The Flavescense dorée is a disease that attacks vineyards and may conduct to a significant loss. Nowadays, the detection of this disease is based on the visual identification of symptoms performed by experts who cover the entire area. However, this work remains tedious and relies only on the human eye, which is a problem since sometimes healthy plants are torn out, while diseased ones are left. If the experts think they have found symptoms, they take samples to send to the laboratory for further analysis. If the test is positive, then the whole vine is uprooted, to limit the spread of the disease. In this context, the use of hyperspectral data will allow the development of new disease detection methods. However, it will be necessary to reduce the volume of data used to make them usable by conventional resources. Fortunately, the advent of machine learning techniques empowered the development of systems that allow better decisions to be made, and consequently save time and money. In this article, a machine learning approach, which is based on an Autoencoder to automatically detect wine disease, is proposed.

2021

Grapevine Segmentation in RGB Images using Deep Learning

Authors
Carneiro, GA; Magalhães, R; Neto, A; Sousa, JJ; Cunha, A;

Publication
Procedia Computer Science

Abstract
Wine is the most important product from the Douro Region, in Portugal. Ampelographs are disappearing, and farmers need new solutions to identify grapevine varieties to ensure high-quality standards. The development of methodology capable of automatically identify grapevine are in need. In the scenario, deep learning based methods are emerging as the state-of-art in grapevines classification tasks. In previous work, we verify the deep learning models would benefit from focus classification patches in leaves images areas. Deep learning segmentation methods can be used to find grapevine leaves areas. This paper presents a methodology to segment grapevines images automatically based on the U-net model. A private dataset was used, composed of 733 grapevines images frames extracted from 236 videos collected in a natural environment. The trained model obtained a Dice of 95.6% and an Intersection over Union of 91.6%, results that fully satisfy the need of localise grapevine leaves.

2021

An Efficient Method for Generating UAV-Based Hyperspectral Mosaics Using Push-Broom Sensors

Authors
Jurado, JM; Padua, L; Hruska, J; Feito, FR; Sousa, JJS;

Publication
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING

Abstract
Hyperspectral sensors mounted in unmanned aerial vehicles offer new opportunities to explore high-resolution multitemporal spectral analysis in remote sensing applications. Nevertheless, the use of hyperspectral data still poses challenges mainly in postprocessing to correct from high geometric deformation of images. In general, the acquisition of high-quality hyperspectral imagery is achieved through a time-consuming and complex processing workflow. However, this effort is mandatory when using hyperspectral imagery in a multisensor data fusion perspective, such as with thermal infrared imagery or photogrammetric point clouds. Push-broom hyperspectral sensors provide high spectral resolution data, but its scanning acquisition architecture imposes more challenges to create geometrically accurate mosaics from multiple hyperspectral swaths. In this article, an efficient method is presented to correct geometrical distortions on hyperspectral swaths from push-broom sensors by aligning them with an RGB photogrammetric orthophoto mosaic. The proposed method is based on an iterative approach to align hyperspectral swaths with an RGB photogrammetric orthophoto mosaic. Using as input preprocessed hyperspectral swaths, apart from the need of introducing some control points, the workflow is fully automatic and consists of: adaptive swath subdivision into multiple fragments; detection of significant image features; estimation of valid matches between individual swaths and the RGB orthophoto mosaic; and calculation of the best geometric transformation model to the retrieved matches. As a result, geometrical distortions of hyperspectral swaths are corrected and an orthomosaic is generated. This methodology provides an expedite solution able to produce a hyperspectral mosaic with an accuracy ranging from two to five times the ground sampling distance of the high-resolution RGB orthophoto mosaic, enabling the hyperspectral data integration with data from other sensors for multiple applications.

2022

Vineyard classification using OBIA on UAV-based RGB and multispectral data: A case study in different wine regions

Authors
Padua, L; Matese, A; Di Gennaro, SF; Morais, R; Peres, E; Sousa, JJ;

Publication
COMPUTERS AND ELECTRONICS IN AGRICULTURE

Abstract
Vineyard classification is an important process within viticulture-related decision-support systems. Indeed, it improves grapevine vegetation detection, enabling both the assessment of vineyard vegetative properties and the optimization of in-field management tasks. Aerial data acquired by sensors coupled to unmanned aerial vehicles (UAVs) may be used to achieve it. Flight campaigns were conducted to acquire both RGB and multispectral data from three vineyards located in Portugal and in Italy. Red, green, blue and near infrared orthorectified mosaics resulted from the photogrammetric processing of the acquired data. They were then used to calculate RGB and multispectral vegetation indices, as well as a crop surface model (CSM). Three different supervised machine learning (ML) approaches-support vector machine (SVM), random forest (RF) and artificial neural network (ANN)-were trained to classify elements present within each vineyard into one of four classes: grapevine, shadow, soil and other vegetation. The trained models were then used to classify vineyards objects, generated from an object-based image analysis (OBIA) approach, into the four classes. Classification outcomes were compared with an automatic point-cloud classification approach and threshold-based approaches. Results shown that ANN provided a better overall classification performance, regardless of the type of features used. Features based on RGB data showed better performance than the ones based only on multispectral data. However, a higher performance was achieved when using features from both sensors. The methods presented in this study that resort to data acquired from different sensors are suitable to be used in the vineyard classification process. Furthermore, they also may be applied in other land use classification scenarios.

  • 16
  • 27