Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

Publications by Joaquim João Sousa

2021

A Convolutional Neural Network-based Ancient Sundanese Character Classifier with Data Augmentation

Authors
Carneiro, GS; Ferreira, A; Morais, R; Sousa, JJ; Cunha, A;

Publication
5TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND COMPUTATIONAL INTELLIGENCE 2020

Abstract
With an increasing interest in the digitization effort of ancient manuscripts, ancient character recognition becomes one of the most important areas in the automated document image analysis. In this regard, we propose a Convolutional Neural Network (CNN)-based classifier to recognize the ancient Sundanese characters obtained from a digital collection of Southeast Asian palm leaf manuscripts. In this work, we utilize two different preprocessing techniques for the dataset. The first technique involves the use of geometric transformations, noise background addition, and brightness adjustment to augment the imbalanced samples to be fed into the classifier. The second technique makes use of the Otsu's threshold method to binarize the characters and only uses the usual geometric transformations for the data augmentation. The proposed network with different data augmentation processes is trained on the training set and tested on the testing set. Image binarization from the second technique can outperform the performance of the CNN-based classifier upon the first technique by achieving a testing accuracy of 97.74%. (C) 2021 The Authors. Published by Elsevier B.V.

2021

Automatic detection of Flavescense Dorée grapevine disease in hyperspectral images using machine learning

Authors
Silva, DM; Bernardin, T; Fanton, K; Nepaul, R; Pádua, L; Sousa, JJ; Cunha, A;

Publication
Procedia Computer Science

Abstract
The technological revolution that we have been witnessing recently has allowed components miniaturization and made electronic components accessible. Hyperspectral sensors benefited from these advances and could be mounted on unmanned aerial vehicles, which was unthinkable until recently. This fact significantly increased the applications of hyperspectral data, namely in agriculture, especially in the detection of diseases at an early stage. The vineyard is one of the agricultural sectors that has the most to gain from the use of this type of data, both by the economic value and by the number of diseases the plants are exposed to. The Flavescense dorée is a disease that attacks vineyards and may conduct to a significant loss. Nowadays, the detection of this disease is based on the visual identification of symptoms performed by experts who cover the entire area. However, this work remains tedious and relies only on the human eye, which is a problem since sometimes healthy plants are torn out, while diseased ones are left. If the experts think they have found symptoms, they take samples to send to the laboratory for further analysis. If the test is positive, then the whole vine is uprooted, to limit the spread of the disease. In this context, the use of hyperspectral data will allow the development of new disease detection methods. However, it will be necessary to reduce the volume of data used to make them usable by conventional resources. Fortunately, the advent of machine learning techniques empowered the development of systems that allow better decisions to be made, and consequently save time and money. In this article, a machine learning approach, which is based on an Autoencoder to automatically detect wine disease, is proposed.

2021

Grapevine Segmentation in RGB Images using Deep Learning

Authors
Carneiro, GA; Magalhães, R; Neto, A; Sousa, JJ; Cunha, A;

Publication
Procedia Computer Science

Abstract
Wine is the most important product from the Douro Region, in Portugal. Ampelographs are disappearing, and farmers need new solutions to identify grapevine varieties to ensure high-quality standards. The development of methodology capable of automatically identify grapevine are in need. In the scenario, deep learning based methods are emerging as the state-of-art in grapevines classification tasks. In previous work, we verify the deep learning models would benefit from focus classification patches in leaves images areas. Deep learning segmentation methods can be used to find grapevine leaves areas. This paper presents a methodology to segment grapevines images automatically based on the U-net model. A private dataset was used, composed of 733 grapevines images frames extracted from 236 videos collected in a natural environment. The trained model obtained a Dice of 95.6% and an Intersection over Union of 91.6%, results that fully satisfy the need of localise grapevine leaves.

2021

An Efficient Method for Generating UAV-Based Hyperspectral Mosaics Using Push-Broom Sensors

Authors
Jurado, JM; Padua, L; Hruska, J; Feito, FR; Sousa, JJS;

Publication
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING

Abstract
Hyperspectral sensors mounted in unmanned aerial vehicles offer new opportunities to explore high-resolution multitemporal spectral analysis in remote sensing applications. Nevertheless, the use of hyperspectral data still poses challenges mainly in postprocessing to correct from high geometric deformation of images. In general, the acquisition of high-quality hyperspectral imagery is achieved through a time-consuming and complex processing workflow. However, this effort is mandatory when using hyperspectral imagery in a multisensor data fusion perspective, such as with thermal infrared imagery or photogrammetric point clouds. Push-broom hyperspectral sensors provide high spectral resolution data, but its scanning acquisition architecture imposes more challenges to create geometrically accurate mosaics from multiple hyperspectral swaths. In this article, an efficient method is presented to correct geometrical distortions on hyperspectral swaths from push-broom sensors by aligning them with an RGB photogrammetric orthophoto mosaic. The proposed method is based on an iterative approach to align hyperspectral swaths with an RGB photogrammetric orthophoto mosaic. Using as input preprocessed hyperspectral swaths, apart from the need of introducing some control points, the workflow is fully automatic and consists of: adaptive swath subdivision into multiple fragments; detection of significant image features; estimation of valid matches between individual swaths and the RGB orthophoto mosaic; and calculation of the best geometric transformation model to the retrieved matches. As a result, geometrical distortions of hyperspectral swaths are corrected and an orthomosaic is generated. This methodology provides an expedite solution able to produce a hyperspectral mosaic with an accuracy ranging from two to five times the ground sampling distance of the high-resolution RGB orthophoto mosaic, enabling the hyperspectral data integration with data from other sensors for multiple applications.

2022

Vineyard classification using OBIA on UAV-based RGB and multispectral data: A case study in different wine regions

Authors
Padua, L; Matese, A; Di Gennaro, SF; Morais, R; Peres, E; Sousa, JJ;

Publication
COMPUTERS AND ELECTRONICS IN AGRICULTURE

Abstract
Vineyard classification is an important process within viticulture-related decision-support systems. Indeed, it improves grapevine vegetation detection, enabling both the assessment of vineyard vegetative properties and the optimization of in-field management tasks. Aerial data acquired by sensors coupled to unmanned aerial vehicles (UAVs) may be used to achieve it. Flight campaigns were conducted to acquire both RGB and multispectral data from three vineyards located in Portugal and in Italy. Red, green, blue and near infrared orthorectified mosaics resulted from the photogrammetric processing of the acquired data. They were then used to calculate RGB and multispectral vegetation indices, as well as a crop surface model (CSM). Three different supervised machine learning (ML) approaches-support vector machine (SVM), random forest (RF) and artificial neural network (ANN)-were trained to classify elements present within each vineyard into one of four classes: grapevine, shadow, soil and other vegetation. The trained models were then used to classify vineyards objects, generated from an object-based image analysis (OBIA) approach, into the four classes. Classification outcomes were compared with an automatic point-cloud classification approach and threshold-based approaches. Results shown that ANN provided a better overall classification performance, regardless of the type of features used. Features based on RGB data showed better performance than the ones based only on multispectral data. However, a higher performance was achieved when using features from both sensors. The methods presented in this study that resort to data acquired from different sensors are suitable to be used in the vineyard classification process. Furthermore, they also may be applied in other land use classification scenarios.

2022

VineInspector: The Vineyard Assistant

Authors
Mendes, J; Peres, E; dos Santos, FN; Silva, N; Silva, R; Sousa, JJ; Cortez, I; Morais, R;

Publication
AGRICULTURE-BASEL

Abstract
Proximity sensing approaches with a wide array of sensors available for use in precision viticulture contexts can nowadays be considered both well-know and mature technologies. Still, several in-field practices performed throughout different crops rely on direct visual observation supported on gained experience to assess aspects of plants' phenological development, as well as indicators relating to the onset of common plagues and diseases. Aiming to mimic in-field direct observation, this paper presents VineInspector: a low-cost, self-contained and easy-to-install system, which is able to measure microclimatic parameters, and also to acquire images using multiple cameras. It is built upon a stake structure, rendering it suitable for deployment across a vineyard. The approach through which distinguishable attributes are detected, classified and tallied in the periodically acquired images, makes use of artificial intelligence approaches. Furthermore, it is made available through an IoT cloud-based support system. VineInspector was field-tested under real operating conditions to assess not only the robustness and the operating functionality of the hardware solution, but also the AI approaches' accuracy. Two applications were developed to evaluate Vinelnspector's consistency while a viticulturist' assistant in everyday practices. One was intended to determine the size of the very first grapevines' shoots, one of the required parameters of the well known 3-10 rule to predict primary downy mildew infection. The other was developed to tally grapevine moth males captured in sex traps. Results show that VineInspector is a logical step in smart proximity monitoring by mimicking direct visual observation from experienced viticulturists. While the latter traditionally are responsible for a set of everyday practices in the field, these are time and resource consuming. VineInspector was proven to be effective in two of these practices, performing them automatically. Therefore, it enables both the continuous monitoring and assessment of a vineyard's phenological development in a more efficient manner, making way to more assertive and timely practices against pests and diseases.

  • 16
  • 25