Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

Publications by Joaquim João Sousa

2021

Prototyping IoT-Based Virtual Environments: An Approach toward the Sustainable Remote Management of Distributed Mulsemedia Setups

Authors
Adao, T; Pinho, T; Padua, L; Magalhaes, LG; Sousa, JJ; Peres, E;

Publication
APPLIED SCIENCES-BASEL

Abstract
Business models built upon multimedia/multisensory setups delivering user experiences within disparate contexts-entertainment, tourism, cultural heritage, etc.-usually comprise the installation and in-situ management of both equipment and digital contents. Considering each setup as unique in its purpose, location, layout, equipment and digital contents, monitoring and control operations may add up to a hefty cost over time. Software and hardware agnosticity may be of value to lessen complexity and provide more sustainable management processes and tools. Distributed computing under the Internet of Things (IoT) paradigm may enable management processes capable of providing both remote control and monitoring of multimedia/multisensory experiences made available in different venues. A prototyping software to perform IoT multimedia/multisensory simulations is presented in this paper. It is fully based on virtual environments that enable the remote design, layout, and configuration of each experience in a transparent way, without regard of software and hardware. Furthermore, pipelines to deliver contents may be defined, managed, and updated in a context-aware environment. This software was tested in the laboratory and was proven as a sustainable approach to manage multimedia/multisensory projects. It is currently being field-tested by an international multimedia company for further validation.

2021

Terrace Vineyards Detection from UAV Imagery Using Machine Learning: A Preliminary Approach

Authors
Figueiredo, N; Padua, L; Sousa, JJ; Sousa, A;

Publication
PROGRESS IN ARTIFICIAL INTELLIGENCE (EPIA 2021)

Abstract
Alto Douro Wine Region is located in the Northeast of Portugal and is classified by UNESCO as a World Heritage Site. Snaked by the Douro River, the region has been producing wines for over 2000 years, with the world-famous Porto wine standing out. The vineyards, in that region, are built in a territory marked by steep slopes and the almost inexistence of flat land and water. The vineyards that cover the great slopes rise from the Douro River and form an immense terraced staircase. All these ingredients combined make the right key for exploring precision agriculture techniques. In this study, a preliminary approach allowing to perform terrace vineyards identification is presented. This is a key-enabling task towards the achievement of important goals such as production estimation and multi-temporal crop evaluation. The proposed methodology consists in the use of Convolutional Neural Networks (CNNs) to classify and segment the terrace vineyards, considering a high-resolution dataset acquired with remote sensing sensors mounted in unmanned aerial vehicles (UAVs).

2021

Virtual Environments & Precision Viticulture: A Case Study

Authors
Lourenço, J; Teixeira, J; Carvalho, P; Pádua, L; Adão, T; Peres, E; Sousa, JJ;

Publication
IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2021, Brussels, Belgium, July 11-16, 2021

Abstract
The development and implementation of a virtual environment that aims to support farmers in managing their land and crops in a more sustainable way is presented in this paper. It allows both textual and 3D visualization of crop-related biophysical parameters, such as height, volume and length. Moreover, the latter can be dynamically altered according to various criteria. A case study was conducted in a Portuguese vineyard. The application was developed using the Unity software, while a real agricultural data feed was provided by mySense interface. The virtual environment can be seen as a valuable decision support system to assist farmers.

2021

Grapevine Variety Identification Through Grapevine Leaf Images Acquired in Natural Environment

Authors
Carneiro, GS; Pádua, L; Sousa, JJ; Peres, E; Morais, R; Cunha, A;

Publication
IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2021, Brussels, Belgium, July 11-16, 2021

Abstract
In this paper we present a Deep Learning-based methodology to automatically classify 12 of the most representative grapevarieties existing in the Douro Demarked region, Portugal. The dataset used consisted of images of leaves at different stages of development, collected on their natural environment. The development of such methodologies becomes particularly important, in a scenario in which ampeleographers are disappearing, creating a gap in the task of inspection of grape varieties. Our approach was based on the transfer learning of the Xcepetion model, using Focal Loss, adaptive learning rate decay and SGD. The model obtained a F1 score of 0.93. To clearly understand the predictions of the model, and realize which regions of the image contributed the most to the classification, the LIME library was used. This way it was possible to identify the parts of the images that were considered for and against each prediction.

2021

Geohazards Monitoring and Assessment Using Multi-Source Earth Observation Techniques

Authors
Sousa, JJ; Liu, G; Fan, JH; Perski, Z; Steger, S; Bai, SB; Wei, LH; Salvi, S; Wang, Q; Tu, JA; Tong, LQ; Mayrhofer, P; Sonnenschein, R; Liu, SJ; Mao, YC; Tolomei, C; Bignami, C; Atzori, S; Pezzo, G; Wu, LX; Yan, SY; Peres, E;

Publication
REMOTE SENSING

Abstract
Geological disasters are responsible for the loss of human lives and for significant economic and financial damage every year. Considering that these disasters may occur anywhere-both in remote and/or in highly populated areas-and anytime, continuously monitoring areas known to be more prone to geohazards can help to determine preventive or alert actions to safeguard human life, property and businesses. Remote sensing technology-especially satellite-based-can be of help due to its high spatial and temporal coverage. Indeed, data acquired from the most recent satellite missions is considered suitable for a detailed reconstruction of past events but also to continuously monitor sensitive areas on the lookout for potential geohazards. This work aims to apply different techniques and methods for extensive exploitation and analysis of remote sensing data, with special emphasis given to landslide hazard, risk management and disaster prevention. Multi-temporal SAR (Synthetic Aperture Radar) interferometry, SAR tomography, high-resolution image matching and data modelling are used to map out landslides and other geohazards and to also monitor possible hazardous geological activity, addressing different study areas: (i) surface deformation of mountain slopes and glaciers; (ii) land surface displacement; and (iii) subsidence, landslides and ground fissure. Results from both the processing and analysis of a dataset of earth observation (EO) multi-source data support the conclusion that geohazards can be identified, studied and monitored in an effective way using new techniques applied to multi-source EO data. As future work, the aim is threefold: extend this study to sensitive areas located in different countries; monitor structures that have strategic, cultural and/or economical relevance; and resort to artificial intelligence (AI) techniques to be able to analyse the huge amount of data generated by satellite missions and extract useful information in due course.

2021

Deformation Fringes Detection in SAR interferograms Using Deep Learning

Authors
Silva, B; Sousa, JJ; Lazecky, M; Cunha, A;

Publication
Procedia Computer Science

Abstract
The success achieved by using SAR data in the study of the Earth led to a firm commitment from space agencies to develop more and better space-borne SAR sensors. This involvement of the space agencies makes us believe that it is possible to increase the potential of SAR interferometry (InSAR) to near real-time monitoring. Among this ever-increasing number of sensors, the ESA's Sentinel-1 (C-band) mission stands out and appears to be disruptive. This mission is acquiring vast volumes of data making current analyzing approaches inviable. This amount of data can no longer be analyzed and studied using classic methods raising the need to use and create new techniques. We believe that Machine Learning techniques can be the solution to overcome this issue since they allow to train Deep Learning models to automate human processes for a vast volume of data. In this paper, we use deep learning models to automatically find and locate deformation areas in InSAR interferograms without atmospheric correction. We train three state-of-the-art classification models for detection deformation areas, achieving an AUC of 0.864 for the best model (VGG19 for wrapped interferograms). Additionally, we use the same models as encoders to train U-net models, achieving a Dice score of 0.54 for InceptionV3. It is necessary more data to achieve better results in segmentation.

  • 15
  • 25