Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

2025

Cherry-Picking in Time Series Forecasting: How to Select Datasets to Make Your Model Shine

Authors
Roque, L; Cerqueira, V; Soares, C; Torgo, L;

Publication
THIRTY-NINTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, AAAI-25, VOL 39 NO 19

Abstract
The importance of time series forecasting drives continuous research and the development of new approaches to tackle this problem. Typically, these methods are introduced through empirical studies that frequently claim superior accuracy for the proposed approaches. Nevertheless, concerns are rising about the reliability and generalizability of these results due to limitations in experimental setups. This paper addresses a critical limitation: the number and representativeness of the datasets used. We investigate the impact of dataset selection bias, particularly the practice of cherry-picking datasets, on the performance evaluation of forecasting methods. Through empirical analysis with a diverse set of benchmark datasets, our findings reveal that cherry-picking datasets can significantly distort the perceived performance of methods, often exaggerating their effectiveness. Furthermore, our results demonstrate that by selectively choosing just four datasets - what most studies report - 46% of methods could be deemed best in class, and 77% could rank within the top three. Additionally, recent deep learning-based approaches show high sensitivity to dataset selection, whereas classical methods exhibit greater robustness. Finally, our results indicate that, when empirically validating forecasting algorithms on a subset of the benchmarks, increasing the number of datasets tested from 3 to 6 reduces the risk of incorrectly identifying an algorithm as the best one by approximately 40%. Our study highlights the critical need for comprehensive evaluation frameworks that more accurately reflect real-world scenarios. Adopting such frameworks will ensure the development of robust and reliable forecasting methods.

2025

Comparative insights into semantic archival modelling: evaluating RiC-O and ArchOnto representation capabilities

Authors
Giagnolini, L; Koch, I; Tomasi, F; Teixeira Lopes, C;

Publication
Journal of Documentation

Abstract
Purpose – This study aims to comparatively evaluate two semantic models, ArchOnto (CIDOC CRM based) and Records in Contexts Ontology (RiC-O), for archival representation within the Linked Open Data framework. The research seeks to critically analyse their ability to represent archival documents, events, activities, and provenance through the application on a case study of historical baptism records. Design/methodology/approach – The study adopted a comparative approach, utilising the two models to represent a dataset of baptism records from a Portuguese parish spanning several centuries. This involved information extraction and conversion processes, transforming XML EAD finding aids into RDF to facilitate more explicit semantic representation and analysis. Findings – The analysis revealed distinctive strengths and limitations of each semantic model, providing nuanced insights into their respective capacities for archival description. The findings guide cultural heritage institutions in selecting and implementing the most suitable semantic model for their needs and pave the way for semantic alignment between the two models. Research limitations/implications – Although the case study explored the representation of a wide range of features, potential limitations include the specific contextual constraints of parish records and the need for broader comparative studies across diverse archival contexts. Originality/value – This paper offers original insights into semantic modelling for archival representations by providing a detailed comparative analysis of two ontological approaches. It offers valuable perspectives for archivists, digital humanities researchers, and cultural heritage professionals seeking to enhance the semantic richness of archival descriptions. © 2025 Emerald Publishing Limited

2025

MT-InSAR and Dam Modeling for the Comprehensive Monitoring of an Earth-Fill Dam: The Case of the Beninar Dam (Almeria, Spain) (vol 15, 2802, 2023)

Authors
Marchamalo-Sacristán, M; Ruiz-Armenteros, AM; Lamas-Fernández, F; González-Rodrigo, B; Martínez-Marín, R; Delgado-Blasco, JM; Bakon, M; Lazecky, M; Perissin, D; Papco, J; Sousa, JJ;

Publication
REMOTE SENSING

Abstract
The authors wish to make the following corrections to this manuscript [...]

2025

Expanding Relevance Judgments for Medical Case-based Retrieval Task with Multimodal LLMs

Authors
Pires, C; Nunes, S; Teixeira, LF;

Publication
CoRR

Abstract

2025

Improvement associated with mesh geometry for the decomposition of InSAR results

Authors
Alonso-Diaz, A; Solla, M; Bakon, M; Sousa, J;

Publication
GEO-SPATIAL INFORMATION SCIENCE

Abstract
This paper presents a novel approach to improve the conversion of interferometric synthetic aperture radar (InSAR) ascending and descending orbit measurements into horizontal and vertical deformation components, explicitly considering SAR product characteristics (acquisition geometry, resolution, and positional accuracy). Conventional decomposition methods use square grids, inadequately addressing directional biases associated with satellite images characteristics, reducing measurement accuracy. It is proposed optimized alternative geometries - rectangle, hexagon, and double inverted isosceles trapezoid (diIT) - derived from theoretical analysis of scatterer influence areas for Sentinel-1 imagery and calibrated data from the European ground motion service (EGMS). Validation was conducted comparing results against global navigation satellite system (GNSS) ground-truth data. Accuracy was quantitatively evaluated using deformation velocity (DV) and average Euclidean distance (ED) metrics. Results demonstrated an average 25% improvement in DV detection over traditional square grids, with only minor trade-offs, such as lower scatterer density and sub-millimetric increases in error for hexagon and diIT geometries.

2025

The vividness of mental imagery in virtual reality: A study on multisensory experiences in virtual tourism

Authors
Magalhães, M; Melo, M; Coelho, A; Bessa, M;

Publication
Comput. Graph.

Abstract

  • 18
  • 4312