Detalhes
Nome
João Manuel PedrosaCargo
Investigador AuxiliarDesde
05 dezembro 2018
Nacionalidade
PortugalContactos
+351222094106
joao.m.pedrosa@inesctec.pt
2024
Autores
Rocha, J; Pereira, SC; Pedrosa, J; Campilho, A; Mendonça, AM;
Publicação
ARTIFICIAL INTELLIGENCE IN MEDICINE
Abstract
Chest X-ray scans are frequently requested to detect the presence of abnormalities, due to their low-cost and non-invasive nature. The interpretation of these images can be automated to prioritize more urgent exams through deep learning models, but the presence of image artifacts, e.g. lettering, often generates a harmful bias in the classifiers and an increase of false positive results. Consequently, healthcare would benefit from a system that selects the thoracic region of interest prior to deciding whether an image is possibly pathologic. The current work tackles this binary classification exercise, in which an image is either normal or abnormal, using an attention-driven and spatially unsupervised Spatial Transformer Network (STERN), that takes advantage of a novel domain-specific loss to better frame the region of interest. Unlike the state of the art, in which this type of networks is usually employed for image alignment, this work proposes a spatial transformer module that is used specifically for attention, as an alternative to the standard object detection models that typically precede the classifier to crop out the region of interest. In sum, the proposed end-to-end architecture dynamically scales and aligns the input images to maximize the classifier's performance, by selecting the thorax with translation and non-isotropic scaling transformations, and thus eliminating artifacts. Additionally, this paper provides an extensive and objective analysis of the selected regions of interest, by proposing a set of mathematical evaluation metrics. The results indicate that the STERN achieves similar results to using YOLO-cropped images, with reduced computational cost and without the need for localization labels. More specifically, the system is able to distinguish abnormal frontal images from the CheXpert dataset, with a mean AUC of 85.67% -a 2.55% improvement vs. the 0.98% improvement achieved by the YOLO-based counterpart in comparison to a standard baseline classifier. At the same time, the STERN approach requires less than 2/3 of the training parameters, while increasing the inference time per batch in less than 2 ms. Code available via GitHub.
2024
Autores
Belo, R; Rocha, J; Pedrosa, J;
Publicação
PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS, CIARP 2023, PT I
Abstract
Chest radiography has been widely used for automatic analysis through deep learning (DL) techniques. However, in the manual analysis of these scans, comparison with images at previous time points is commonly done, in order to establish a longitudinal reference. The usage of longitudinal information in automatic analysis is not a common practice, but it might provide relevant information for desired output. In this work, the application of longitudinal information for the detection of cardiomegaly and change in pairs of CXR images was studied. Multiple experiments were performed, where the inclusion of longitudinal information was done at the features level and at the input level. The impact of the alignment of the image pairs (through a developed method) was also studied. The usage of aligned images was revealed to improve the final mcs for both the detection of pathology and change, in comparison to a standard multi-label classifier baseline. The model that uses concatenated image features outperformed the remaining, with an Area Under the Receiver Operating Characteristics Curve (AUC) of 0.858 for change detection, and presenting an AUC of 0.897 for the detection of pathology, showing that pathology features can be used to predict more efficiently the comparison between images. In order to further improve the developed methods, data augmentation techniques were studied. These proved that increasing the representation of minority classes leads to higher noise in the dataset. It also showed that neglecting the temporal order of the images can be an advantageous augmentation technique in longitudinal change studies.
2024
Autores
Abay, SG; Lima, F; Geurts, L; Camara, J; Pedrosa, J; Cunha, A;
Publicação
Procedia Computer Science
Abstract
Low-cost smartphone-compatible portable ophthalmoscopes can capture visuals of the patient's retina to screen several ophthalmological diseases like glaucoma. The images captured have lower quality and resolution than standard retinography devices but enough for glaucoma screening. Small videos are captured to improve the chance of inspecting the eye properly; however, those videos may not always have enough quality for screening glaucoma, and the patient needs to repeat the inspection later. In this paper, a method for automatic assessment of the quality of videos captured using the D-Eye lens is proposed and evaluated with a personal dataset with 539 videos. Based on two methods developed for retina localization on the images/frames, the Circle Hough Transform method with a precision of 78,12% and the YOLOv7 method with a precision of 99,78%, the quality assessment method automatically decides on the quality of the video by measuring the number of frames of good-quality in each video, according to the chosen threshold. © 2024 Elsevier B.V.. All rights reserved.
2024
Autores
Santos, R; Baeza, R; Filipe, VM; Renna, F; Paredes, H; Pedrosa, J;
Publicação
2024 IEEE 22ND MEDITERRANEAN ELECTROTECHNICAL CONFERENCE, MELECON 2024
Abstract
Coronary artery calcium is a good indicator of coronary artery disease and can be used for cardiovascular risk stratification. Over the years, different deep learning approaches have been proposed to automatically segment coronary calcifications in computed tomography scans and measure their extent through calcium scores. However, most methodologies have focused on using 2D architectures which neglect most of the information present in those scans. In this work, we use a 3D convolutional neural network capable of leveraging the 3D nature of computed tomography scans and including more context in the segmentation process. In addition, the selected network is lightweight, which means that we can have 3D convolutions while having low memory requirements. Our results show that the predictions of the model, trained on the COCA dataset, are close to the ground truth for the majority of the patients in the test set obtaining a Dice score of 0.90 +/- 0.16 and a Cohen's linearly weighted kappa of 0.88 in Agatston score risk categorization. In conclusion, our approach shows promise in the tasks of segmenting coronary artery calcifications and predicting calcium scores with the objectives of optimizing clinical workflow and performing cardiovascular risk stratification.
2023
Autores
Ferraz, S; Coimbra, M; Pedrosa, J;
Publicação
FRONTIERS IN CARDIOVASCULAR MEDICINE
Abstract
Echocardiography is the most frequently used imaging modality in cardiology. However, its acquisition is affected by inter-observer variability and largely dependent on the operator's experience. In this context, artificial intelligence techniques could reduce these variabilities and provide a user independent system. In recent years, machine learning (ML) algorithms have been used in echocardiography to automate echocardiographic acquisition. This review focuses on the state-of-the-art studies that use ML to automate tasks regarding the acquisition of echocardiograms, including quality assessment (QA), recognition of cardiac views and assisted probe guidance during the scanning process. The results indicate that performance of automated acquisition was overall good, but most studies lack variability in their datasets. From our comprehensive review, we believe automated acquisition has the potential not only to improve accuracy of diagnosis, but also help novice operators build expertise and facilitate point of care healthcare in medically underserved areas.
Teses supervisionadas
2024
Autor
Pedro Pereira
Instituição
2024
Autor
Rui Castro
Instituição
2024
Autor
Rúben Baeza Silva
Instituição
2024
Autor
Teresa Corado
Instituição
2024
Autor
Francisca Silva
Instituição
The access to the final selection minute is only available to applicants.
Please check the confirmation e-mail of your application to obtain the access code.