Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

Publications by CTM

2023

Brain activation by a VR-based motor imagery and observation task: An fMRI study

Authors
Nunes, D; Vourvopoulos, A; Blanco Mora, DA; Jorge, C; Fernandes, J; Bermudez I Badia, S; Figueiredo, P;

Publication
PloS one

Abstract
Training motor imagery (MI) and motor observation (MO) tasks is being intensively exploited to promote brain plasticity in the context of post-stroke rehabilitation strategies. This may benefit from the use of closed-loop neurofeedback, embedded in brain-computer interfaces (BCI's) to provide an alternative non-muscular channel, which may be further augmented through embodied feedback delivered through virtual reality (VR). Here, we used functional magnetic resonance imaging (fMRI) in a group of healthy adults to map brain activation elicited by an ecologically-valid task based on a VR-BCI paradigm called NeuRow, whereby participants perform MI of rowing with the left or right arm (i.e., MI), while observing the corresponding movement of the virtual arm of an avatar (i.e., MO), on the same side, in a first-person perspective. We found that this MI-MO task elicited stronger brain activation when compared with a conventional MI-only task based on the Graz BCI paradigm, as well as to an overt motor execution task. It recruited large portions of the parietal and occipital cortices in addition to the somatomotor and premotor cortices, including the mirror neuron system (MNS), associated with action observation, as well as visual areas related with visual attention and motion processing. Overall, our findings suggest that the virtual representation of the arms in an ecologically-valid MI-MO task engage the brain beyond conventional MI tasks, which we propose could be explored for more effective neurorehabilitation protocols. Copyright: © 2023 Nunes et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

2023

Zero-shot face recognition: Improving the discriminability of visual face features using a Semantic-Guided Attention Model

Authors
Patricio, C; Neves, JC;

Publication
EXPERT SYSTEMS WITH APPLICATIONS

Abstract
Zero-shot learning enables the recognition of classes not seen during training through the use of semantic information comprising a visual description of the class either in textual or attribute form. Despite the advances in the performance of zero-shot learning methods, most of the works do not explicitly exploit the correlation between the visual attributes of the image and their corresponding semantic attributes for learning discriminative visual features. In this paper, we introduce an attention-based strategy for deriving features from the image regions regarding the most prominent attributes of the image class. In particular, we train a Convolutional Neural Network (CNN) for image attribute prediction and use a gradient-weighted method for deriving the attention activation maps of the most salient image attributes. These maps are then incorporated into the feature extraction process of Zero-Shot Learning (ZSL) approaches for improving the discriminability of the features produced through the implicit inclusion of semantic information. For experimental validation, the performance of state-of-the-art ZSL methods was determined using features with and without the proposed attention model. Surprisingly, we discover that the proposed strategy degrades the performance of ZSL methods in classical ZSL datasets (AWA2), but it can significantly improve performance when using face datasets. Our experiments show that these results are a consequence of the interpretability of the dataset attributes, suggesting that existing ZSL datasets attributes are, in most cases, difficult to be identifiable in the image. Source code is available at https://github.com/CristianoPatricio/SGAM.

2023

Scaling VR Video Conferencing

Authors
Dasari, M; Lu, E; Farb, MW; Pereira, N; Liang, I; Rowe, A;

Publication
2023 IEEE CONFERENCE VIRTUAL REALITY AND 3D USER INTERFACES, VR

Abstract
Virtual Reality (VR) telepresence platforms are being challenged to support live performances, sporting events, and conferences with thousands of users across seamless virtual worlds. Current systems have struggled to meet these demands which has led to high-profile performance events with groups of users isolated in parallel sessions. The core difference in scaling VR environments compared to classic 2D video content delivery comes from the dynamic peer-to-peer spatial dependence on communication. Users have many pair-wise interactions that grow and shrink as they explore spaces. In this paper, we discuss the challenges of VR scaling and present an architecture that supports hundreds of users with spatial audio and video in a single virtual environment. We leverage the property of spatial locality with two key optimizations: (1) a Quality of Service (QoS) scheme to prioritize audio and video traffic based on users' locality, and (2) a resource manager that allocates client connections across multiple servers based on user proximity within the virtual world. Through real-world deployments and extensive evaluations under real and simulated environments, we demonstrate the scalability of our platform while showing improved QoS compared with existing approaches.

2023

Invasive and Minimally Invasive Evaluation of Diffusion Properties of Sugar in Muscle

Authors
Pinheiro, MR; Tuchin, VV; Oliveira, LM;

Publication
IEEE JOURNAL OF SELECTED TOPICS IN QUANTUM ELECTRONICS

Abstract
In this article, the use of diffuse reflectance (R-d) spectroscopy is explored to evaluate the diffusion properties of water and sucrose in skeletal muscle during optical clearing treatments. Treating muscle samples with sucrose-water solutions with different osmolarities, collimated transmittance (T-c) and R-d measurements were performed to obtain the diffusion time (t) and the diffusion coefficient (D) values that characterize the unique water and sucrose fluxes in the muscle and also the optical clearing mechanisms designated as tissue dehydration and refractive index matching. Considering the R-d measurements, the estimated t and D values for water in the muscle were 63.1s and 1.72x10(-6) cm(2)/s, while the ones estimated for sucrose were 261s and 4.86x10(-7) cm(2)/s. Comparing these values with the ones estimated from the T-c measurements, the relative differences observed for t and D were 1.6% and 2.8% in the case of water and 0.3% and 0.4% in the case of sucrose.

2023

Measurement of tissue optical properties in a wide spectral range: a review [Invited]

Authors
Martins, IS; Silva, HF; Lazareva, EN; Chernomyrdin, NV; Zaytsev, KI; Oliveira, LM; Tuchin, VV;

Publication
BIOMEDICAL OPTICS EXPRESS

Abstract
A distinctive feature of this review is a critical analysis of methods and results of measurements of the optical properties of tissues in a wide spectral range from deep UV to terahertz waves. Much attention is paid to measurements of the refractive index of biological tissues and liquids, the knowledge of which is necessary for the effective application of many methods of optical imaging and diagnostics. The optical parameters of healthy and pathological tissues are presented, and the reasons for their differences are discussed, which is important for the discrimination of pathologies and the demarcation of their boundaries. When considering the interaction of terahertz radiation with tissues, the concept of an effective medium is discussed, and relaxation models of the effective optical properties of tissues are presented. Attention is drawn to the manifestation of the scattering properties of tissues in the THz range and the problems of measuring the optical properties of tissues in this range are discussed. In conclusion, a method for the dynamic analysis of the optical properties of tissues under optical clearing using an application of immersion agents is presented. The main mechanisms and technologies of optical clearing, as well as examples of the successful application for differentiation of healthy and pathological tissues, are analyzed. (c) 2022 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement

2023

1st Spring Biophotonics Conference in Porto

Authors
Oliveira, LM; Meglinski, I; Tuchin, VV;

Publication
JOURNAL OF BIOPHOTONICS

Abstract
[No abstract available]

  • 69
  • 377