2021
Authors
Monteiro, P; Goncalves, G; Coelho, H; Melo, M; Bessa, M;
Publication
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
Abstract
Hands are the most important tool to interact with virtual environments, and they should be available to perform the most critical tasks. For example, a surgeon in VR should keep his/her hands on the instruments and be able to do secondary tasks without performing a disruptive event to the operative task. In this common scenario, one can observe that hands are not available for interaction. The goal of this systematic review is to survey the literature and identify which hands-free interfaces are used, the performed interaction tasks, what metrics are used for interface evaluation, and the results of such evaluations. From 79 studies that met the eligibility criteria, the voice is the most studied interface, followed by the eye and head gaze. Some novel interfaces were brain interfaces and face expressions. System control and selection represent most of the interaction tasks studied and most studies evaluate interfaces for usability. Despite the best interface depending on the task and study, the voice was found to be versatile and showed good results amongst the studies. More research is recommended to improve the practical use of the interfaces and to evaluate the interfaces more formally.
2021
Authors
Peixoto, B; Pinto, R; Melo, M; Cabral, L; Bessa, M;
Publication
IEEE ACCESS
Abstract
Immersion is a proven method of learning a foreign language and using Virtual Reality to achieve that immersion has high potential educational benefits. However, there are no recent systematic reviews that combine both foreign language education and immersive Virtual Reality. This systematic review aims to identify features, educational methods, technologies, and gaps of immersive virtual reality for foreign and second language education. PRISMA method was followed to carry out the systematic review. From the analysis of the results, two main conclusions were drawn. Firstly, the relation between immersive Virtual Reality and foreign language learning is quite positive, particularly when compared with conventional pedagogical practices. Not only that, the connection between immersive Virtual Reality and the user's motivation and satisfaction is also quite positive. Lastly, limitations such as the low sample of studies and gaps in the literature are addressed, and directions for future work and the area's progress are pointed out.
2021
Authors
Mukherjee, R; Bessa, M; Melo Pinto, P; Chalmers, A;
Publication
IEEE ACCESS
Abstract
Most Convolution Neural Network (CNN) based object detectors, to date, have been optimized for accuracy and/or detection performance on datasets typically comprised of well exposed 8-bits/pixel/channel Standard Dynamic Range (SDR) images. A major existing challenge in this area is to accurately detect objects under extreme/difficult lighting conditions as SDR image trained detectors fail to accurately detect objects under such challenging lighting conditions. In this paper, we address this issue for the first time by introducing High Dynamic Range (HDR) imaging to object detection. HDR imagery can capture and process approximate to 13 orders of magnitude of scene dynamic range similar to the human eye. HDR trained models are therefore able to extract more salient features from extreme lighting conditions leading to more accurate detections. However, introducing HDR also presents multiple new challenges such as the complete absence of resources and previous literature on such an approach. Here, we introduce a methodology to generate a large scale annotated HDR dataset from any existing SDR dataset and validate the quality of the generated dataset via a robust evaluation technique. We also discuss the challenges of training and validating HDR trained models using existing detectors. Finally, we provide a methodology to create an out of distribution (OOD) HDR dataset to test and compare the performance of HDR and SDR trained detectors under difficult lighting condition. Results suggest that using the proposed methodology, HDR trained models are able to achieve 10 - 12% more accuracy compared to SDR trained models on real-world OOD dataset consisting of high-contrast images under extreme lighting conditions.
2021
Authors
Magalhaes, M; Melo, M; Bessa, M; Coelho, AF;
Publication
IEEE ACCESS
Abstract
This paper aims to explore the impact of sense of presence and cybersickness on the users' expectancy and perceived similarity between virtual and the corresponding real environments. Two virtual reality setups were tested (non-immersive and immersive) to achieve further conclusions. This research encompassed a quantitative analysis using data collection based on questionnaires, applied to a sample of 45 participants. A virtual experience was conducted (to explore users' cybersickness and sense of presence), followed by a visit to the actual real sites (to determine the degree of perceived similarity between the virtual and the corresponding real environment and if their expectations were fulfilled). Our results show a positive correlation between the global sense of presence and perceived similarity and users' expectancy for the non-immersive VR setup. A positive correlation was also found between the global cybersickness on both perceived similarity and users' expectancy for the immersive VR setup. Implications of such results for virtual tourism are discussed.
2021
Authors
Pinto, RD; Peixoto, B; Melo, M; Cabral, L; Bessa, M;
Publication
EDUCATION SCIENCES
Abstract
Virtual reality has shown to have great potential as an educational tool when it comes to new learning methods. With the growth and dissemination of this technology, there is a massive opportunity for teachers to add this technology to their methods of teaching a second/foreign language, since students keep showing a growing interest in new technologies. This systematic review of empirical research aims at understanding whether the use of gaming strategies in virtual reality is beneficial for the learning of a second/foreign language or not. Results show that more than half of the articles proved that virtual reality technologies with gaming strategies can be used to learn a foreign language. It was also found that "learning" was the most evaluated dependent variable among the chosen records, augmented reality was the leading technology used, primary education and lower secondary was the most researched school stages, and the most used language to evaluate the use of gamified technology was by far the English language. Given the lack of directed investigation, it is recommended to use these technologies to support second language learning and not entirely replace traditional approaches. A research agenda is also proposed by the authors.
2021
Authors
Goncalves, G; Monteiro, P; Coelho, H; Melo, M; Bessa, M;
Publication
IEEE ACCESS
Abstract
Proper evaluation of realism in immersive virtual experiences is crucial to ensure optimisation of resources. This way, we can take better decisions while designing realistic immersive experiences, prioritising factors that have a higher impact on the perceived realism of the virtual experience. This systematic review aims to provide readers with an overview of methodologies used throughout the literature to evaluate realism in immersive virtual, augmented and mixed reality. A total of 79 from 1300 gathered articles met the eligibility criteria and were analysed. Results have shown that virtual reality is by far the platform where realism studies were performed. Head-mounted displays are by far the preferred equipment for such studies. Visual realism is the most researched, followed by audiovisual. The majority of methodologies consisted of subjective, as well as a combination of objective and subjective measures. The most used evaluation instrument is questionnaires where many of which are custom and non-validated. Presence questionnaires are the most used ones and are often used to evaluate the presence, perceived realism and involvement. Cybersickness evaluation is consistently assessed by one self-report questionnaire.
The access to the final selection minute is only available to applicants.
Please check the confirmation e-mail of your application to obtain the access code.