Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

Publications by Miguel Correia Melo

2021

Development and Evaluation of an Outdoor Multisensory AR System for Cultural Heritage

Authors
Marto, A; Melo, M; Goncalves, A; Bessa, M;

Publication
IEEE ACCESS

Abstract
Enhancing tourist visits to cultural heritage sites by making use of mobile augmented reality has been a tendency in the last few years, presenting mainly audiovisual experiences. However, these explorations using only visuals and sounds, or narratives, do not allow users to be presented with, for example, a particular smell that can be important to feel engaged or to better understand the history of the site. This article pursues the goal of creating an experience that puts the user in a scene planned to evoke several stimuli with SensiMAR prototype - a Multisensory Augmented Reality system that aims to be used in cultural heritage outdoors. When using SensiMAR, the user will be involved with visual reconstructions, surrounded by the soundscape of ancient times, and is exposed to a particular smell very common that time. Given the novelty of this proposal, ascertaining the usability of such a system was raised as a foremost demand. Thus, in addition to its development and implementation specifications, an experimental study was conducted to evaluate the usability of the system in end-users' perspective. The results obtained from random visitors of an archaeological site were analysed according to their sex, age, previous experience with augmented reality technology, and provided condition - audiovisual condition, and multisensory condition, with visual, audio, and smell stimuli. Results were collected from a total of 67 participants and show that this multisensory prototype achieved good usability results across all groups. No statistically differences were found, demonstrating good usability of the SensiMAR system regardless of their sex, age, previous experience with the technology or provided condition.

2021

Hands-free interaction in immersive virtual reality: A systematic review

Authors
Monteiro, P; Goncalves, G; Coelho, H; Melo, M; Bessa, M;

Publication
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS

Abstract
Hands are the most important tool to interact with virtual environments, and they should be available to perform the most critical tasks. For example, a surgeon in VR should keep his/her hands on the instruments and be able to do secondary tasks without performing a disruptive event to the operative task. In this common scenario, one can observe that hands are not available for interaction. The goal of this systematic review is to survey the literature and identify which hands-free interfaces are used, the performed interaction tasks, what metrics are used for interface evaluation, and the results of such evaluations. From 79 studies that met the eligibility criteria, the voice is the most studied interface, followed by the eye and head gaze. Some novel interfaces were brain interfaces and face expressions. System control and selection represent most of the interaction tasks studied and most studies evaluate interfaces for usability. Despite the best interface depending on the task and study, the voice was found to be versatile and showed good results amongst the studies. More research is recommended to improve the practical use of the interfaces and to evaluate the interfaces more formally.

2021

Immersive Virtual Reality for Foreign Language Education: A PRISMA Systematic Review

Authors
Peixoto, B; Pinto, R; Melo, M; Cabral, L; Bessa, M;

Publication
IEEE ACCESS

Abstract
Immersion is a proven method of learning a foreign language and using Virtual Reality to achieve that immersion has high potential educational benefits. However, there are no recent systematic reviews that combine both foreign language education and immersive Virtual Reality. This systematic review aims to identify features, educational methods, technologies, and gaps of immersive virtual reality for foreign and second language education. PRISMA method was followed to carry out the systematic review. From the analysis of the results, two main conclusions were drawn. Firstly, the relation between immersive Virtual Reality and foreign language learning is quite positive, particularly when compared with conventional pedagogical practices. Not only that, the connection between immersive Virtual Reality and the user's motivation and satisfaction is also quite positive. Lastly, limitations such as the low sample of studies and gaps in the literature are addressed, and directions for future work and the area's progress are pointed out.

2021

The Relationship Between Cybersickness, Sense of Presence, and the Users' Expectancy and Perceived Similarity Between Virtual and Real Places

Authors
Magalhaes, M; Melo, M; Bessa, M; Coelho, AF;

Publication
IEEE ACCESS

Abstract
This paper aims to explore the impact of sense of presence and cybersickness on the users' expectancy and perceived similarity between virtual and the corresponding real environments. Two virtual reality setups were tested (non-immersive and immersive) to achieve further conclusions. This research encompassed a quantitative analysis using data collection based on questionnaires, applied to a sample of 45 participants. A virtual experience was conducted (to explore users' cybersickness and sense of presence), followed by a visit to the actual real sites (to determine the degree of perceived similarity between the virtual and the corresponding real environment and if their expectations were fulfilled). Our results show a positive correlation between the global sense of presence and perceived similarity and users' expectancy for the non-immersive VR setup. A positive correlation was also found between the global cybersickness on both perceived similarity and users' expectancy for the immersive VR setup. Implications of such results for virtual tourism are discussed.

2021

Foreign Language Learning Gamification Using Virtual Reality-A Systematic Review of Empirical Research

Authors
Pinto, RD; Peixoto, B; Melo, M; Cabral, L; Bessa, M;

Publication
EDUCATION SCIENCES

Abstract
Virtual reality has shown to have great potential as an educational tool when it comes to new learning methods. With the growth and dissemination of this technology, there is a massive opportunity for teachers to add this technology to their methods of teaching a second/foreign language, since students keep showing a growing interest in new technologies. This systematic review of empirical research aims at understanding whether the use of gaming strategies in virtual reality is beneficial for the learning of a second/foreign language or not. Results show that more than half of the articles proved that virtual reality technologies with gaming strategies can be used to learn a foreign language. It was also found that "learning" was the most evaluated dependent variable among the chosen records, augmented reality was the leading technology used, primary education and lower secondary was the most researched school stages, and the most used language to evaluate the use of gamified technology was by far the English language. Given the lack of directed investigation, it is recommended to use these technologies to support second language learning and not entirely replace traditional approaches. A research agenda is also proposed by the authors.

2021

Systematic Review on Realism Research Methodologies on Immersive Virtual, Augmented and Mixed Realities

Authors
Goncalves, G; Monteiro, P; Coelho, H; Melo, M; Bessa, M;

Publication
IEEE ACCESS

Abstract
Proper evaluation of realism in immersive virtual experiences is crucial to ensure optimisation of resources. This way, we can take better decisions while designing realistic immersive experiences, prioritising factors that have a higher impact on the perceived realism of the virtual experience. This systematic review aims to provide readers with an overview of methodologies used throughout the literature to evaluate realism in immersive virtual, augmented and mixed reality. A total of 79 from 1300 gathered articles met the eligibility criteria and were analysed. Results have shown that virtual reality is by far the platform where realism studies were performed. Head-mounted displays are by far the preferred equipment for such studies. Visual realism is the most researched, followed by audiovisual. The majority of methodologies consisted of subjective, as well as a combination of objective and subjective measures. The most used evaluation instrument is questionnaires where many of which are custom and non-validated. Presence questionnaires are the most used ones and are often used to evaluate the presence, perceived realism and involvement. Cybersickness evaluation is consistently assessed by one self-report questionnaire.

  • 11
  • 18