Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

Publications by CTM

2021

NINJA TURTLES RACE: A REACTION TIME TEST TO STUDY AND ASSESS THE FOCUS OF ATTENTION, MOTOR, AND COGNITIVE SKILLS IN CHILDREN'S LEARNING PROCESSES

Authors
Sousa, D; Coelho, A; Bernardes, G; Correia, N;

Publication
INTED2021 Proceedings

Abstract

2021

SyVMO: Synchronous Variable Markov Oracle for Modeling and Predicting Multi-part Musical Structures

Authors
Carvalho, N; Bernardes, G;

Publication
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Abstract
We present SyVMO, an algorithmic extension of the Variable Markov Oracle algorithm, to model and predict multi-part dependencies from symbolic music manifestations. Our model has been implemented as a software application named INCITe for computer-assisted algorithmic composition. It learns variable amounts of musical data from style-agnostic music represented as multiple viewpoints. To evaluate the SyVMO model within INCITe, we adopted the Creative Support Index survey and semi-structured interviews. Four expert composers participated in the evaluation using both personal and exogenous music corpus of variable size. The results suggest that INCITe shows great potential to support creative music tasks, namely in assisting the composition process. The use of SyVMO allowed the creation of polyphonic music suggestions from style-agnostic sources while maintaining a coherent melodic structure. © 2021, Springer Nature Switzerland AG.

2021

Musical Control Gestures in Mobile Handheld Devices: Design Guidelines Informed by Daily User Experience

Authors
Clement, A; Moreira, L; Rosa, M; Bernardes, G;

Publication
MULTIMODAL TECHNOLOGIES AND INTERACTION

Abstract
Mobile handheld devices, such as smartphones and tablets, have become some of the most prominent ubiquitous terminals within the information and communication technology landscape. Their transformative power within the digital music domain changed the music ecosystem from production to distribution and consumption. Of interest here is the ever-expanding number of mobile music applications. Despite their growing popularity, their design in terms of interaction perception and control is highly arbitrary. It remains poorly addressed in related literature and lacks a clear, systematized approach. In this context, our paper aims to provide the first steps towards defining guidelines for optimal sonic interaction design practices in mobile music applications. Our design approach is informed by user data in appropriating mobile handheld devices. We conducted an experiment to learn links between control gestures and musical parameters, such as pitch, duration, and amplitude. A twofold action-reflection protocol and tool-set for evaluating the aforementioned links-are also proposed. The results collected from the experiment show statistically significant trends in pitch and duration control gesture mappings. On the other hand, amplitude appears to elicit a more diverse mapping approach, showing no definitive trend in this experiment.

2021

Appropriating Biosensors as Embodied Control Structures in Interactive Music Systems

Authors
Aly, L; Silva, H; Bernardes, G; Penha, R;

Publication
Human Technology

Abstract
We present a scoping review of biosensors appropriation as control structures in interactive music systems (IMSs). Technical and artistic dimensions promoted by transdisciplinary approaches, ranging from biomedicine to musical performance and interaction design fields, support a taxonomy for biosensor-driven IMSs. A broad catalog of 70 biosensor-driven IMSs, ranging in publication dates from 1965 to 2019, was compiled and categorized according to the proposed taxonomy. From the catalog data, we extrapolated representative historical trends, notably to critically verify our working hypothesis that biosensing technologies are expanding the array of control structures within IMSs. Observed data show that our hypothesis is consistent with the historical evolution of the biosensor-driven IMSs. From our findings, we advance future challenges for novel means of control across humans and machines that should ultimately transform the agents involved in interactive music creation to form new corporalities in extended performative settings.

2021

Encoding, Analysing and Modeling I-Folk: A New Database of Iberian Folk Music

Authors
Carvalho N.; Gonzalez-Gutierrez S.; Merchan Sanchez-Jara J.; Bernardes G.; Navarro-Cáceres M.;

Publication
ACM International Conference Proceeding Series

Abstract
Folk music is a fundamental immaterial heritage that promotes cultural identity. However, it lacks a substantial body of open access materials, and its promotion has been disconnected from the education curriculum. In this context, facilitated access to annotated high-quality folk music content can promote better educational tools and enhance cultural heritage literacy. Based on this, we advance and detail three main contributions: 1) a standardized model to musically annotate Iberian folk music; 2) a new database, named I-Folk, with annotated files following the proposed model; and 3) tools for navigating and retrieving folk music contents from the database. A particular emphasis is given to the educational application of the proposed model, contents, and tools in education. Ultimately, we strive for the promotion of Iberian folk music to the educators' community.

2021

Noise promotes disengagement in dementia patients during non-invasive neurorehabilitation treatment

Authors
Animashaun, A; Bernardes, G;

Publication
4th Symposium on Occupational Safety and Health Proceedings Book

Abstract
Introduction:The lack of engagement and the shortage of motivation and drive, also referred to as apathy, negatively impacts the effectiveness and adherence to treatment and the general well-being of people with neurocognitive disorders (NCDs), such as dementia. Methodology:The hypothesis raised states that the engagement of people with dementia during their non-invasive treatments for NCDs is affected by the noisy source levels and negative auditory stimuli present within environmental treatment settings. An online survey was conducted with the study objectives to assess 1) the engagement levels of dementia patients while interacting with others at home versus in therapy facilities, 2) the emotions perceived when interacting with people at home compared to therapy sessions, 3) the perceived loudness of the environment at home versus in therapy facilities, and 4) which source sounds negatively impact the patients at home and during therapy sessions. A purposive sampling (n=62) targeting relatives, friends, and caregivers of dementia patients was conducted via online community forums in the DACH region. Moreover, a recording session was conducted in a psychotherapist’s office to verify the answer tothe questionnaire on the noise sources perceived in therapy facilities. Results and Discussion:The raised hypothesis that disruptive auditory stimuli and noise levels influence the engagement levels of demented individuals during treatment is confirmed as the engagement is affected by the perceived noise disruptions when comparing perceived noise levels and engagement at home to those in treatment facilities.Significant statistical results were found between the lower engagement of demented individuals when interacting with people during therapy sessions compared to higher engagement in-home interactions. Furthermore, negatively perceived sound sources can be found in both therapy facilities and home settings. The noise sound sources identified, such as human voices, household appliances and household noises, while recording inthe psychotherapist’s office align with the questionnaire responses received on this topic. The findings indicate that the perceived heightened noise levels in therapy facilities stand in correlation with the lowered engagement rate perceived during the therapy session compared to the lower noise level and higher engagement encountered when demented individuals interact at home. Conclusion:If the identified noise elements are masked or replaced by other auditory stimuli that promote a soothing soundscape, the original disturbances encountered during therapy and the lack of engagement can possibly be minimized. Further studies need to be conducted in the prototyping of a noise intervention tool to analyze the impact on lack of engagement through noise disturbances.Keywords. Noise, Engagement, Dementia, Therapy, Apathy.INTRODUCTIONNeurocognitive disorders (NCDs) are a steadily rising global public health concern. In 2020, around 50 million people worldwide lived with major NCDs, specifically dementia, with nearly 10 million new cases per year1NCDs can be found in many diseases, including Alzheimer, Parkinson, Huntington, and Creutzfeldt-Jakob (Reith, 2018). The causes of NCDs are typically associated with advanced age. Still, it can occur from incidents such as traumatic brain injuries, infections, thyroid problems, damage to the blood vessels, and other causes (Kane et al., 2017), increasingly affecting a wide range of people and age groups. Successful treatment methods are limited and can be split into two main categories, invasive and non-invasive methods.Invasive treatment methods are surgical procedures, such as Deep Brain Stimulation (DBS), a neurosurgical procedure in which a neurotransmitter is placed in the brain to send electrical 1World Health Organization, Dementia [website] https://www.who.int/news-room/fact-sheets/detail/dementia(accessed 12 April 2021)

  • 77
  • 328