Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Publicações

Publicações por CTM

2022

Emotional machines: Toward affective virtual environments

Autores
Forero, J; Bernardes, G; Mendes, M;

Publicação
MM 2022 - Proceedings of the 30th ACM International Conference on Multimedia

Abstract
Emotional Machines is an interactive installation that builds affective virtual environments through spoken language. In response to the existing limitations of emotion recognition models incorporating computer vision and electrophysiological activity, whose sources are hindered by a head-mounted display, we propose the adoption of speech emotion recognition (from the audio signal) and semantic sentiment analysis. In detail, we use two machine learning models to predict three main emotional categories from high-level semantic and low-level speech features. Output emotions are mapped to audiovisual representation by an end-To-end process. We use a generative model of chord progressions to transfer speech emotion into music and a synthesized image from the text (transcribed from the user's speech). The generated image is used as the style source in the style-Transfer process onto an equirectangular projection image target selected for each emotional category. The installation is an immersive virtual space encapsulating emotions in spheres disposed into a 3D environment. Thus, users can create new affective representations or interact with other previous encoded instances using joysticks. © 2022 Owner/Author.

2022

Leveraging compatibility and diversity in computer-aided music mashup creation

Autores
Bernardo, G; Bernardes, G;

Publicação
Personal and Ubiquitous Computing

Abstract
AbstractWe advance Mixmash-AIS, a multimodal optimization music mashup creation model for loop recombination at scale. Our motivation is to (1) tackle current scalability limitations in state-of-the-art (brute force) computational mashup models while enforcing the (2) compatibility of audio loops and (3) a pool of diverse mashups that can accommodate user preferences. To this end, we adopt the artificial immune system (AIS) opt-aiNet algorithm to efficiently compute a population of compatible and diverse music mashups from loop recombinations. Optimal mashups result from local minima in a feature space representing harmonic, rhythmic, and spectral musical audio compatibility. We objectively assess the compatibility, diversity, and computational performance of Mixmash-AIS generated mashups compared to a standard genetic algorithm (GA) and a brute force (BF) approach. Furthermore, we conducted a perceptual test to validate the objective evaluation function within Mixmash-AIS in capturing user enjoyment of the computer-generated loop mashups. Our results show that while the GA stands as the most efficient algorithm, the AIS opt-aiNet outperforms both the GA and BF approaches in terms of compatibility and diversity. Our listening test has shown that Mixmash-AIS objective evaluation function significantly captures the perceptual compatibility of loop mashups (p < .001).

2022

Proof of Concept of a Low-Cost Beam-Steering Hybrid Reflectarray that Mixes Microstrip and Lens Elements Using Passive Demonstrators

Autores
Luo, Q; Gao, S; Hu, W; Liu, W; Pessoa, LM; Sobhy, M; Sun, YC;

Publicação
IEEE COMMUNICATIONS MAGAZINE

Abstract
In this article, a proof-of-concept study on the use of a hybrid design technique to reduce the number of phase shifters of a beam-scanning reflectarray (RA) is presented. An extended hemispherical lens antenna with feeds inspired by the retrodirective array is developed as a reflecting element, and the hybrid design technique mixes the lenses with the microstrip patch elements to realize a reflecting surface. Compared to the conventional designs that only use microstrip antennas to realize a reflecting surface, given a fixed aperture size the presented design uses 25 percent fewer array elements while shows comparable beam-steering performance. As a result of using fewer elements, the number of required phase shifters or other equivalent components such as RF switches and tunable materials is reduced by 25 percent, which leads to the reduction of the overall antenna system's complexity, cost, and power consumption. To verify the design concept, two passive prototypes with a center frequency at 12.5 GHz were designed and fabricated. The reflecting surface was fabricated by using standard PCB manufacturing and the lenses were fabricated using 3D printing. Good agreement between the simulation and measurement results is obtained. The presented design concept can be extended to the design of RAs operating at different frequency bands including millimetre-wave frequencies with similar radiation performances. The presented design method is not limited to the microstrip patch reflecting elements and can also be applied to the design of the hybrid RAs with different types of reflecting elements.

2022

Editorial of the Special Issue from WorldCIST'20

Autores
Domingues, I; Sequeira, AF;

Publicação
COMPUTATIONAL AND MATHEMATICAL ORGANIZATION THEORY

Abstract

2022

BIOSIG 2021 Special issue on efficient, reliable, and privacy-friendly biometrics

Autores
Sequeira, AE; Gomez Barrero, M; Damer, N; Correia, PL;

Publicação
IET BIOMETRICS

Abstract

2022

Chairs' Message

Autores
Brömme A.; Damer N.; Gomez-Barrero M.; Raja K.; Rathgeb C.; Sequeira A.F.; Todisco M.; Uhl A.;

Publicação
BIOSIG 2022 - Proceedings of the 21st International Conference of the Biometrics Special Interest Group

Abstract

  • 56
  • 328