Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

Publications by HumanISE

2023

Designing for Hybrid Intelligence: A Taxonomy and Survey of Crowd-Machine Interaction

Authors
Correia, A; Grover, A; Schneider, D; Pimentel, AP; Chaves, R; de Almeida, MA; Fonseca, B;

Publication
APPLIED SCIENCES-BASEL

Abstract
With the widespread availability and pervasiveness of artificial intelligence (AI) in many application areas across the globe, the role of crowdsourcing has seen an upsurge in terms of importance for scaling up data-driven algorithms in rapid cycles through a relatively low-cost distributed workforce or even on a volunteer basis. However, there is a lack of systematic and empirical examination of the interplay among the processes and activities combining crowd-machine hybrid interaction. To uncover the enduring aspects characterizing the human-centered AI design space when involving ensembles of crowds and algorithms and their symbiotic relations and requirements, a Computer-Supported Cooperative Work (CSCW) lens strongly rooted in the taxonomic tradition of conceptual scheme development is taken with the aim of aggregating and characterizing some of the main component entities in the burgeoning domain of hybrid crowd-AI centered systems. The goal of this article is thus to propose a theoretically grounded and empirically validated analytical framework for the study of crowd-machine interaction and its environment. Based on a scoping review and several cross-sectional analyses of research studies comprising hybrid forms of human interaction with AI systems and applications at a crowd scale, the available literature was distilled and incorporated into a unifying framework comprised of taxonomic units distributed across integration dimensions that range from the original time and space axes in which every collaborative activity take place to the main attributes that constitute a hybrid intelligence architecture. The upshot is that when turning to the challenges that are inherent in tasks requiring massive participation, novel properties can be obtained for a set of potential scenarios that go beyond the single experience of a human interacting with the technology to comprise a vast set of massive machine-crowd interactions.

2023

A hybrid human-AI tool for scientometric analysis

Authors
Correia, A; Grover, A; Jameel, S; Schneider, D; Antunes, P; Fonseca, B;

Publication
ARTIFICIAL INTELLIGENCE REVIEW

Abstract
Solid research depends on systematic, verifiable and repeatable scientometric analysis. However, scientometric analysis is difficult in the current research landscape characterized by the increasing number of publications per year, intersections between research domains, and the diversity of stakeholders involved in research projects. To address this problem, we propose SciCrowd, a hybrid human-AI mixed-initiative system, which supports the collaboration between Artificial Intelligence services and crowdsourcing services. This work discusses the design and evaluation of SciCrowd. The evaluation is focused on attitudes, concerns and intentions towards use. This study contributes a nuanced understanding of the interplay between algorithmic and human tasks in the process of conducting scientometric analysis.

2023

Investigating Author Research Relatedness through Crowdsourcing: A Replication Study on MTurk

Authors
Correia, A; Paulino, D; Paredes, H; Guimarães, D; Schneider, D; Fonseca, B;

Publication
26th International Conference on Computer Supported Cooperative Work in Design, CSCWD 2023, Rio de Janeiro, Brazil, May 24-26, 2023

Abstract

2023

NLP-Crowdsourcing Hybrid Framework for Inter-Researcher Similarity Detection

Authors
Correia, A; Guimaraes, D; Paredes, H; Fonseca, B; Paulino, D; Trigo, L; Brazdil, P; Schneider, D; Grover, A; Jameel, S;

Publication
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS

Abstract
Visualizing and examining the intellectual landscape and evolution of scientific communities to support collaboration is crucial for multiple research purposes. In some cases, measuring similarities and matching patterns between research publication document sets can help to identify people with similar interests for building research collaboration networks and university-industry linkages. The premise of this work is assessing feasibility for resolving ambiguous cases in similarity detection to determine authorship with natural language processing (NLP) techniques so that crowdsourcing is applied only in instances that require human judgment. Using an NLP-crowdsourcing convergence strategy, we can reduce the costs of microtask crowdsourcing while saving time and maintaining disambiguation accuracy over large datasets. This article contributes a next-gen crowd-artificial intelligence framework that used an ensemble of term frequency-inverse document frequency and bidirectional encoder representation from transformers to obtain similarity rankings for pairs of scientific documents. A sequence of content-based similarity tasks was created using a crowd-powered interface for solving disambiguation problems. Our experimental results suggest that an adaptive NLP-crowdsourcing hybrid framework has advantages for inter-researcher similarity detection tasks where fully automatic algorithms provide unsatisfactory results, with the goal of helping researchers discover potential collaborators using data-driven approaches.

2023

Quest-based Gamification in a software development lab course: a case study

Authors
Flores, H; Pinto, R;

Publication
International Conference on Higher Education Advances

Abstract
Motivation and engagement play a crucial role in student success in a course. Students may lose interest or underestimate courses that tackle non-core learning outcomes to their specific curriculum or program. Gamification, using game elements (e.g., rewards, challenges) in non-game contexts, is one way to motivate and engage students. Some educational courses use project-based learning, where students tackle problems, overcome obstacles, and gain knowledge. Quest-based games are designed as systems of challenges that players must complete to advance and win the game. They were linked with education by applying specific game mechanics to a computing course unit. This paper case studies the application of a quest-based gamification approach in a mandatory software engineering course to boost engagement among higher education students. Results were collected through observational methods and surveying the students, indicating a tendency for higher grades in course years implementing gamification while maintaining satisfactory levels of motivation and engagement. © 2023 International Conference on Higher Education Advances. All rights reserved.

2023

A Review on CubeSat Missions for Ionospheric Science

Authors
Francisco, C; Henriques, R; Barbosa, S;

Publication
AEROSPACE

Abstract
The ionosphere is a fundamental component of the Earth's atmosphere, impacting human activities such as communication transmissions, navigation systems, satellite functions, power network systems, and natural gas pipelines, even endangering human life or health. As technology moves forward, understanding the impact of the ionosphere on our daily lives becomes increasingly important. CubeSats are a promising way to increase understanding of this important atmospheric layer. This paper reviews the state of the art of CubeSat missions designed for ionospheric studies. Their main instrumentation payload and orbits are also analyzed from the point of view of their importance for the missions. It also focuses on the importance of data and metadata, and makes an approach to the aspects that need to be improved.

  • 64
  • 663