Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Sobre

Sobre

Armando Sousa received his Ph.D. degrees in the area of Robotics at the University of Porto, Portugal in 2004.
He is currently an Auxiliary Professor in the same faculty and an integrated researcher in the INESCTEC (Institute for Systems and Computer Engineering of Porto - Technology and Science).
He received several international awards in robotic soccer under the RoboCup Federation (mainly in the small size league). He has also received the Pedagogical Excellence award of the UP in year 2015.
His main research interests include education, robotics, data fusion and vision systems. He has co-authored over 50 international peer-reviewed publications and participated in over 10 international projects in the areas of education and robotics.

Tópicos
de interesse
Detalhes

Detalhes

  • Nome

    Armando Sousa
  • Cargo

    Investigador Sénior
  • Desde

    01 junho 2009
007
Publicações

2024

Inspection of Part Placement Within Containers Using Point Cloud Overlap Analysis for an Automotive Production Line

Autores
Costa C.M.; Dias J.; Nascimento R.; Rocha C.; Veiga G.; Sousa A.; Thomas U.; Rocha L.;

Publicação
Lecture Notes in Mechanical Engineering

Abstract
Reliable operation of production lines without unscheduled disruptions is of paramount importance for ensuring the proper operation of automated working cells involving robotic systems. This article addresses the issue of preventing disruptions to an automotive production line that can arise from incorrect placement of aluminum car parts by a human operator in a feeding container with 4 indexing pins for each part. The detection of the misplaced parts is critical for avoiding collisions between the containers and a high pressure washing machine and also to avoid collisions between the parts and a robotic arm that is feeding parts to a air leakage inspection machine. The proposed inspection system relies on a 3D sensor for scanning the parts inside a container and then estimates the 6 DoF pose of the container followed by an analysis of the overlap percentage between each part reference point cloud and the 3D sensor data. When the overlap percentage is below a given threshold, the part is considered as misplaced and the operator is alerted to fix the part placement in the container. The deployment of the inspection system on an automotive production line for 22 weeks has shown promising results by avoiding 18 hours of disruptions, since it detected 407 containers having misplaced parts in 4524 inspections, from which 12 were false negatives, while no false positives were reported, which allowed the elimination of disruptions to the production line at the cost of manual reinspection of 0.27% of false negative containers by the operator.

2024

An Educational Kit for Simulated Robot Learning in ROS 2

Autores
Almeida, F; Leao, G; Sousa, A;

Publicação
ROBOT 2023: SIXTH IBERIAN ROBOTICS CONFERENCE, VOL 2

Abstract
Robot Learning is one of the most important areas in Robotics and its relevance has only been increasing. The Robot Operating System (ROS) has been one of the most used architectures in Robotics but learning it is not a simple task. Additionally, ROS 1 is reaching its end-of-life and a lot of users are yet to make the transition to ROS 2. Reinforcement Learning (RL) and Robotics are rarely taught together, creating greater demand for tools to teach all these components. This paper aims to develop a learning kit that can be used to teach Robot Learning to students with different levels of expertise in Robotics. This kit works with the Flatland simulator using open-source free software, namely the OpenAI Gym and Stable-Baselines3 packages, and contains tutorials that introduce the user to the simulation environment as well as how to use RL to train the robot to perform different tasks. User tests were conducted to better understand how the kit performs, showing very positive feedback, with most participants agreeing that the kit provided a productive learning experience.

2024

Mission Supervisor for Food Factories Robots

Autores
Moreira, T; Santos, FN; Santos, L; Sarmento, J; Terra, F; Sousa, A;

Publicação
ROBOT 2023: SIXTH IBERIAN ROBOTICS CONFERENCE, VOL 2

Abstract
Climate change, limited natural resources, and the increase in the world's population impose society to produce food more sustainably, with lower energy and water consumption. The use of robots in agriculture is one of the most promising solutions to change the paradigm of agricultural practices. Agricultural robots should be seen as a way to make jobs easier and lighter, and also a way for people who do not have agricultural skills to produce their food. The PixelCropRobot is a low-cost, open-source robot that can perform the processes of monitoring and watering plants in small gardens. This work proposes a mission supervisor for PixelCropRobot, and general agricultural robots, and presents a prototype of user interface to this mission supervision. The communication between the mission supervisor and the other components of the system is done using ROS2 and MQTT, and mission file standardized. The mission supervisor receives a prescription map, with information about the respective mission, and decomposes them into simple tasks. An A* algorithm then defines the priority of each mission that depends on factors like water requirements, and distance travelled. This concept of mission supervisor was deployed into the PixelCropRobot and was validated in real conditions, showing a enormous potential to be extended to other agricultural robots.

2024

YOLO-Based Tree Trunk Types Multispectral Perception: A Two-Genus Study at Stand-Level for Forestry Inventory Management Purposes

Autores
da Silva, DQ; Dos Santos, FN; Filipe, V; Sousa, AJ; Pires, EJS;

Publicação
IEEE ACCESS

Abstract
Stand-level forest tree species perception and identification are needed for monitoring-related operations, being crucial for better biodiversity and inventory management in forested areas. This paper contributes to this knowledge domain by researching tree trunk types multispectral perception at stand-level. YOLOv5 and YOLOv8 - Convolutional Neural Networks specialized at object detection and segmentation - were trained to detect and segment two tree trunk genus (pine and eucalyptus) using datasets collected in a forest region in Portugal. The dataset comprises only two categories, which correspond to the two tree genus. The datasets were manually annotated for object detection and segmentation with RGB and RGB-NIR images, and are publicly available. The Small variant of YOLOv8 was the best model at detection and segmentation tasks, achieving an F1 measure above 87% and 62%, respectively. The findings of this study suggest that the use of extended spectra, including Visible and Near Infrared, produces superior results. The trained models can be integrated into forest tractors and robots to monitor forest genus across different spectra. This can assist forest managers in controlling their forest stands.

2024

Multi-Agent Reinforcement Learning for Side-by-Side Navigation of Autonomous Wheelchairs

Autores
Fonseca, T; Leao, G; Ferreira, LL; Sousa, A; Severino, R; Reis, LP;

Publicação
2024 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS, ICARSC

Abstract
This paper explores the use of Robotics and decentralized Multi-Agent Reinforcement Learning (MARL) for side-by-side navigation in Intelligent Wheelchairs (IW). Evolving from a previous work approach using traditional single-agent methodologies, it adopts a Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm to provide control input and enable a pair of IW to be deployed as decentralized computing agents in real-world environments, discarding the need to rely on communication between each other. In this study, the Flatland 2D simulator, in conjunction with the Robot Operating System (ROS), is used as a realistic environment to train and test the navigation algorithm. An overhaul of the reward function is introduced, which now provides individual rewards for each agent and revised reward incentives. Additionally, the logic for identifying side-by-side navigation was improved, to encourage dynamic alignment control. The preliminary results outline a promising research direction, with the IWs learning to navigate in various realistic hallways testing scenarios. The outcome also suggests that while the MADDPG approach holds potential over single-agent techniques for the decentralized IW robotics application, further investigation are needed for real-world deployment.

Teses
supervisionadas

2023

SuperCoordinator - Coordinator of Educational Subsystems in the context of Industry 4.0

Autor
Joaquim Daniel Rios da Cunha

Instituição
UP-FEUP

2023

RGBD-Based Automatic Stem Selection for Selective Thinning Operations in Forest Context

Autor
Tiago Ferreira Rodrigues

Instituição
UP-FEUP

2023

Formação ética em engenharia com recurso a metodologias ativas: caso de estudo em Engenharia Eletrotécnica

Autor
Maria de Fátima Coelho Monteiro

Instituição
UP-FEUP

2023

Robotic bin picking of flexible entangled tubes

Autor
Gonçalo da Mota Laranjeira Torres Leão

Instituição
UP-FEUP

2023

AI-Based, Real-Time Object Detection in the Public Landscape

Autor
André Vilhena da Costa

Instituição
UP-FEUP