Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

Publications by Manuel Santos Silva

2023

Object Segmentation for Bin Picking Using Deep Learning

Authors
Cordeiro, A; Rocha, LF; Costa, C; Silva, MF;

Publication
ROBOT2022: FIFTH IBERIAN ROBOTICS CONFERENCE: ADVANCES IN ROBOTICS, VOL 2

Abstract
Bin picking based on deep learning techniques is a promising approach that can solve several analytical methods problems. These systems can provide accurate solutions to bin picking in cluttered environments, where the scenario is always changing. This article proposes a robust and accurate system for segmenting bin picking objects, employing an easy configuration procedure to adjust the framework according to a specific object. The framework is implemented in Robot Operating System (ROS) and is divided into a detection and segmentation system. The detection system employs Mask R-CNN instance neural network to identify several objects from two dimensions (2D) grayscale images. The segmentation system relies on the point cloud library (PCL), manipulating 3D point cloud data according to the detection results to select particular points of the original point cloud, generating a partial point cloud result. Furthermore, to complete the bin picking system a pose estimation approach based on matching algorithms is employed, such as Iterative Closest Point (ICP). The system was evaluated for two types of objects, knee tube, and triangular wall support, in cluttered environments. It displayed an average precision of 79% for both models, an average recall of 92%, and an average IOU of 89%. As exhibited throughout the article, this system demonstrates high accuracy in cluttered environments with several occlusions for different types of objects.

2023

Robotics in Natural Settings - CLAWAR 2022, Ponta Delgada, Portugal, 12-14 September, 2022

Authors
Cascalho, JM; Tokhi, MO; Silva, MF; Mendes, AB; Goher, KM; Funk, M;

Publication
CLAWAR

Abstract

2023

Safety Standards for Collision Avoidance Systems in Agricultural Robots - A Review

Authors
Martins, JJ; Silva, M; Santos, F;

Publication
ROBOT2022: FIFTH IBERIAN ROBOTICS CONFERENCE: ADVANCES IN ROBOTICS, VOL 1

Abstract
To produce more food and tackle the labor scarcity, agriculture needs safer robots for repetitive and unsafe tasks (such as spraying). The interaction between humans and robots presents some challenges to ensure a certifiable safe collaboration between human-robot, a reliable system that does not damage goods and plants, in a context where the environment is mostly dynamic, due to the constant environment changes. A well-known solution to this problem is the implementation of real-time collision avoidance systems. This paper presents a global overview about state of the art methods implemented in the agricultural environment that ensure human-robot collaboration according to recognised industry standards. To complement are addressed the gaps and possible specifications that need to be clarified in future standards, taking into consideration the human-machine safety requirements for agricultural autonomous mobile robots.

2023

Bin Picking for Ship-Building Logistics Using Perception and Grasping Systems

Authors
Cordeiro, A; Souza, JP; Costa, CM; Filipe, V; Rocha, LF; Silva, MF;

Publication
ROBOTICS

Abstract
Bin picking is a challenging task involving many research domains within the perception and grasping fields, for which there are no perfect and reliable solutions available that are applicable to a wide range of unstructured and cluttered environments present in industrial factories and logistics centers. This paper contributes with research on the topic of object segmentation in cluttered scenarios, independent of previous object shape knowledge, for textured and textureless objects. In addition, it addresses the demand for extended datasets in deep learning tasks with realistic data. We propose a solution using a Mask R-CNN for 2D object segmentation, trained with real data acquired from a RGB-D sensor and synthetic data generated in Blender, combined with 3D point-cloud segmentation to extract a segmented point cloud belonging to a single object from the bin. Next, it is employed a re-configurable pipeline for 6-DoF object pose estimation, followed by a grasp planner to select a feasible grasp pose. The experimental results show that the object segmentation approach is efficient and accurate in cluttered scenarios with several occlusions. The neural network model was trained with both real and simulated data, enhancing the success rate from the previous classical segmentation, displaying an overall grasping success rate of 87.5%.

2023

Development of a Collaborative Robotic Platform for Autonomous Auscultation

Authors
Lopes, D; Coelho, L; Silva, MF;

Publication
APPLIED SCIENCES-BASEL

Abstract
Listening to internal body sounds, or auscultation, is one of the most popular diagnostic techniques in medicine. In addition to being simple, non-invasive, and low-cost, the information it offers, in real time, is essential for clinical decision-making. This process, usually done by a doctor in the presence of the patient, currently presents three challenges: procedure duration, participants' safety, and the patient's privacy. In this article we tackle these by proposing a new autonomous robotic auscultation system. With the patient prepared for the examination, a 3D computer vision sub-system is able to identify the auscultation points and translate them into spatial coordinates. The robotic arm is then responsible for taking the stethoscope surface into contact with the patient's skin surface at the various auscultation points. The proposed solution was evaluated to perform a simulated pulmonary auscultation in six patients (with distinct height, weight, and skin color). The obtained results showed that the vision subsystem was able to correctly identify 100% of the auscultation points, with uncontrolled lighting conditions, and the positioning subsystem was able to accurately position the gripper on the corresponding positions on the human body. Patients reported no discomfort during auscultation using the described automated procedure.

2023

Insect Farming – An EPS@ISEP 2022 Project

Authors
Copinet, B; Flügge, F; Margetich, LC; Vandepitte, M; Petrache, PL; Duarte, AJ; Malheiro, B; Ribeiro, C; Justo, J; Silva, MF; Ferreira, P; Guedes, P;

Publication
Lecture Notes in Educational Technology

Abstract
Intensive cattle farming as a means of protein production contributes with the direct emission of greenhouse gases and the indirect contamination of soil and water. The public awareness towards this issue is growing in western cultures, leading to the stagnation of meat consumption and to the willingness to adopt alternative sustainable sources of protein. A solution is to farm insects as they present a reduced environmental impact and constitute a well-known source of protein. However, for westerners, eating insects implies a cultural change as they are still seen as dirty and disgusting. In 2022, a team of five EPS@ISEP students chose to design a solution for this problem followed by the assembly and test of the corresponding proof-of-concept prototype. They decided to design a home farming kit to grow mealworms driven by ethical, sustainable and the market needs. Exploring the insect life-cycle, the kit provides protein for humans and animals, chitin for soil bacteria and frass for plants. It can also be used as an educational tool for children to learn about sustainability, social responsibility and insect life-cycles, helping to overtake the cultural barrier against insect eating from a young age. © 2023, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

  • 22
  • 33