2021
Authors
de Souza, JPC; Rocha, LF; Filipe, VM; Boaventura Cunha, J; Moreira, AP;
Publication
2021 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC)
Abstract
Nowadays, the robotic welding joint estimation, or weld seam tracking, has improved according to the new developments on computer vision technologies. Typically, the advances are focused on solving inaccurate procedures that advent from the manual positioning of the metal parts in welding workstations, especially in SMEs. Robotic arms, endowed with the appropriate perception capabilities, are a viable solution in this context, aiming for enhancing the production system agility whilst not increasing the production set-up time and costs. In this regard, this paper proposes a local perception pipeline to estimate joint welding points using small-sized/low-cost 3D cameras, following an eyes-on-hand approach. A metrological 3D camera comparison between Intel Realsene D435, D415, and ZED Mini is also discussed, proving that the proposed pipeline associated with standard commercial 3D cameras is viable for welding operations in an industrial environment.
2022
Authors
de Souza, JPC; Amorim, AM; Rocha, LF; Pinto, VH; Moreira, AP;
Publication
INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION
Abstract
Purpose The purpose of this paper is to present a programming by demonstration (PbD) system based on 3D stereoscopic vision and inertial sensing that provides a cost-effective pose tracking system, even during error-prone situations, such as camera occlusions. Design/methodology/approach The proposed PbD system is based on the 6D Mimic innovative solution, whose six degrees of freedom marker hardware had to be revised and restructured to accommodate an IMU sensor. Additionally, a new software pipeline was designed to include this new sensing device, seeking the improvement of the overall system's robustness in stereoscopic vision occlusion situations. Findings The IMU component and the new software pipeline allow the 6D Mimic system to successfully maintain the pose tracking when the main tracking tool, i.e. the stereoscopic vision, fails. Therefore, the system improves in terms of reliability, robustness, and accuracy which were verified by real experiments. Practical implications Based on this proposal, the 6D Mimic system reaches a reliable and low-cost PbD methodology. Therefore, the robot can accurately replicate, on an industrial scale, the artisan level performance of highly skilled shop-floor operators. Originality/value To the best of the authors' knowledge, the sensor fusion between stereoscopic images and IMU applied to robot PbD is a novel approach. The system is entirely designed aiming to reduce costs and taking advantage of an offline processing step for data analysis, filtering and fusion, enhancing the reliability of the PbD system.
2023
Authors
Cordeiro, A; Souza, JP; Costa, CM; Filipe, V; Rocha, LF; Silva, MF;
Publication
ROBOTICS
Abstract
Bin picking is a challenging task involving many research domains within the perception and grasping fields, for which there are no perfect and reliable solutions available that are applicable to a wide range of unstructured and cluttered environments present in industrial factories and logistics centers. This paper contributes with research on the topic of object segmentation in cluttered scenarios, independent of previous object shape knowledge, for textured and textureless objects. In addition, it addresses the demand for extended datasets in deep learning tasks with realistic data. We propose a solution using a Mask R-CNN for 2D object segmentation, trained with real data acquired from a RGB-D sensor and synthetic data generated in Blender, combined with 3D point-cloud segmentation to extract a segmented point cloud belonging to a single object from the bin. Next, it is employed a re-configurable pipeline for 6-DoF object pose estimation, followed by a grasp planner to select a feasible grasp pose. The experimental results show that the object segmentation approach is efficient and accurate in cluttered scenarios with several occlusions. The neural network model was trained with both real and simulated data, enhancing the success rate from the previous classical segmentation, displaying an overall grasping success rate of 87.5%.
2016
Authors
Delgado, FS; Carvalho, JP; Coelho, TVN; Dos Santos, AB;
Publication
Sensors (Switzerland)
Abstract
In this paper, we propose and experimentally investigate an optical sensor based on a novel combination of a long-period fiber grating (LPFG) with a permanent magnet to measure electrical current in unmanned aerial vehicles (UAVs). The proposed device uses a neodymium magnet attached to the grating structure, which suffers from an electromagnetic force produced when the current flows in the wire of the UAV engine. Therefore, it causes deformation on the sensor and thus, different shifts occur in the resonant bands of the transmission spectrum of the LPFG. Finally, the results show that it is possible to monitor electrical current throughout the entire operating range of the UAV engine from 0 A to 10 A in an effective and practical way with good linearity, reliability and response time, which are desirable characteristics in electrical current sensing. © 2016 by the authors; licensee MDPI, Basel, Switzerland.
2017
Authors
Moraes, L; Carmo, LC; Campos, RF; Jucá, MA; Moreira, LS; Carvalho, JP; Texeira, AM; Silveira, DD; Coelho, TVN; Luis, A; Marcato, M; Dos Santos, AB;
Publication
IEEE Aerospace and Electronic Systems Magazine
Abstract
Surveillance missions in vast, difficult access environments are responsible for logistic difficulties in comparison to using an in loco monitoring team. For this and many other reasons, solutions with robotic platforms such as unmanned aerial vehicles (UAVs), present economic advantages. © 1986-2012 IEEE.
2017
Authors
Carvalho, JP; Jucá, MA; Menezes, A; Olivi, LR; Marcato, ALM; dos Santos, AB;
Publication
Lecture Notes in Electrical Engineering
Abstract
Unmanned Aerial Vehicles (UAVs) have become a prominent research field due to their vast applicability and reduced size. An appealing aspect of theUAVs is the ability to accomplish autonomous flights in several contexts and purposes, and a variety of applications have been developed, from military to civilian fields. The system proposed in this work is a novel and simplified interaction between the user and the UAV for autonomous flight, where the necessary computation is performed in an embedded computer, decreasing response time and eliminating the necessity of long-distance communication links with base stations. Results are presented with both hardware in the loop simulations and a real UAV using Pixhawk, and Odroid and ROS as companion computer and software platform for code development. © Springer International Publishing Switzerland 2017.
The access to the final selection minute is only available to applicants.
Please check the confirmation e-mail of your application to obtain the access code.