Gonçalo Leão

Abstract
Robotics is an ever-growing field, used in countless applications, from domestic to industrial, and taught in advanced courses of multiple higher education institutions. Robot Operating System (ROS), the most prominent robotics architecture, integrates several of these, and has recently moved to a new iteration in the form of ROS2. This project aims to design a complete educational package meant for teaching intelligent robotics in ROS1 and ROS2. A foundation for the package was constructed, using a small differential drive robot equipped with camera-based virtual sensors, a representation in the Flatland simulator, and introductory lessons to both ROS versions and Reinforcement Learning (RL) in robotics. To evaluate the package's pertinence, expected learning outcomes were set and the lessons were tested with users from varying backgrounds and levels of robotics experience. Encouraging results were obtained, especially in the ROS1 and ROS2 lessons, while the feedback from the RL lesson provided clear indications for future improvements. Therefore, this work provides solid groundwork for a more comprehensive educational package on robotics and ROS.

Abstract
Bin picking is a challenging problem that involves using a robotic manipulator to remove, one-by-one, a set of objects randomly stacked in a container. When the objects are prone to entanglement, having an estimation of their pose and shape is highly valuable for more reliable grasp and motion planning. This paper focuses on modeling entangled tubes with varying degrees of curvature. An unconventional machine learning technique, Inductive Logic Programming (ILP), is used to construct sets of rules (theories) capable of modeling multiple tubes when given the cylinders that constitute them. Datasets of entangled tubes are created via simulation in Gazebo. Experiments using Aleph and SWI-Prolog illustrate how ILP can build explainable theories with a high performance, using a relatively small dataset and low amount of time for training. Therefore, this work serves as a proof-of-concept that ILP is a valuable method to acquire knowledge and validate heuristics for pose and shape estimation in complex bin picking scenarios.

Abstract
Reinforcement Learning (RL) is a well-suited paradigm to train robots since it does not require any previous information or database to train an agent. This paper explores using Deep Reinforcement Learning (DRL) to train a robot to navigate in maps containing different sorts of obstacles and which emulate hallways. Training and testing were performed using the Flatland 2D simulator and a Deep Q-Network (DQN) provided by OpenAI gym. Different sets of maps were used for training and testing. The experiments illustrate how well the robot is able to navigate in maps distinct from the ones used for training by learning new behaviours (namely following walls) and highlight the key challenges when solving this task using DRL, including the appropriate definition of the state space and reward function, as well as of the stopping criteria during training.

Abstract
Bin picking is a challenging problem that involves using a robotic manipulator to remove, one-by-one, a set of objects randomly stacked in a container. In order to provide ground truth data for evaluating heuristic or machine learning perception systems, this paper proposes using simulation to create bin picking environments in which a procedural generation method builds entangled tubes that can have curvatures throughout their length. The output of the simulation is an annotated point cloud, generated by a virtual 3D depth camera, in which the tubes are assigned with unique colors. A general metric based on micro-recall is proposed to compare the accuracy of point cloud annotations with the ground truth. The synthetic data is representative of a high quality 3D scanner, given that the performance of a tube modeling system when given 640 simulated point clouds was similar to the results achieved with real sensor data. Therefore, simulation is a promising technique for the automated evaluation of solutions for bin picking tasks.

Abstract
The manipulation of deformable objects poses a significant challenge for the automotive industry. In particular, the assembly of flexible cables and wire-harnesses in vehicles is still performed manually as there is yet to be a reliable and general solution for this problem. This paper presents a simple yet efficient motion planning algorithm to mount a flexible wire in an assembly jig, where the wire must traverse a set of forks in order. The algorithm uses a heuristic based on a set of control points to guide the wire’s movement. Various controlled assembly scenarios are built in simulation using MuJoCo, a physics engine that can emulate the dynamics of Deformable Linear Objects (DLO). Experimental results in simulation demonstrated that the amount and orientation of the forks has a large impact in the solution’s performance and highlighted several key ideas and challenges moving forward. Thus, this work serves as a stepping stone towards the development of more complete solutions, capable of assembling flexible items in vehicles. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.