2019
Authors
Pacher, R; Petry, MR;
Publication
19th IEEE International Conference on Autonomous Robot Systems and Competitions, ICARSC 2019
Abstract
Optical character recognition (OCR) is the process by which the textual content of an image is converted into strings. Localization is the problem of figuring out where one is in a given environment. In this work we approach the application of OCR in robot localization. We develop and test a vision based localization system that is capable of detecting room identification signs present in the environment, recognizing their textual contents and apply them to determine its location referent to a topological map of the environment. A sign detection method based on image segmentation by color and corner detection by contour analysis is developed. The recognition of characters is performed with the application of an open-source OCR engine. Localization is performed through the comparison of sign readings with the textual information embedded in the topological representation of the environment. The algorithm was tested in a dataset of images acquired in a corridor. Experimental results show that the system successfully determines its localization in 83.33% of tested cases. © 2019 IEEE.
2019
Authors
Nunes Masson, JE; Petry, MR;
Publication
19th IEEE International Conference on Autonomous Robot Systems and Competitions, ICARSC 2019
Abstract
The photogrammetry, 3D reconstruction from images, is an old technique but it's potentials could only be seen after the development of computers and digital photographs. Nowadays it has many applications, as creating scenarios for games, acquiring human expressions, roof inspection, stockpile measurement, high voltage transformer inspection, etc. As new technologies appear, new applications to photogrammetry are created. In this paper the use of available open and closed-source algorithms for 3D reconstruction and texturization is investigated. To achieve this goal, images of a fountain from several points-of-view were used. Next a comparison between several open and closed-source algorithms was performed, evaluating the number of faces, time consumption, RAM memory, GPU memory and the generated textured 3D models. The results obtained demonstrate that with the right setup, current open-source algorithms can achieve results near or better than proprietary software. Regarding the comparison, 3Dflow and MeshRecon presented the most accurate textured 3D models. When comparing quantitative measures, though, MeshRecon presented a slightly better performance in time consumption, but 3Dflow had a better RAM memory usage and a lower quantity of faces with a similar level of details. © 2019 IEEE.
2020
Authors
Baltazar, A; Petry, MR; Silva, MF; Moreira, AP;
Publication
2020 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC 2020)
Abstract
The transport of patients from the inpatient service to the operating room is a recurrent task in the hospital routine. This task is repetitive, non-ergonomic, time consuming, and requires the labor of patient transporters. In this paper is presented the design of a driverless wheelchair under development capable of providing an on-demand mobility service to hospitals. The proposed wheelchair can receive transportation requests directly from the hospital information management system, pick-up patients at their beds, navigate autonomously through different floors, avoid obstacles, communicate with elevators, and drop patients off at the designated destination.
2020
Authors
Sousa, RB; Petry, MR; Moreira, AP;
Publication
2020 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC 2020)
Abstract
Localisation is a critical problem in ground mobile robots. For dead reckoning, odometry is usually used. A disadvantage of using it alone is unbounded error accumulation. So, odometry calibration is critical in reducing error propagation. This paper presents an analysis of the developments and advances of systematic methods for odometry calibration. Four steering geometries were analysed, namely differential drive, Ackerman, tricycle and omnidirectional. It highlights the advances made on this field and covers the methods since UMBmark was proposed. The points of analysis are the techniques and test paths used, errors considered in calibration, and experiments made to validate each method. It was obtained fifteen methods for differential drive, three for Ackerman, two for tricycle, and three for the omnidirectional steering geometry. A disparity was noted, compared with the real utilisation, between the number of published works addressing differential drive and tricycle/Ackerman. Still, odometry continues evolving since UMBmark was proposed.
2020
Authors
Santos, LC; Aguiar, AS; Santos, FN; Valente, A; Petry, M;
Publication
ROBOTICS
Abstract
Robotics will significantly impact large sectors of the economy with relatively low productivity, such as Agri-Food production. Deploying agricultural robots on the farm is still a challenging task. When it comes to localising the robot, there is a need for a preliminary map, which is obtained from a first robot visit to the farm. Mapping is a semi-autonomous task that requires a human operator to drive the robot throughout the environment using a control pad. Visual and geometric features are used by Simultaneous Localisation and Mapping (SLAM) Algorithms to model and recognise places, and track the robot's motion. In agricultural fields, this represents a time-consuming operation. This work proposes a novel solution-called AgRoBPP-bridge-to autonomously extract Occupancy Grid and Topological maps from satellites images. These preliminary maps are used by the robot in its first visit, reducing the need of human intervention and making the path planning algorithms more efficient. AgRoBPP-bridge consists of two stages: vineyards row detection and topological map extraction. For vineyards row detection, we explored two approaches, one that is based on conventional machine learning technique, by considering Support Vector Machine with Local Binary Pattern-based features, and another one found in deep learning techniques (ResNET and DenseNET). From the vineyards row detection, we extracted an occupation grid map and, by considering advanced image processing techniques and Voronoi diagrams concept, we obtained a topological map. Our results demonstrated an overall accuracy higher than 85% for detecting vineyards and free paths for robot navigation. The Support Vector Machine (SVM)-based approach demonstrated the best performance in terms of precision and computational resources consumption. AgRoBPP-bridge shows to be a relevant contribution to simplify the deployment of robots in agriculture.
2020
Authors
Aschenbrenner, D; Rieder, JSI; van Tol, D; van Dam, J; Rusak, Z; Blech, JO; Azangoo, M; Panu, S; Kruusamae, K; Masnavi, H; Rybalskii, I; Aabloo, A; Petry, M; Teixeira, G; Thiede, B; Pedrazzoli, P; Ferrario, A; Foletti, M; Confalonieri, M; Bertaggia, D; Togias, T; Makris, S;
Publication
2020 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR 2020)
Abstract
How to visualize recorded production data in Virtual Reality? How to use state of the art Augmented Reality displays that can show robot data? This paper introduces an open-source ICT framework approach for combining Unity-based Mixed Reality applications with robotic production equipment using ROS Industrial. This publication gives details on the implementation and demonstrates the use as a data analysis tool in the context of scientific exchange within the area of Mixed Reality enabled human-robot co-production.
The access to the final selection minute is only available to applicants.
Please check the confirmation e-mail of your application to obtain the access code.