Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Publicações

Publicações por João Braun

2024

Design and Development of an Omnidirectional Mecanum Platform for the RobotAtFactory 4.0 Competition

Autores
Braun, J; Baidi, K; Bonzatto, L; Berger, G; Pinto, M; Kalbermatter, RB; Klein, L; Grilo, V; Pereira, AI; Costa, P; Lima, J;

Publicação
SYNERGETIC COOPERATION BETWEEN ROBOTS AND HUMANS, VOL 1, CLAWAR 2023

Abstract
Robotics competitions are highly strategic tools to engage and motivate students, cultivating their curiosity and enthusiasm for technology and robotics. These competitions encompass various disciplines, such as programming, electronics, control systems, and prototyping, often beginning with developing a mobile platform. This paper focuses on designing and implementing an omnidirectional mecanum platform, encompassing aspects of mechatronics, mechanics, electronics, kinematics models, and control. Additionally, a simulation model is introduced and compared with the physical robot, providing a means to validate the proposed platform.

2024

Advance Reconnaissance of UGV Path Planning Using Unmanned Aerial Vehicle to Carry Our Mission in Unknown Environment

Autores
Nowakowski, M; Berger, GS; Braun, J; Mendes, JA; Bonzatto, L Jr; Lima, J;

Publicação
ROBOT 2023: SIXTH IBERIAN ROBOTICS CONFERENCE, VOL 2

Abstract
The utilization of unmanned vehicles for specialized tasks has gained significant attention in both military and civilian domains. This article explores the application of commercial unmanned aerial vehicles (UAVs) for reconnaissance purposes, specifically to verify autonomous driving missions assigned to the developed TAERO manned-unmanned vehicle in field operations. The paper introduces the TAERO vehicle, highlighting its functionality and capabilities for unmanned missions. The architecture of the unmanned ground vehicle (UGV) system is discussed taking into consideration the autonomy subsystem and used location data. The limitations associated with terrain and potential obstacles are addressed as well as importance of acquiring accurate terrain information for successful autonomous operation. The solution proposed in our study involves the use of a commercially available UAV applied to the visual tracking of potential targets in an engagement scenario. Details related to flight route planning system, geolocation, target tracking, and data transmission between robotic platforms are discussed and presented in this work. The acquired real-time data plays a crucial role in confirm- ing the mission, making necessary adjustments, or altering the planned route. The UAV platform, known for its maneuverability and operational capabilities, can operate ahead as a reconnaissance element, improving the overall reconnaissance capabilities of the system. Upon completion of the mission, the UAV can return to the base or land on a moving vehicle platform. The authors proposed integration of a UAV that significantly enhances the autonomous mode capabilities of unmanned ground platform, improving operation in unknown environment during special mission.

2024

Development of a Low-Cost 3D Mapping Technology with 2D LIDAR for Path Planning Based on the A* Algorithm

Autores
Ferreira, E; Grilo, V; Braun, J; Santos, M; Pereira, AI; Costa, P; Lima, J;

Publicação
ROBOT 2023: SIXTH IBERIAN ROBOTICS CONFERENCE ADVANCES IN ROBOTICS, VOL 1

Abstract
This article presents the development of a low-cost 3D mapping technology for trajectory planning using a 2D LiDAR and a stepper motor. The research covers the design and implementation of a circuit board to connect and control all components, including the LiDAR and motor. In addition, a 3D printed support structure was developed to connect the LiDAR to the motor shaft. System data acquisition and processing are addressed, as well as the generation of the point cloud and the application of the A* algorithm for trajectory planning. Experimental results demonstrate the effectiveness and feasibility of the proposed technology for low-cost 3D mapping and trajectory planning applications.

2024

Using LiDAR Data as Image for AI to Recognize Objects in the Mobile Robot Operational Environment

Autores
Nowakowski, M; Kurylo, J; Braun, J; Berger, GS; Mendes, J; Lima, J;

Publicação
OPTIMIZATION, LEARNING ALGORITHMS AND APPLICATIONS, PT II, OL2A 2023

Abstract
Nowadays, there has been a growing interest in the use of mobile robots for various applications, where the analysis of the operational environment is a crucial component to conduct our special tasks or missions. The main aim of this work was to implement artificial intelligence (AI) for object detection and distance estimation navigating the developed unmanned platform in unknown environments. Conventional approaches are based on vision systems analysis using neural networks for object detection, classification, and distance estimation. Unfortunately, in the case of precise operation, the used algorithms do not provide accurate data required by platforms operators as well as autonomy subsystems. To overcome this limitation, the authors propose a novel approach using the spatial data from laser scanners supplementing the acquisition of precise information about the detected object distance in the operational environment. In this article, we introduced the application of pretrained neural network models, typically used for vision systems, in analysing flat distributions of LiDAR point cloud surfaces. To achieve our goal, we have developed software that fuses detection algorithm (based on YOLO network) to detect objects and estimate their distances using the MiDaS depth model. Initially, the accuracy of distance estimation was evaluated through video stream testing in various scenarios. Furthermore, we have incorporated data from a laser scanner into the software, enabling precise distance measurements of the detected objects. The paper provides discussion on conducted experiments, obtained results, and implementation to improve performance of the described modular mobile platform.

2024

Kabsch Marker Estimation Algorithm-A Multi-Robot Marker-Based Localization Algorithm Within the Industry 4.0 Context

Autores
Braun, J; Lima, J; Pereira, AI; Costa, P;

Publicação
IEEE ACCESS

Abstract
This paper introduces the Kabsch Marker Estimation Algorithm (KMEA), a new, robust multi-marker localization method designed for Autonomous Mobile Robots (AMRs) within Industry 4.0 (I4.0) settings. By integrating the Kabsch Algorithm, our approach significantly enhances localization robustness by aligning detected fiducial markers with their known positions. Unlike conventional methods that rely on a limited subset of visible markers, the KMEA uses all available markers, without requiring the camera's extrinsic parameters, thereby improving robustness. The algorithm was validated in an I4.0 automated warehouse mockup, with a four-stage methodology compared to a previously established marker estimation algorithm for reference. On the one hand, the results have demonstrated the KMEA's similar performance in standard controlled scenarios, with millimetric precision across a set of error metrics and a mean relative error (MRE) of less than 1%. On the other hand, KMEA, when faced with challenging test scenarios with outliers, showed significantly superior performance compared to the baseline algorithm, where it maintained a millimetric to centimetric scale in error metrics, whereas the other suffered extreme degradation. This was emphasized by the average reduced results of error metrics from 86.9% to 92% in Parts III and IV of the test methodology, respectively. These results were achieved using low-cost hardware, indicating the possibility of even greater accuracy with advanced equipment. The paper details the algorithm's development, theoretical framework, comparative advantages over existing methods, discusses the test results, and concludes with comments regarding its potential for industrial and commercial applications by its scalability and reliability.

2024

Deep Learning-Based Localization Approach for Autonomous Robots in the RobotAtFactory 4.0 Competition

Autores
Klein, LC; Mendes, J; Braun, J; Martins, FN; de Oliveira, AS; Costa, P; Wörtche, H; Lima, J;

Publicação
OPTIMIZATION, LEARNING ALGORITHMS AND APPLICATIONS, PT II, OL2A 2023

Abstract
Accurate localization in autonomous robots enables effective decision-making within their operating environment. Various methods have been developed to address this challenge, encompassing traditional techniques, fiducial marker utilization, and machine learning approaches. This work proposes a deep-learning solution employing Convolutional Neural Networks (CNN) to tackle the localization problem, specifically in the context of the RobotAtFactory 4.0 competition. The proposed approach leverages transfer learning from the pre-trained VGG16 model to capitalize on its existing knowledge. To validate the effectiveness of the approach, a simulated scenario was employed. The experimental results demonstrated an error within the millimeter scale and rapid response times in milliseconds. Notably, the presented approach offers several advantages, including a consistent model size regardless of the number of training images utilized and the elimination of the need to know the absolute positions of the fiducial markers.

  • 4
  • 4