Cookies
O website necessita de alguns cookies e outros recursos semelhantes para funcionar. Caso o permita, o INESC TEC irá utilizar cookies para recolher dados sobre as suas visitas, contribuindo, assim, para estatísticas agregadas que permitem melhorar o nosso serviço. Ver mais
Aceitar Rejeitar
  • Menu
Publicações

Publicações por António Paulo Moreira

2021

Accuracy and Repeatability Tests on HoloLens 2 and HTC Vive

Autores
Soares, I; Sousa, RB; Petry, M; Moreira, AP;

Publicação
MULTIMODAL TECHNOLOGIES AND INTERACTION

Abstract
Augmented and virtual reality have been experiencing rapid growth in recent years, but there is still no deep knowledge regarding their capabilities and in what fields they could be explored. In that sense, this paper presents a study on the accuracy and repeatability of Microsoft's HoloLens 2 (augmented reality device) and HTC Vive (virtual reality device) using an OptiTrack system as ground truth. For the HoloLens 2, the method used was hand tracking, whereas, in HTC Vive, the object tracked was the system's hand controller. A series of tests in different scenarios and situations were performed to explore what could influence the measures. The HTC Vive obtained results in the millimeter range, while the HoloLens 2 revealed not very accurate measurements (around 2 cm). Although the difference can seem to be considerable, the fact that HoloLens 2 was tracking the user's hand and not the system's controller made a huge impact. The results are considered a significant step for the ongoing project of developing a human-robot interface by demonstrating an industrial robot using extended reality, which shows great potential to succeed based on our data.

2021

Smarter Robotic Sprayer System for Precision Agriculture

Autores
Baltazar, AR; dos Santos, FN; Moreira, AP; Valente, A; Cunha, JB;

Publicação
ELECTRONICS

Abstract
The automation of agricultural processes is expected to positively impact the environment by reducing waste and increasing food security, maximising resource use. Precision spraying is a method used to reduce the losses during pesticides application, reducing chemical residues in the soil. In this work, we developed a smart and novel electric sprayer that can be assembled on a robot. The sprayer has a crop perception system that calculates the leaf density based on a support vector machine (SVM) classifier using image histograms (local binary pattern (LBP), vegetation index, average, and hue). This density can then be used as a reference value to feed a controller that determines the air flow, the water rate, and the water density of the sprayer. This perception system was developed and tested with a created dataset available to the scientific community and represents a significant contribution. The results of the leaf density classifier show an accuracy score that varies between 80% and 85%. The conducted tests prove that the solution has the potential to increase the spraying accuracy and precision.

2021

Programming Robots by Demonstration Using Augmented Reality

Autores
Soares, I; Petry, M; Moreira, AP;

Publicação
SENSORS

Abstract
The world is living the fourth industrial revolution, marked by the increasing intelligence and automation of manufacturing systems. Nevertheless, there are types of tasks that are too complex or too expensive to be fully automated, it would be more efficient if the machines were able to work with the human, not only by sharing the same workspace but also as useful collaborators. A possible solution to that problem is on human-robot interaction systems, understanding the applications where they can be helpful to implement and what are the challenges they face. This work proposes the development of an industrial prototype of a human-machine interaction system through Augmented Reality, in which the objective is to enable an industrial operator without any programming experience to program a robot. The system itself is divided into two different parts: the tracking system, which records the operator's hand movement, and the translator system, which writes the program to be sent to the robot that will execute the task. To demonstrate the concept, the user drew geometric figures, and the robot was able to replicate the operator's path recorded.

2021

Human Detector Smart Sensor for Autonomous Disinfection Mobile Robot

Autores
Mendonça, H; Lima, J; Costa, P; Moreira, AP; dos Santos, FN;

Publicação
Optimization, Learning Algorithms and Applications - First International Conference, OL2A 2021, Bragança, Portugal, July 19-21, 2021, Revised Selected Papers

Abstract
The COVID-19 virus outbreak led to the need of developing smart disinfection systems, not only to protect the people that usually frequent public spaces but also to protect those who have to subject themselves to the contaminated areas. In this paper it is developed a human detector smart sensor for autonomous disinfection mobile robot that use Ultra Violet C type light for the disinfection task and stops the disinfection system when a human is detected around the robot in all directions. UVC light is dangerous for humans and thus the need for a human detection system that will protect them by disabling the disinfection process, as soon as a person is detected. This system uses a Raspberry Pi Camera with a Single Shot Detector (SSD) Mobilenet neural network to identify and detect persons. It also has a FLIR 3.5 Thermal camera that measures temperatures that are used to detect humans when within a certain range of temperatures. The normal human skin temperature is the reference value for the range definition. The results show that the fusion of both sensors data improves the system performance, compared to when the sensors are used individually. One of the tests performed proves that the system is able to distinguish a person in a picture from a real person by fusing the thermal camera and the visible light camera data. The detection results validate the proposed system.

2021

Recommendation System using Reinforcement Learning for What-If Simulation in Digital Twin

Autores
Pires, F; Ahmad, B; Moreira, AP; Leitão, P;

Publicação
19th IEEE International Conference on Industrial Informatics, INDIN 2021, Palma de Mallorca, Spain, July 21-23, 2021

Abstract
The research about the digital twin concept is growing worldwide, especially in the industrial sector, due to the increasing digitisation level associated to Industry 4.0. The application of the digital twin concept improves performance of a system by implementing monitoring, diagnosis, optimisation, and decision support actions. In particular, the decision-making process is very time consuming since the decision-maker is presented with hundreds of different scenarios that can be simulated and assessed in a what-if perspective. Bearing this in mind, this paper proposes to integrate a digital twin-based what-if simulation with a recommendation system to improve the decision-making cycle. The recommendation system is based on a reinforcement learning technique and takes user knowledge of the system into consideration and trust in the system recommendation. The applicability of the proposed approach is presented in an assembly line case study for recommending the best configurations for the system operation, in terms of the optimal number of AGVs (Autonomous Guided Vehicles) in various scenarios. The achieved results show its successful application and highlight the benefits of using AI-based recommendation systems for what-if simulation in digital twin systems. © 2021 IEEE.

2021

Robot@Factory Lite Competition: A Digital Twin Approach for the AGV

Autores
Braun, J; Lima, J; Costa, P; Moreira, A;

Publicação
PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON SIMULATION AND MODELING METHODOLOGIES, TECHNOLOGIES AND APPLICATIONS (SIMULTECH)

Abstract
Robotics competitions are environments that foster teamwork, AI, and technology development by encouraging students, researchers, and academics to test their solutions against each other. These competitions often challenge the competitors' prototypes with tasks specifically designed to benchmark them with the current optimal solutions. During the prototype stages of a robot, the development costs and time spent are often higher than other stages, as changes in the prototype are frequent. Simulation is often used to reduce these variables as it allows flexibility in all development stages before transitioning to the real scenario. However, a digital twin can be used to increase even further flexibility and effectiveness. Digital twins are virtual representations of real assets, providing replication and prediction of real scenario events, and real-time monitoring of the real object. Thus, this paper presents the development of a digital twin of an automatic guided vehicle (AGV) to the Robot@Factory Lite competition and the tests performed to validate the approach.

  • 27
  • 44