Cookies Policy
The website need some cookies and similar means to function. If you permit us, we will use those means to collect data on your visits for aggregated statistics to improve our service. Find out More
Accept Reject
  • Menu
Publications

Publications by António Paulo Moreira

2024

A Multi-User Multi-Robot Collaboration through Augmented Reality

Authors
Martins, JG; Costa, GM; Petry, MR; Costa, P; Moreira, AP;

Publication
2024 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS, ICARSC

Abstract
Current industrial environments have multiple robots working alongside humans, thus providing an operator the ability to perceive the robot's workspace correctly and to anticipate its intentions and movements through the visualization of the robot's digital twin is of utmost importance for safe and productive human-robot collaboration scenarios. Much has been studied regarding single human-single robot collaborative scenarios, but few address multi-user multi-robot scenarios. To this end, this paper presents a multi-robot multi-operator architecture, where the users' awareness is enhanced through an augmented reality head-mounted display. A multi-robot, multi-user collaborative scenario is presented in a laboratory environment with two industrial robots. Besides being able to interact with both robots in the system, each user becomes more aware of the robot's workspace and its pre-defined trajectories. Furthermore, it presents how fiducial markers can help to establish the relation between the different coordinate frames.

2024

MonoVisual3DFilter: 3D tomatoes' localisation with monocular cameras using histogram filters

Authors
Magalhaes, SAC; dos Santos, FN; Moreira, AP; Dias, JMM;

Publication
ROBOTICA

Abstract
Performing tasks in agriculture, such as fruit monitoring or harvesting, requires perceiving the objects' spatial position. RGB-D cameras are limited under open-field environments due to lightning interferences. So, in this study, we state to answer the research question: How can we use and control monocular sensors to perceive objects' position in the 3D task space? Towards this aim, we approached histogram filters (Bayesian discrete filters) to estimate the position of tomatoes in the tomato plant through the algorithm MonoVisual3DFilter. Two kernel filters were studied: the square kernel and the Gaussian kernel. The implemented algorithm was essayed in simulation, with and without Gaussian noise and random noise, and in a testbed at laboratory conditions. The algorithm reported a mean absolute error lower than 10 mm in simulation and 20 mm in the testbed at laboratory conditions with an assessing distance of about 0.5 m. So, the results are viable for real environments and should be improved at closer distances.

2024

UAV Visual and Thermographic Power Line Detection Using Deep Learning

Authors
Santos, T; Cunha, T; Dias, A; Moreira, AP; Almeida, J;

Publication
SENSORS

Abstract
Inspecting and maintaining power lines is essential for ensuring the safety, reliability, and efficiency of electrical infrastructure. This process involves regular assessment to identify hazards such as damaged wires, corrosion, or vegetation encroachment, followed by timely maintenance to prevent accidents and power outages. By conducting routine inspections and maintenance, utilities can comply with regulations, enhance operational efficiency, and extend the lifespan of power lines and equipment. Unmanned Aerial Vehicles (UAVs) can play a relevant role in this process by increasing efficiency through rapid coverage of large areas and access to difficult-to-reach locations, enhanced safety by minimizing risks to personnel in hazardous environments, and cost-effectiveness compared to traditional methods. UAVs equipped with sensors such as visual and thermographic cameras enable the accurate collection of high-resolution data, facilitating early detection of defects and other potential issues. To ensure the safety of the autonomous inspection process, UAVs must be capable of performing onboard processing, particularly for detection of power lines and obstacles. In this paper, we address the development of a deep learning approach with YOLOv8 for power line detection based on visual and thermographic images. The developed solution was validated with a UAV during a power line inspection mission, obtaining mAP@0.5 results of over 90.5% on visible images and over 96.9% on thermographic images.

2024

Positioning Cyber-Physical Systems and Digital Twins in Industry 4.0

Authors
Pires, F; Melo, V; Queiroz, J; Moreira, AP; de la Prieta, F; Estévez, E; Leitao, P;

Publication
2024 IEEE 7TH INTERNATIONAL CONFERENCE ON INDUSTRIAL CYBER-PHYSICAL SYSTEMS, ICPS 2024

Abstract
Industry 4.0 has brought innovative concepts and technologies that have greatly improved the development of more intelligent, flexible and reconfigurable systems. Two of these concepts, Cyber-Physical Systems (CPSs) and Digital Twins (DTs), have gained significant attention from various stakeholders, e.g., researchers, industry practitioners, and governmental organizations. Both are vital to support the digitalisation of products, machines, and systems, and they focus on the integration of physical and cyber processes, where one affects the other through feedback loops. Having this in mind, this paper aims to better understand how CPS and DT are correlated, particularly exploring their similarities and differences, their positioning within the Industry 4.0 paradigm, and their convergence to develop Industry 4.0 solutions. Some research challenges to develop Industry 4.0 solutions by integrating these concepts are also discussed.

  • 44
  • 44