Rui Pedro Nascimento

Abstract
The growing demand for high-quality components in various industries, particularly in the automotive sector, requires advanced and reliable inspection methods to maintain competitive standards and support innovation. Manual quality inspection tasks are often inefficient and prone to errors due to their repetitive nature and subjectivity, which can lead to attention lapses and operator fatigue. The inspection of reflective aluminum parts presents additional challenges, as uncontrolled reflections and glare can obscure defects and reduce the reliability of conventional vision-based methods. Addressing these challenges requires optimized illumination strategies and robust image processing techniques to enhance defect visibility. This work presents the development of an automated optical inspection system for reflective parts, focusing on components made of high-pressure diecast aluminum used in the automotive industry. The reflective nature of these parts introduces challenges for defect detection, requiring optimized illumination and imaging methods. The system applies deep learning algorithms and uses dome light to achieve uniform illumination, enabling the detection of small defects on reflective surfaces. A collaborative robotic manipulator equipped with a gripper handles the parts during inspection, ensuring precise positioning and repeatability, which improves both the efficiency and effectiveness of the inspection process. A flow execution-based software platform integrates all system components, enabling seamless operation. The system was evaluated with Schmidt Light Metal Group using three custom datasets to detect surface porosities and inner wall defects post-machining. For surface porosity detection, YOLOv8-Mosaic, trained with cropped images to reduce background noise, achieved a recall value of 84.71% and was selected for implementation. Additionally, an endoscopic camera was used in a preliminary study to detect defects within the inner walls of holes. The industrial trials produced promising results, demonstrating the feasibility of implementing a vision-based automated inspection system in various industries. The system improves inspection accuracy and efficiency while reducing material waste and operator fatigue.

Abstract
Reliable operation of production lines without unscheduled disruptions is of paramount importance for ensuring the proper operation of automated working cells involving robotic systems. This article addresses the issue of preventing disruptions to an automotive production line that can arise from incorrect placement of aluminum car parts by a human operator in a feeding container with 4 indexing pins for each part. The detection of the misplaced parts is critical for avoiding collisions between the containers and a high pressure washing machine and also to avoid collisions between the parts and a robotic arm that is feeding parts to a air leakage inspection machine. The proposed inspection system relies on a 3D sensor for scanning the parts inside a container and then estimates the 6 DoF pose of the container followed by an analysis of the overlap percentage between each part reference point cloud and the 3D sensor data. When the overlap percentage is below a given threshold, the part is considered as misplaced and the operator is alerted to fix the part placement in the container. The deployment of the inspection system on an automotive production line for 22 weeks has shown promising results by avoiding 18 hours of disruptions, since it detected 407 containers having misplaced parts in 4524 inspections, from which 12 were false negatives, while no false positives were reported, which allowed the elimination of disruptions to the production line at the cost of manual reinspection of 0.27% of false negative containers by the operator.

Abstract
Quality control inspection systems are crucial and a key factor in maintaining and ensuring the integrity of any product. The quality inspection task is a repetitive task, when performed by operators only, it can be slow and susceptible to failures due to the lack of attention and fatigue. This work focuses on the inspection of parts made of high-pressure diecast aluminum for components of the automotive industry. In the present case study, last year, 18240 parts needed to be reinspected, requiring approximately 96 hours, a time that could be spent on other tasks. This article performs a comparison of four deep learning models: Faster R-CNN, RetinaNet, YOLOv7, and YOLOv7-tiny, to find out which one is more suited to perform the quality inspection task of detecting metal filings on casting aluminum parts. As for this use-case the prototype must be highly intolerant to False Negatives, that is, the part being defective and passing undetected, Faster R-CNN was considered the bestperforming model based on a Recall value of 96.00%.

Abstract
This work presents a novel methodology for the quality assessment of material extrusion parts through AI-based Computer Vision. To this end, different techniques are integrated using inspection methods that are applied to other areas in additive manufacturing field. The system is divided into four main points: (1) pre-processing, (2) color analysis, (3) shape analysis, and (4) defect location. The color analysis is performed in CIELAB color space, and the color distance between the part under analysis and the reference surface is calculated using the color difference formula CIE2000. The shape analysis consists of the binarization of the image using the Canny edge detector. Then, the Hu moments are calculated for images from the part under analysis and the results are compared with those from the reference part. To locate defects, the image of the part to be analyzed is first processed with a median filter, and both the original and filtered image are subtracted. Then, the resulting image is binarized, and the defects are located through a blob detector. In the training phase, a subset of parts was used to evaluate the performance of different methods and to set the values of parameters. Later, in a testing and validation phase, the performance of the system was evaluated using a different set of parts. The results show that the proposed system is able to classify parts produced by additive manufacturing, with an overall accuracy of 86.5%, and to locate defects on their surfaces in a more effective manner.