3-Dimensional Residual Neural Architecture Search for Ultrasonic Defect Detection.

This study presents a deep learning methodology using 3-dimensional (3D) convolutional neural networks to detect defects in carbon fiber reinforced polymer composites through volumetric ultrasonic testing data. Acquiring large amounts of ultrasonic training data experimentally is expensive and time-consuming. To address this issue, a synthetic data generation method was extended to incorporate volumetric data. By preserving the complete volumetric data, complex preprocessing is reduced, and the model can utilize spatial and temporal information that is lost during imaging. This enables the model to utilize important features that might be overlooked otherwise. The performance of three architectures were compared. The first architecture is prevalent in the literature for the classification of volumetric datasets. The second demonstrated a hand-designed approach to architecture design, with modifications to the first architecture to address the challenges of this specific task. A key modification was the use of cuboidal kernels to account for the large aspect ratios seen in ultrasonic data. The third architecture was discovered through neural architecture search from a modified 3D Residual Neural Network (ResNet) search space. Additionally, domain-specific augmentation methods were incorporated during training, resulting in significant improvements in model performance, with a mean accuracy improvement of 22.4% on the discovered architecture. The discovered architecture demonstrated the best performance with a mean accuracy increase of 7.9% over the second best model. It was able to consistently detect all defects whilst maintaining a model size smaller than most 2-dimensional (2D) ResNets. Each model had an inference time of less than 0.5 seconds, making them efficient for the interpretation of large amounts of data.