Today, the most commonly used civil infrastructure inspection method is based on a visual assessment conducted by certified inspectors following prescribed protocols. However, the increase in aggressive environmental and load conditions, coupled with the achievement of many structures of the life-cycle end, has highlighted the need to automate damage identification and satisfy the number of structures that need to be inspected. To overcome this challenge, this paper presents a method for automating concrete damage classification using a deep convolutional neural network. The convolutional neural network was designed after an experimental investigation of a wide number of pretrained networks, applying the transfer-learning technique. Training and validation were conducted using a database built with 1352 images balanced between “undamaged”, “cracked”, and “delaminated” concrete surfaces. To increase the network robustness compared to images in real-world situations, different image configurations have been collected from the Internet and on-field bridge inspections. The GoogLeNet model, with the highest validation accuracy of approximately 94%, was selected as the most suitable network for concrete damage classification. The results confirm that the proposed model can correctly classify images from real concrete surfaces of bridges, tunnels, and pavement, resulting in an effective alternative to the current visual inspection techniques.
C Anitescu, E Atroshchenko, N Alajlan, T Rabczuk. Artificial neural network methods for the solution of second order boundary value problems. Computers, Materials & Continua, 2019, 59(1): 345–359 https://doi.org/10.32604/cmc.2019.06641
2
H Guo, X Zhuang, T Rabczuk. A deep collocation method for the bending analysis of Kirchhoff plate. Computers, Materials & Continua, 2019, 59(2): 433–456 https://doi.org/10.32604/cmc.2019.06660
3
Z Fan, Y Wu, J Lu, W Li. Automatic pavement crack detection based on structured prediction with the convolutional neural network. arXiv preprint arXiv: 1802.02208, 2018
4
L Zhang, F Yang, Y Daniel Zhang, Y J Zhu. Road crack detection using deep convolutional neural network. In: IEEE International Conference on Image Processing 2016. Phoenix, AZ: ICIP, 2016, 3708–3712 https://doi.org/10.1109/ICIP.2016.7533052
5
B Kim, S Cho. Automated vision-based detection of cracks on concrete surfaces using a deep learning technique. Sensors (Basel), 2018, 18(10): 3452–3469 https://doi.org/10.3390/s18103452
6
P Hung, N Su, V Diep. Surface classification of damaged concrete using deep convolutional neural network. Pattern Recognition and Image Analysis, 2019, 29(4): 676–687 https://doi.org/10.1134/S1054661819040047
7
J Zhu, J Song. An intelligent classification model for surface defects on cement concrete bridges. Applied Sciences (Basel, Switzerland), 2020, 10(3): 972–990 https://doi.org/10.3390/app10030972
8
C Feng, H Zhang, S Wang, Y Li, H Wang, F Yan. Structural damage detection using deep convolutional neural network and transfer learning. KSCE Journal of Civil Engineering, 2019, 23(10): 4493–4502 https://doi.org/10.1007/s12205-019-0437-z
9
Q Song, Y Wu, X Xin, L Yang, M Yang, H Chen, C Liu, M Hu, X Chai, J Li. Real-time tunnel crack analysis system via deep learning. IEEE Access: Practical Innovations, Open Solutions, 2019, 7: 64186–64197 https://doi.org/10.1109/ACCESS.2019.2916330
10
K Makantasis, E Protopapadakis, A Doulamis, N Doulamis, C Loupos. Doulamis Nikolaos. Deep convolutional neural networks for efficient vision based tunnel inspection. In: IEEE International Conference on Intelligent Computer Communication and Processing 2015. Cluj-Napoca: Romania ICCP, 2015, 335–342 https://doi.org/10.1109/ICCP.2015.7312681
11
B Patterson, G Leone, M Pantoja, A Behrouzi. Deep learning for automated image classification of seismic damage to built infrastructure. In: Proceedings of the 11th National Conference in Earthquake Engineering 2018. Los Angeles, CA: Earthquake Engineering Research Institute, 2018
12
N S Gulgec, M Takac, S N Pakzad. Structural damage detection using convolutional neural networks. In: Barthorpe R, Platz R, Lopez I, et al., eds. Model Validation and Uncertainty Quantification. Conference Proceedings of the Society for Experimental Mechanics Series. Cham: Springer, 2017, 331–337
13
Y J Cha, W Choi, G Suh, S Mahmoudkhani, O Büyüköztürk. Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types. Computer-Aided Civil and Infrastructure Engineering, 2018, 33(9): 731–747 https://doi.org/10.1111/mice.12334
14
D Soukup, R Huber-Mörk. Convolutional neural networks for steel surface defect detection from photometric stereo images. In: Bebis G, et al., eds. Advances in Visual Computing. ISVC 2014. Lecture Notes in Computer Science. Cham: Springer, 2014, 668–677
15
J Li, Z Su, J Geng, Y Yin. Real-time detection of steel strip surface defects based on improved YOLO detection network. IFAC-PapersOnLine, 2018, 51(21): 76–81 https://doi.org/10.1016/j.ifacol.2018.09.412
16
W Rawat, Z Wang. Deep convolutional neural networks for image classification: A comprehensive review. Neural Computation, 2017, 29(9): 1–98 https://doi.org/10.1162/neco_a_00990
V Nair, G E Hinton. Rectified linear units improve restricted Boltzmann machines. In: Proceedings of the 27th International Conference on Machine Learning 2010. Haifa: Israel ICML-10, 2010, 807–814
19
O Russakovsky, J Deng, H Su, J Krause, S Satheesh, S Ma, Z Huang, A Karpathy, A Khosla, M Bernstein, A C Berg, F L Fei. ImageNet large scale visual recognition challenge. International Journal of Computer Vision, 2015, 115(3): 211–252 https://doi.org/10.1007/s11263-015-0816-y
20
A Krizhevsky, I Sutskever, G E Hinton. ImageNet classification with deep convolutional neural networks. Communications of the ACM, 2017, 60(6): 84–90 https://doi.org/10.1145/3065386
21
F N Iandola, S Han, M W Moskewicz, K Ashraf, W J Dally, K Keutzer. SqueezeNet: AlexNet-level accuracy with 50X fewer parameters and<0.5 MB model size. 2017, arxiv.org/abs/1602.07360
22
X Zhang, X Zhou, M Lin, J Sun. ShuffleNet: An extremely efficient convolutional neural network for mobile devices. In: Conference on Computer Vision and Pattern Recognition 2018. Salt Lake City: USA IEEE/CVF, 2018, 6848–6856 https://doi.org/10.1109/CVPR.2018.00716
23
K He, X Zhang, S Ren, J Sun. Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2016. Las Vegas, 2016, 770–778. https://doi.org/10.1109/CVPR.2016.90
24
C Szegedy, W Liu, Y Jia, P Sermanet, S Reed, D Anguelov, D Erhan, V Vanhoucke, A Rabinovich. Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Boston: USA IEEE, 2015, 1–9 https://doi.org/10.1109/CVPR.2015.7298594
25
M Sandler, A Howard, M Zhu, A Zhmoginov, L C Chen. MobileNetV2: Inverted residuals and linear bottlenecks. In: Conference on Computer Vision and Pattern Recognition 2018. Salt Lake City: USA IEEE/CVF, 2018, 4510–4520
26
A G Howard, M Zhu, B Chen, D Kalenichenko, W Wang, T Weyand, M Andreetto, H Adam. MobileNets: Efficient convolutional neural networks for mobile vision applications. 2017, arXiv:1704.04861
27
B Zoph, V Vasudevan, J Shlens, Q V Le. Learning transferable architectures for scalable image recognition. In: Conference on Computer Vision and Pattern Recognition 2018. Salt Lake City: USA IEEE/CVF, 2018, 8697–8710 https://doi.org/10.1109/CVPR.2018.00907
