1. School of Civil Engineering, Central South University, Changsha 410000, China 2. National Engineering Research Center of Highway Maintenance Technology, Changsha University of Science & Technology, Changsha 410000, China 3. School of Traffic and Transportation Engineering, Changsha University of Science & Technology, Changsha 410000, China
An algorithm based on deep semantic segmentation called LC-DeepLab is proposed for detecting the trends and geometries of cracks on tunnel linings at the pixel level. The proposed method addresses the low accuracy of tunnel crack segmentation and the slow detection speed of conventional models in complex backgrounds. The novel algorithm is based on the DeepLabv3+ network framework. A lighter backbone network was used for feature extraction. Next, an efficient shallow feature fusion module that extracts crack features across pixels is designed to improve the edges of crack segmentation. Finally, an efficient attention module that significantly improves the anti-interference ability of the model in complex backgrounds is validated. Four classic semantic segmentation algorithms (fully convolutional network, pyramid scene parsing network, U-Net, and DeepLabv3+) are selected for comparative analysis to verify the effectiveness of the proposed algorithm. The experimental results show that LC-DeepLab can accurately segment and highlight cracks from tunnel linings in complex backgrounds, and the accuracy (mean intersection over union) is 78.26%. The LC-DeepLab can achieve a real-time segmentation of 416 × 416 × 3 defect images with 46.98 f/s and 21.85 Mb parameters.
. [J]. Frontiers of Structural and Civil Engineering, 2023, 17(5): 732-744.
Zhong ZHOU, Yidi ZHENG, Junjie ZHANG, Hao YANG. Fast detection algorithm for cracks on tunnel linings based on deep semantic segmentation. Front. Struct. Civ. Eng., 2023, 17(5): 732-744.
J Zhang, L Dai, J Zheng, H Wu. Reflective crack propagation and control in asphalt pavement widening. Journal of Testing and Evaluation, 2016, 44(2): 838–846 https://doi.org/10.1520/JTE20150220
2
Z Zhou, H Ding, L Miao, C Gong. Predictive model for the surface settlement caused by the excavation of twin tunnels. Tunnelling and Underground Space Technology, 2021, 114: 104014 https://doi.org/10.1016/j.tust.2021.104014
3
L Zeng, L Y Xiao, J H Zhang, Q F Gao. Effect of the characteristics of surface cracks on the transient saturated zones in colluvial soil slopes during rainfall. Bulletin of Engineering Geology and the Environment, 2020, 79(2): 699–709 https://doi.org/10.1007/s10064-019-01584-1
4
B Chiaia, G Marasco, S Aiello. Deep convolutional neural network for multi-level non-invasive tunnel lining assessment. Frontiers of Structural and Civil Engineering, 2022, 16(2): 214–223 https://doi.org/10.1007/s11709-021-0800-2
5
N Zhang, X Zhu, Y Ren. Analysis and study on crack characteristics of highway tunnel lining. Civil Engineering Journal, 2019, 5(5): 1119–1123 https://doi.org/10.28991/cej-2019-03091316
6
P Savino, F Tondolo. Automated classification of civil structure defects based on convolutional neural network. Frontiers of Structural and Civil Engineering, 2021, 15(2): 305–317 https://doi.org/10.1007/s11709-021-0725-9
7
A Arena, C Delle Piane, J Sarout. A new computational approach to cracks quantification from 2D image analysis: Application to micro-cracks description in rocks. Computers & Geosciences, 2014, 66: 106–120 https://doi.org/10.1016/j.cageo.2014.01.007
8
S D FallsR P Young. Acoustic emission and ultrasonic-velocity methods used to characterise the excavation disturbance associated with deep tunnels in hard rock. Tectonophysics, 1998, 289(1–3): 1–15
9
C H Lee, Y C Chiu, T T Wang, T H Huang. Application and validation of simple image-mosaic technology for interpreting cracks on tunnel lining. Tunnelling and Underground Space Technology, 2013, 34: 61–72 https://doi.org/10.1016/j.tust.2012.11.002
10
K Schabowicz. Ultrasonic tomography—The latest nondestructive technique for testing concrete members—Description, test methodology, application example. Archives of Civil and Mechanical Engineering, 2014, 14(2): 295–303 https://doi.org/10.1016/j.acme.2013.10.006
11
L M Dang, H Wang, Y Li, Y Park, C Oh, T N Nguyen, H Moon. Automatic tunnel lining crack evaluation and measurement using deep learning. Tunnelling and Underground Space Technology, 2022, 124: 104472 https://doi.org/10.1016/j.tust.2022.104472
12
M Kamaliardakani, L Sun, M K Ardakani. Sealed-crack detection algorithm using heuristic thresholding approach. Journal of Computing in Civil Engineering, 2016, 30(1): 04014110 https://doi.org/10.1061/(ASCE)CP.1943-5487.0000447
13
G Wang, W T Peter, M Yuan. Automatic internal crack detection from a sequence of infrared images with a triple-threshold Canny edge detector. Measurement Science & Technology, 2018, 29(2): 025403 https://doi.org/10.1088/1361-6501/aa9857
14
S Dorafshan, R J Thomas, M Maguire. Comparison of deep convolutional neural networks and edge detectors for image-based crack detection in concrete. Construction & Building Materials, 2018, 186: 1031–1045 https://doi.org/10.1016/j.conbuildmat.2018.08.011
15
H Huang, Q Li, D Zhang. Deep learning based image recognition for crack and leakage defects of metro shield tunnel. Tunnelling and Underground Space Technology, 2018, 77: 166–176 https://doi.org/10.1016/j.tust.2018.04.002
16
X Wu, J Li, L Wang. Efficient identification of water conveyance tunnels siltation based on ensemble deep learning. Frontiers of Structural and Civil Engineering, 2022, 16(5): 564–575 https://doi.org/10.1007/s11709-022-0829-x
17
L Zhang, F Yang, Y D Zhang, Y J Zhu. Road crack detection using deep convolutional neural network. In: Proceedings of 2016 IEEE International Conference on Image Processing (ICIP). Phoenix, AZ: IEEE, 2016, 3708–3712
18
Y J Cha, W Choi, O Büyüköztürk. Deep learning-based crack damage detection using convolutional neural networks. Computer-Aided Civil and Infrastructure Engineering, 2017, 32(5): 361–378 https://doi.org/10.1111/mice.12263
19
D Kang, Y J Cha. Autonomous UAVs for structural health monitoring using deep learning and an ultrasonic beacon system with geo-tagging. Computer-Aided Civil and Infrastructure Engineering, 2018, 33(10): 885–902 https://doi.org/10.1111/mice.12375
20
G H Beckman, D Polyzois, Y J Cha. Deep learning-based automatic volumetric damage quantification using depth camera. Automation in Construction, 2019, 99: 114–124 https://doi.org/10.1016/j.autcon.2018.12.006
21
Z Zhou, J Zhang, C Gong. Automatic detection method of tunnel lining multi-defects via an enhanced You Only Look Once network. Computer-Aided Civil and Infrastructure Engineering, 2022, 37(6): 762–780 https://doi.org/10.1111/mice.12836
22
J Redmon, S Divvala, R Girshick, A Farhadi. You only look once: Unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV: IEEE, 2016, 779–788
23
A BochkovskiyC Y WangH Y M Liao. Yolov4: Optimal speed and accuracy of object detection. 2020, arXiv: 2004.10934
24
S Ren, K He, R Girshick, J Sun. Faster R-CNN: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems. New York, NY: Curran Associates, 2015, 28
25
W Liu, D Anguelov, D Erhan. SSD: Single shot multibox detector. In: European Conference on Computer Vision. Amsterdam: Springer, 2016, 21–37
26
J Long, E Shelhamer, T Darrell. Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Boston, MA: IEEE, 2015, 3431–3440
27
W Choi, Y J Cha. SDDNet: Real-time crack segmentation. IEEE Transactions on Industrial Electronics, 2019, 67(9): 8016–8025 https://doi.org/10.1109/TIE.2019.2945265
28
D Kang, S S Benipal, D L Gopal, Y J Cha. Hybrid pixel-level concrete crack segmentation and quantification across complex backgrounds using deep learning. Automation in Construction, 2020, 118: 103291 https://doi.org/10.1016/j.autcon.2020.103291
29
Z Liu, Y Cao, Y Wang, W Wang. Computer vision-based concrete crack detection using U-Net fully convolutional networks. Automation in Construction, 2019, 104: 129–139 https://doi.org/10.1016/j.autcon.2019.04.005
30
O Ronneberger, P Fischer, T Brox. U-Net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Munich: Springer, 2015, 234–241
31
A Ji, X Xue, Y Wang, X Luo, W Xue. An integrated approach to automatic pixel-level crack detection and quantification of asphalt pavement. Automation in Construction, 2020, 114: 103176 https://doi.org/10.1016/j.autcon.2020.103176
32
L C Chen, Y Zhu, G Papandreou, F Schroff, H Adam. Encoder−decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European Conference on Computer Vision (ECCV). Munich, Germany: Springer, 2018, 801–818
33
H Zhou. Automatic identification of tunnel leakage based on deep semantic segmentation. Chinese Journal of Rock Mechanics and Engineering, 2022, 41(10): 2082–2093 https://doi.org/10.13722/j.cnki.jrme.2022.0016
34
R Ali, Y J Cha. Attention-based generative adversarial network with internal damage segmentation using thermography. Automation in Construction, 2022, 141: 104412 https://doi.org/10.1016/j.autcon.2022.104412
35
A Howard, M Sandler, G Chu, L C Chen, B Chen, M Tan, W Wang, Y Zhu, R Pang, V Vasudevan, Q V Le. Searching for MobileNetV3. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. Seoul: IEEE, 2019, 1314–1324
36
J Hu, L Shen, G Sun. Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City, UT: IEEE, 2018, 7132–7141
37
Q L WangB G WuP F ZhuP LiW ZuoQ Hu. ECA-Net: efficient channel attention for deep convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Seattle, WA: IEEE, 2020
38
D H Kang, Y J Cha. Efficient attention-based deep encoder and decoder for automatic crack segmentation. Structural Health Monitoring, 2022, 21(5): 2190–2205 https://doi.org/10.1177/14759217211053776
39
K He, X Zhang, S Ren, J Sun. Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(9): 1904–1916 https://doi.org/10.1109/TPAMI.2015.2389824
40
F Chollet. Xception: Deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI: IEEE, 2017, 1251–1258
41
L C ChenG PapandreouF SchroffH Adam. Rethinking atrous convolution for semantic image segmentation. arXiv:1706.05587
42
C Farabet, C Couprie, L Najman, Y LeCun. Learning hierarchical features for scene labeling. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 35(8): 1915–1929 https://doi.org/10.1109/TPAMI.2012.231
43
Y J Cha, W Choi, G Suh, S Mahmoudkhani, O Büyüköztürk. Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types. Computer-Aided Civil and Infrastructure Engineering, 2018, 33(9): 731–747 https://doi.org/10.1111/mice.12334
44
P LiashchynskyiP Liashchynskyi. Grid search, random search, genetic algorithm: A big comparison for NAS. arXiv preprint arXiv:1912.06059
45
F Milletari, N Navab, S A Ahmadi. V-Net: Fully convolutional neural networks for volumetric medical image segmentation. In: Proceedings of 2016 Fourth International Conference on 3D Vision (3DV). Stanford, CA: IEEE, 2016, 565–571
46
Y Ren, J Huang, Z Hong, W Lu, J Yin, L Zou, X Shen. Image-based concrete crack detection in tunnels using deep fully convolutional networks. Construction & Building Materials, 2020, 234: 117367 https://doi.org/10.1016/j.conbuildmat.2019.117367
47
H Zhao, J Shi, X Qi, X Wang, J Jia. Pyramid scene parsing network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI: IEEE, 2017, 2881–2890
