1. School of Civil and Transportation Engineering, Guangdong University of Technology, Guangzhou 510006, China 2. JSTI Group Guangdong Inspection and Certification Co. Ltd, Nanjing 210000, China
This paper utilizes three popular semantic segmentation networks, specifically DeepLab v3+, fully convolutional network (FCN), and U-Net to qualitively analyze and identify the key components of cutting slope images in complex scenes and achieve rapid image-based slope detection. The elements of cutting slope images are divided into 7 categories. In order to determine the best algorithm for pixel level classification of cutting slope images, the networks are compared from three aspects: a) different neural networks, b) different feature extractors, and c) 2 different optimization algorithms. It is found that DeepLab v3+ with Resnet18 and Sgdm performs best, FCN 32s with Sgdm takes the second, and U-Net with Adam ranks third. This paper also analyzes the segmentation strategies of the three networks in terms of feature map visualization. Results show that the contour generated by DeepLab v3+ (combined with Resnet18 and Sgdm) is closest to the ground truth, while the resulting contour of U-Net (combined with Adam) is closest to the input images.
Z Chen. Soil Slope Stability Analysis––Principle, Methods and Programs. Beijing: China Water & Power Press, 2003 (in Chinese)
2
C I Wu, H Y Kung, C H Chen, L C Kuo. An intelligent slope disaster prediction and monitoring system based on WSN and ANP. Expert Systems with Applications, 2014, 41( 10): 4554–4562 https://doi.org/10.1016/j.eswa.2013.12.049
3
J ShuJ Zhang J Wu. Research on highway slope disaster identification based on deep convolution neural network. Highway Traffic Technology, 2017, 13(10): 70–74 (in Chinese)
4
J Wu. Feature learning of highway image and detection of slope failure. Thesis for the Master’s Degree. Beijing: Beijing University of Posts and Telecommunications, 2018 (in Chinese)
5
J Xu, C Gui, Q Han. Recognition of rust grade and rust ratio of steel structures based on ensembled convolutional neural network. Computer-Aided Civil and Infrastructure Engineering, 2020, 35( 10): 1160–1174 https://doi.org/10.1111/mice.12563
6
H Guo, X Zhuang, T Rabczuk. A deep collocation method for the bending analysis of Kirchhoff plate. Computers, Materials & Continua, 2019, 59( 2): 433–456 https://doi.org/10.32604/cmc.2019.06660
7
C Anitescu, E Atroshchenko, N Alajlan, T Rabczuk. Artificial neural network methods for the solution of second order boundary value problems. Computers, Materials & Continua, 2019, 59( 1): 345–359 https://doi.org/10.32604/cmc.2019.06641
8
E Samaniego, C Anitescu, S Goswami, V M Nguyen-Thanh, H Guo, K Hamdia, X Zhuang, T Rabczuk. An energy approach to the solution of partial differential equations in computational mechanics via machine learning: Concepts, implementation and applications. Computer Methods in Applied Mechanics and Engineering, 2020, 362 : 112790 https://doi.org/10.1016/j.cma.2019.112790
9
H ZhouY ChenR Tian. Distance prediction of slope-foot landslide in southwest of China based on GA-BP neural network. In: 2019 the 6th Annual International Conference on Material Engineering and Application. Guangzhou: IOP Publishing, 2020
10
Y XingJ WangX LiR LiuJ Gao. Slope stability prediction model based on GA-SVM. In: 2010 International Conference on Educational and Information Technology. Chongqing: IEEE, 2010
11
H M Lin, S K Chang, J H Wu, C H Juang. Neural network-based model for assessing failure potential of highway slopes in the Alishan, Taiwan Area (China): Pre- and post-earthquake investigation. Engineering Geology, 2009, 104( 3-4): 280–289 https://doi.org/10.1016/j.enggeo.2008.11.007
12
Y Xia, B Chen, S Weng, Y Q Ni, Y L Xu. Temperature effect on vibration properties of civil structures: A literature review and case studies. Journal of Civil Structural Health Monitoring, 2012, 2( 1): 29–46 https://doi.org/10.1007/s13349-011-0015-7
Y Lin, Z Nie, H Ma. Structural damage detection with automatic feature-extraction through deep learning. Computer-Aided Civil and Infrastructure Engineering, 2017, 32( 12): 1025–1046 https://doi.org/10.1111/mice.12313
15
K Zhong, S Teng, G Liu, G Chen, F Cui. Structural damage features extracted by convolutional neural networks from mode shapes. Applied Sciences (Basel, Switzerland), 2020, 10( 12): 4247–4262 https://doi.org/10.3390/app10124247
16
S Teng, Z Liu, G Chen, L Cheng. Concrete crack detection based on well-known feature extractor model and the YOLO_v2 network. Applied Sciences (Basel, Switzerland), 2021, 11( 2): 813–825 https://doi.org/10.3390/app11020813
17
O Ghorbanzadeh, S R Meena, T Blaschke, J Aryal. UAV-based slope failure detection using deep-learning convolutional neural networks. Remote Sensing, 2019, 11( 17): 2046–2069 https://doi.org/10.3390/rs11172046
18
V Badrinarayanan, A Kendall, R Cipolla. SegNet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39( 12): 2481–2495 https://doi.org/10.1109/TPAMI.2016.2644615
19
O Ronneberger, P Fischer, T Brox. U-Net: convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention (MICCAI). Munich: Springer, 2015, 234–241
20
L C Chen, Y Zhu, G Papandreou, F Schroff, H Adam. Encoder-decoder with atrous separable convolution for semantic image segmentation. In: European Conference on Computer Vision (ECCV). Munich: Springer, 2018, 833–851
21
E Shelhamer, J Long, T Darrell. Fully Convolutional networks for semantic segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39( 4): 640–651 https://doi.org/10.1109/TPAMI.2016.2572683
22
Y Narazaki, V Hoskere, T A Hoang, Y Fujino, A Sakurai, B F Jr Spencer. Vision ‐ based automated bridge component recognition with high ‐ level scene consistency. Computer-Aided Civil and Infrastructure Engineering, 2020, 35( 5): 465–482 https://doi.org/10.1111/mice.12505
23
J Liu, X Yang, S Lau, X Wang, S Luo, V C S Lee, L Ding. Automated pavement crack detection and segmentation based on two-step convolutional neural network. Computer-Aided Civil and Infrastructure Engineering, 2020, 35( 11): 1291–1305 https://doi.org/10.1111/mice.12622
24
C V Dung, L D Anh. Autonomous concrete crack detection using deep fully convolutional neural network. Automation in Construction, 2019, 99 : 52–58 https://doi.org/10.1016/j.autcon.2018.11.028
25
S Teng, G Chen, P Gong, G Liu, F Cui. Structural damage detection using convolutional neural networks combining strain energy and dynamic response. Meccanica, 2020, 55( 4): 945–959 https://doi.org/10.1007/s11012-019-01052-w
26
C RojahnD R BonnevilleN D QuadriM T PhippsR A Ranous J E RussellW E StaehlinZ Turner. Postearthquake Safety Evaluation of Buildings. Redwood City, CA: Applied Technology Council, 2005
27
H Noh, S Hong, B Han. Learning deconvolution network for semantic segmentation. In: 2015 IEEE International Conference on Computer Vision (ICCV). Las Condes: IEEE, 2015, 1520–1528
28
C Dong, C C Loy, X Tang. Accelerating the super-resolution convolutional neural network. In: European Conference on Computer Vision (ECCV). Amsterdam: Springer, 2016, 391–407
29
V M Nguyen-Thanh, C Anitescu, N Alajlan, T Rabczuk, X Zhuang. Parametric deep energy approach for elasticity accounting for strain gradient effects. Computer Methods in Applied Mechanics and Engineering, 2021, 386 : 114096 https://doi.org/10.1016/j.cma.2021.114096
30
X Zhuang, H Guo, N Alajlan, H Zhu, T Rabczuk. Deep autoencoder based energy method for the bending, vibration, and buckling analysis of Kirchhoff plates with transfer learning. European Journal of Mechanics. A, Solids, 2021, 87 : 104225 https://doi.org/10.1016/j.euromechsol.2021.104225
31
K He, X Zhang, S Ren, J Sun. Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, NV: IEEE, 2016, 770–778
32
L C Chen, G Papandreou, I Kokkinos, K Murphy, A L Yuille. DeepLab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018, 40( 4): 834–848 https://doi.org/10.1109/TPAMI.2017.2699184
33
Y J Cha, W Choi, O Büyüköztürk. Deep learning-based crack damage detection using convolutional neural networks. Computer-Aided Civil and Infrastructure Engineering, 2017, 32( 5): 361–378 https://doi.org/10.1111/mice.12263
34
K He, X Zhang, S Ren, J Sun. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In: 2015 IEEE International Conference on Computer Vision (ICCV). Las Condes: IEEE, 2015, 1026–1034
35
S IoffeC Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. 2015, arXiv:1502.03167
36
N Srivastava, G Hinton, A Krizhevsky, I Sutskever, R Salakhutdinov. Dropout: A simple way to prevent neural networks from overfitting. Journal of Machine Learning Research, 2014, 15( 1): 1929–1958
37
G CsurkaD LarlusF Perronnin. What is a good evaluation measure for semantic segmentation? In: Proceedings of the British Machine Vision Conference. Bristol: BMVA, 2013
38
D Randall Wilson, T R Martinez. The need for small learning rates on large problems. In: International Joint Conference on Neural Networks. Washington, D.C.: IEEE, 2001, 115–119
39
A KroghJ A Hertz. A Simple Weight Decay Can Improve Generalization. In: Proceedings of the 4th International Conference on Neural Information Processing Systems (NIPS). Denver: MIT Press, 1991
40
R F David Eigen. Predicting depth, surface normals and semantic labels with a common multi-scale convolutional architecture. In: IEEE International Conference on Computer Vision (ICCV). Las Condes: IEEE, 2015,
