1. School of Civil Engineering, Tianjin University, Tianjin 300350, China 2. School of Civil Engineering and Architecture, Guangxi University, Nanning 530004, China 3. Jiangxi Communications Design and Research Institute Co., Ltd., Nanchang 330000, China 4. China Railway 18th Bureau Group Co., Ltd., Tianjin 300222, China 5. School of Highway, Chang’an University, Xi’an 710064, China 6. School of Civil Engineering, Qingdao University of Technology, Qingdao 266033, China
For real-time classification of rock-masses in hard-rock tunnels, quick determination of the rock lithology on the tunnel face during construction is essential. Motivated by current breakthroughs in artificial intelligence technology in machine vision, a new automatic detection approach for classifying tunnel lithology based on tunnel face images was developed. The method benefits from residual learning for training a deep convolutional neural network (DCNN), and a multi-scale dilated convolutional attention block is proposed. The block with different dilation rates can provide various receptive fields, and thus it can extract multi-scale features. Moreover, the attention mechanism is utilized to select the salient features adaptively and further improve the performance of the model. In this study, an initial image data set made up of photographs of tunnel faces consisting of basalt, granite, siltstone, and tuff was first collected. After classifying and enhancing the training, validation, and testing data sets, a new image data set was generated. A comparison of the experimental findings demonstrated that the suggested approach outperforms previous classifiers in terms of various indicators, including accuracy, precision, recall, F1-score, and computing time. Finally, a visualization analysis was performed to explain the process of the network in the classification of tunnel lithology through feature extraction. Overall, this study demonstrates the potential of using artificial intelligence methods for in situ rock lithology classification utilizing geological images of the tunnel face.
Z H Xu, F M Liu, P Lin, R Q Shao, X S Shi. Non-destructive, in-situ, fast identification of adverse geology in tunnels based on anomalies analysis of element content. Tunnelling and Underground Space Technology, 2021, 118: 104146 https://doi.org/10.1016/j.tust.2021.104146
2
Z H Xu, W Ma, P Lin, Y L Hua. Deep learning of rock microscopic images for intelligent lithology identification: Neural network comparison and selection. Journal of Rock Mechanics and Geotechnical Engineering, 2022, 14(4): 1140–1152 https://doi.org/10.1016/j.jrmge.2022.05.009
3
Z B Liu, L Li, X L Fang, W B Qi, J M Shen, H Y Zhou, Y L Zhang. Hard-rock tunnel lithology prediction with TBM construction Big Data using a global-attention-mechanism-based LSTM network. Automation in Construction, 2021, 125: 103647 https://doi.org/10.1016/j.autcon.2021.103647
4
Z H Xu, H Shi, P Lin, T H Liu. Integrated lithology identification based on images and elemental data from rocks. Journal of Petroleum Science Engineering, 2021, 205: 108853 https://doi.org/10.1016/j.petrol.2021.108853
5
Z H Xu, W Y Wang, P Lin, L C Nie, J Wu, Z M Li. Hard-rock TBM jamming subject to adverse geological conditions: Influencing factor, hazard mode and a case study of Gaoligongshan Tunnel. Tunnelling and Underground Space Technology, 2021, 108: 103683 https://doi.org/10.1016/j.tust.2020.103683
6
D J Ren, S L Shen, A Arulrajah, W C Cheng. Prediction model of TBM disc cutter wear during tunnelling in heterogeneous ground. Rock Mechanics and Rock Engineering, 2018, 51(11): 3599–3611 https://doi.org/10.1007/s00603-018-1549-3
7
M Kanik. Evaluation of the limitations of RMR89 system for preliminary support selection in weak rock class. Computers and Geotechnics, 2019, 115: 103159 https://doi.org/10.1016/j.compgeo.2019.103159
8
R Peng, X R Meng, G M Zhao, Z H Ouyang, Y M Li. Multi-echelon support method to limit asymmetry instability in different lithology roadways under high ground stress. Tunnelling and Underground Space Technology, 2021, 108: 103681 https://doi.org/10.1016/j.tust.2020.103681
9
P E A Ayawah, S Sebbeh-Newton, J W A Azure, A G A Kaba, A Anani, S Bansah, H Zabidi. A review and case study of artificial intelligence and machine learning methods used for ground condition prediction ahead of tunnel boring machines. Tunnelling and Underground Space Technology, 2022, 125: 104497 https://doi.org/10.1016/j.tust.2022.104497
10
Miguel-García E de, J F Gómez-González. A new methodology to estimate the powder factor of explosives considering the different lithologies of volcanic lands: A case study from the island of Tenerife, Spain. Tunnelling and Underground Space Technology, 2019, 91: 103023 https://doi.org/10.1016/j.tust.2019.103023
11
L Bi, B Y Ren, D H Zhong, L X Hu. Real-time construction schedule analysis of long-distance diversion tunnels based on lithological predictions using a Markov process. Journal of Construction Engineering and Management, 2015, 141(2): 04014076 https://doi.org/10.1061/(ASCE)CO.1943-7862.0000935
12
S C Li, B Liu, X J Xu, L C Nie, Z Y Liu, J Song, H F Sun, L Chen, K Fan. An overview of ahead geological prospecting in tunneling. Tunnelling and Underground Space Technology, 2017, 63: 69–94 https://doi.org/10.1016/j.tust.2016.12.011
13
G E Hinton, R R Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 2006, 313(5786): 504–507 https://doi.org/10.1126/science.1127647
14
A Krizhevsky, I Sutskever, G E Hinton. ImageNet classification with deep convolutional neural networks. Communications of the ACM, 2017, 60(6): 84–90 https://doi.org/10.1145/3065386
15
C SzegedyW LiuY Q JiaP SermanetS Reed D AnguelovD ErhanV VanhouckeA Rabinovich. Going deeper with convolutions. In: Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Boston, MA: IEEE, 2015, 1–9
16
K SimonyanA Zisserman. Very deep convolutional networks for large-scale image recognition. In: Proceedings of the 3rd International Conference on Learning Representations (ICLR). San Diego, CA: ICLR, 2015
17
K M HeX Y ZhangS Q RenJ Sun. Deep residual learning for image recognition. In: Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, NV: IEEE, 2016, 770–778
18
M F Lei, L H Liu, C H Shi, Y Tan, Y X Lin, W D Wang. A novel tunnel-lining crack recognition system based on digital image technology. Tunnelling and Underground Space Technology, 2021, 108: 103724 https://doi.org/10.1016/j.tust.2020.103724
19
X H SunC H ShiL H LiuM F Lei. Concrete crack image recognition system based on improved seed filling algorithm. Journal of South China University of Technology (Natural Science Edition), 2022, 50(5): 127–136, 146 (in Chinese)
20
J Tinoco, A Gomes Correia, P Cortez. Support vector machines applied to uniaxial compressive strength prediction of jet grouting columns. Computers and Geotechnics, 2014, 55: 132–140 https://doi.org/10.1016/j.compgeo.2013.08.010
21
N Makasis, G A Narsilio, A Bidarmaghz. A machine learning approach to energy pile design. Computers and Geotechnics, 2018, 97: 189–203 https://doi.org/10.1016/j.compgeo.2018.01.011
22
X L Han, N J Jiang, Y F Yang, J Choi, D N Singh, P Beta, Y J Du, Y J Wang. Deep learning based approach for the instance segmentation of clayey soil desiccation cracks. Computers and Geotechnics, 2022, 146: 104733 https://doi.org/10.1016/j.compgeo.2022.104733
23
W G Zhang, H R Li, Y Q Li, H L Liu, Y M Chen, X M Ding. Application of deep learning algorithms in geotechnical engineering: A short critical review. Artificial Intelligence Review, 2021, 54(8): 5633–5673 https://doi.org/10.1007/s10462-021-09967-1
24
M Q Huang, J Ninić, Q B Zhang. BIM, machine learning and computer vision techniques in underground construction: Current status and future perspectives. Tunnelling and Underground Space Technology, 2021, 108: 103677 https://doi.org/10.1016/j.tust.2020.103677
25
X D Bai, W C Cheng, B B Sheil, G Li. Pipejacking clogging detection in soft alluvial deposits using machine learning algorithms. Tunnelling and Underground Space Technology, 2021, 113: 103908 https://doi.org/10.1016/j.tust.2021.103908
26
J Chen, D M Zhang, H W Huang, M Shadabfar, M L Zhou, T J Yang. Image-based segmentation and quantification of weak interlayers in rock tunnel face via deep learning. Automation in Construction, 2020, 120: 103371 https://doi.org/10.1016/j.autcon.2020.103371
27
Z F Wang, W C Cheng. Predicting jet-grout column diameter to mitigate the environmental impact using an artificial intelligence algorithm. Underground Space, 2021, 6(3): 267–280 https://doi.org/10.1016/j.undsp.2020.02.004
28
A F Hu, T Li, Y Chen, H B Ge, Y J Li. Deep learning for preprocessing of measured settlement data. Journal of Hunan University (Natural Sciences), 2021, 48(9): 43–51
29
A K Patel, S Chatterjee. Computer vision-based limestone rock-type classification using probabilistic neural network. Geoscience Frontiers, 2016, 7(1): 53–60 https://doi.org/10.1016/j.gsf.2014.10.005
30
Z H Xu, W Ma, P Lin, H Shi, D D Pan, T H Liu. Deep learning of rock images for intelligent lithology identification. Computers & Geosciences, 2021, 154: 104799 https://doi.org/10.1016/j.cageo.2021.104799
31
Y Y Cai, D G Xu, H Shi. Rapid identification of ore minerals using multi-scale dilated convolutional attention network associated with portable Raman spectroscopy. Spectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy, 2022, 267: 120607 https://doi.org/10.1016/j.saa.2021.120607
32
Z M Cao, C Yang, J Han, H W Mu, C Wan, P Gao. Lithology identification method based on integrated K-means clustering and meta-object representation. Arabian Journal of Geosciences, 2022, 15(17): 1462 https://doi.org/10.1007/s12517-022-10693-3
N Li, H Z Hao, Q Gu, D R Wang, X M Hu. A transfer learning method for automatic identification of sandstone microscopic images. Computers & Geosciences, 2017, 103: 111–121 https://doi.org/10.1016/j.cageo.2017.03.007
35
Ö Polat, A Polat, T Ekici. Automatic classification of volcanic rocks from thin section images using transfer learning networks. Neural Computing & Applications, 2021, 33(18): 11531–11540 https://doi.org/10.1007/s00521-021-05849-3
36
W Seo, Y Kim, H Sim, Y Song, T S Yun. Classification of igneous rocks from petrographic thin section images using convolutional neural network. Earth Science Informatics, 2022, 15(2): 1297–1307 https://doi.org/10.1007/s12145-022-00808-5
37
J Y Chen, M L Zhou, H W Huang, D M Zhang, Z C Peng. Automated extraction and evaluation of fracture trace maps from rock tunnel face images via deep learning. International Journal of Rock Mechanics and Mining Sciences, 2021, 142: 104745 https://doi.org/10.1016/j.ijrmms.2021.104745
38
J Y Chen, Y F Chen, A G Cohn, H W Huang, J H Man, L J Wei. A novel image-based approach for interactive characterization of rock fracture spacing in a tunnel face. Journal of Rock Mechanics and Geotechnical Engineering, 2022, 14(4): 1077–1088 https://doi.org/10.1016/j.jrmge.2021.10.012
39
Y D Xue, Y P Cao, M L Zhou, F Zhang, K Shen, F Jia. Rock mass fracture maps prediction based on spatiotemporal image sequence modeling. Computer-Aided Civil and Infrastructure Engineering, 2023, 38(4): 470–488
40
J Y Chen, T J Yang, D M Zhang, H W Huang, Y Tian. Deep learning based classification of rock structure of tunnel face. Geoscience Frontiers, 2021, 12(1): 395–404 https://doi.org/10.1016/j.gsf.2020.04.003
41
W D Qiao, Y F Zhao, Y Xu, Y M Lei, Y J Wang, S Yu, H Li. Deep learning-based pixel-level rock fragment recognition during tunnel excavation using instance segmentation model. Tunnelling and Underground Space Technology, 2021, 115: 104072 https://doi.org/10.1016/j.tust.2021.104072
42
W C Cheng, X D Bai, B B Sheil, G Li, F Wang. Identifying characteristics of pipejacking parameters to assess geological conditions using optimisation algorithm-based support vector machines. Tunnelling and Underground Space Technology, 2020, 106: 103592 https://doi.org/10.1016/j.tust.2020.103592
43
J Y Chen, M L Zhou, D M Zhang, H W Huang, F S Zhang. Quantification of water inflow in rock tunnel faces via convolutional neural network approach. Automation in Construction, 2021, 123: 103526 https://doi.org/10.1016/j.autcon.2020.103526
44
J Y Chen, H W Huang, A G Cohn, M L Zhou, D M Zhang, J H Man. A hierarchical DCNN-based approach for classifying imbalanced water inflow in rock tunnel faces. Tunnelling and Underground Space Technology, 2022, 122: 104399 https://doi.org/10.1016/j.tust.2022.104399
45
H Jalalifar, S Mojedifar, A A Sahebi, H Nezamabadi-pour. Application of the adaptive neuro-fuzzy inference system for prediction of a rock engineering classification system. Computers and Geotechnics, 2011, 38(6): 783–790 https://doi.org/10.1016/j.compgeo.2011.04.005
46
M N Wang, S G Zhao, J J Tong, Z L Wang, M Yao, J W Li, W H Yi. Intelligent classification model of surrounding rock of tunnel using drilling and blasting method. Underground Space, 2021, 6(5): 539–550 https://doi.org/10.1016/j.undsp.2020.10.001
47
S G Zhao, M N Wang, W H Yi, D Yang, J J Tong. Intelligent classification of surrounding rock of tunnel based on 10 machine learning algorithms. Applied Sciences, 2022, 12(5): 2656 https://doi.org/10.3390/app12052656
48
S K Hou, Y R Liu, Q Yang. Real-time prediction of rock mass classification based on TBM operation Big Data and stacking technique of ensemble learning. Journal of Rock Mechanics and Geotechnical Engineering, 2022, 14(1): 123–143 https://doi.org/10.1016/j.jrmge.2021.05.004
49
D H Qiu, K Fu, Y G Xue, Y F Tao, F M Kong, C H Bai. TBM tunnel surrounding rock classification method and real-time identification model based on tunneling performance. International Journal of Geomechanics, 2022, 22(6): 04022070 https://doi.org/10.1061/(ASCE)GM.1943-5622.0002379
50
J H Hu, T Zhou, S W Ma, D J Yang, M M Guo, P L Huang. Rock mass classification prediction model using heuristic algorithms and support vector machines: A case study of Chambishi copper mine. Scientific Reports, 2022, 12(1): 928 https://doi.org/10.1038/s41598-022-05027-y
51
J J Xu, H Zhang, C S Tang, Q Cheng, B G Tian, B Liu, B Shi. Automatic soil crack recognition under uneven illumination condition with the application of artificial intelligence. Engineering Geology, 2022, 296: 106495 https://doi.org/10.1016/j.enggeo.2021.106495
52
K M HeX Y ZhangS Q RenJ Sun. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In: Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV). Santiago, CA: IEEE, 2015, 1026–1034
53
S N XieR GirshickP DollárZ W TuK M He. Aggregated residual transformations for deep neural networks. In: Proceedings of the 2017 IEEE conference on computer vision and pattern recognition (CVPR). Honolulu, HI: IEEE, 2017, 1492–1500
54
A G HowardM L ZhuB ChenD KalenichenkoW J Wang T WeyandM AndreettoH Adam. Mobilenets: Efficient convolutional neural networks for mobile vision applications. 2017, arXiv: 1704.04861
55
P Q WangP F ChenY YuanD LiuZ H Huang X D HouG Cottrell. Understanding convolution for semantic segmentation. In: 2018 IEEE Winter Conference on Applications of Computer Vision (WACV). Lake Tahoe, NV: IEEE, 2018, 1451–1460
56
F YuV Koltun. Multi-scale context aggregation by dilated convolutions. In: Proceedings of the 4th International Conference on Learning Representations (ICLR). San Juan, UT: ICLR, 2016
57
D M Vo, S W Lee. Semantic image segmentation using fully convolutional neural networks with multi-scale images and multi-scale dilated convolutions. Multimedia Tools and Applications, 2018, 77(14): 18689–18707 https://doi.org/10.1007/s11042-018-5653-x
58
V MnihN HeessA GravesK Kavukcuoglu. Recurrent models of visual attention. In: Ghahramani Z, Welling M, Cortes C, Lawrence N D, Weinberger K Q, eds. Advances in Neural Information Processing Systems 27 (NIPS 2014). Montreal, QC: NIPS, 2014
59
A VaswaniN ShazeerN ParmarJ UszkoreitL Jones A N GomezL KaiserI Polosukhin. Attention is all you need. In: Guyon I, Luxburg U V, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R, eds. Advances in Neural Information Processing Systems 30 (NIPS 2017). Long Beach, CA: NIPS, 2017
60
J HuL Shen G Sun. Squeeze-and-excitation networks. In: Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Salt Lake City, UT: IEEE, 2018, 7132–7141
61
D P KingmaJ Ba. Adam: A method for stochastic optimization. In: Proceedings of the 3rd International Conference on Learning Representations (ICLR). San Diego, CA: ICLR, 2015
62
Y Lecun, L Bottou, Y Bengio, P Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 1998, 86(11): 2278–2324 https://doi.org/10.1109/5.726791
63
Z LiuH Mao C Y WuC FeichtenhoferT DarrellS Xie. A ConvNet for the 2020s. In: Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, LA: IEEE, 2022
64
R R SelvarajuM CogswellA Das R VedantamD ParikhD Batra. Grad-CAM: Visual explanations from deep networks via gradient-based localization. In: Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV). Venice: IEEE, 2017, 618–626
