Please wait a minute...
Frontiers of Structural and Civil Engineering

ISSN 2095-2430

ISSN 2095-2449(Online)

CN 10-1023/X

Postal Subscription Code 80-968

2018 Impact Factor: 1.272

Front. Struct. Civ. Eng.    2022, Vol. 16 Issue (4) : 401-413    https://doi.org/10.1007/s11709-022-0823-3
RESEARCH ARTICLE
Realtime prediction of hard rock TBM advance rate using temporal convolutional network (TCN) with tunnel construction big data
Zaobao LIU1,2(), Yongchen WANG1, Long LI1, Xingli FANG3, Junze WANG1
1. Key Laboratory of Ministry of Education on Safe Mining of Deep Metal Mines, Institute of Deep Engineering and Intelligent Technology, Northeastern University, Shenyang 110819, China
2. State Key Laboratory of Hydraulics and Mountain River Engineering, Sichuan University, Chengdu 610065, China
3. Software College, Northeastern University, Shenyang 110819, China
 Download: PDF(4468 KB)   HTML
 Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks
Abstract

Real-time dynamic adjustment of the tunnel bore machine (TBM) advance rate according to the rock-machine interaction parameters is of great significance to the adaptability of TBM and its efficiency in construction. This paper proposes a real-time predictive model of TBM advance rate using the temporal convolutional network (TCN), based on TBM construction big data. The prediction model was built using an experimental database, containing 235 data sets, established from the construction data from the Jilin Water-Diversion Tunnel Project in China. The TBM operating parameters, including total thrust, cutterhead rotation, cutterhead torque and penetration rate, are selected as the input parameters of the model. The TCN model is found outperforming the recurrent neural network (RNN) and long short-term memory (LSTM) model in predicting the TBM advance rate with much smaller values of mean absolute percentage error than the latter two. The penetration rate and cutterhead torque of the current moment have significant influence on the TBM advance rate of the next moment. On the contrary, the influence of the cutterhead rotation and total thrust is moderate. The work provides a new concept of real-time prediction of the TBM performance for highly efficient tunnel construction.

Keywords hard rock tunnel      tunnel bore machine advance rate prediction      temporal convolutional networks      soft computing      construction big data     
Corresponding Author(s): Zaobao LIU   
Just Accepted Date: 12 April 2022   Online First Date: 27 June 2022    Issue Date: 09 August 2022
 Cite this article:   
Zaobao LIU,Yongchen WANG,Long LI, et al. Realtime prediction of hard rock TBM advance rate using temporal convolutional network (TCN) with tunnel construction big data[J]. Front. Struct. Civ. Eng., 2022, 16(4): 401-413.
 URL:  
https://academic.hep.com.cn/fsce/EN/10.1007/s11709-022-0823-3
https://academic.hep.com.cn/fsce/EN/Y2022/V16/I4/401
Fig.1  Causal convolution structure.
Fig.2  Residual block structure.
Fig.3  One-dimensional dilated temporal convolution with two blocks.
Fig.4  Flow chart of TCN.
Fig.5  Flow chart of advance rate prediction model.
Fig.6  Variation trend of some parameters in complete driving cycle.
Fig.7  Variation trend of some parameters in typical driving cycle.
Fig.8  Correlation analysis between characteristic parameters and advance rate: (a) total thrust; (b) penetration rate; (c) cutterhead rotation and (d) cutterhead torque.
hyper-parametercandidate valueTCN valueRNN valueLSTM value
nneuronsa)[25, 125, 225, 325, 425]125325325
ksb)[2, 3, 4]2
dsc)[[1, 2, 4, 8];[1, 2, 4, 8, 16];[1, 2, 4, 8, 16, 24]][1, 2, 4, 8, 16]
nstacksd)[1, 2]2
ndropout[0.2, 0.3, 0.4, 0.5]0.30.30.3
learning rate[0.003, 0.001, 0.0009, 0.0003, 0.0001]0.00090.0010.0003
Tab.1  Hyper-parameters of the advance rate prediction model
Fig.9  Comparison of measured value and TCN predicted value of advance rate.
evaluation indextraining & validation settraining settest set
RMSE (mm/min)4.08944.03934.3403
MAE (mm/min)3.15823.12823.3349
MAPE5.612%5.556%6.182%
R20.69100.68910.7213
Tab.2  Performance of TCN-based model on different data sets
modeldataset 1dataset 2dataset 3dataset 4average
TRa)TSb)TRTSTRTSTRTSTRTS
TCN0.6530.6730.6810.7100.6890.7210.6580.6890.6700.698
LSTM0.6280.6050.7110.7060.6630.7120.6500.6690.6530.673
RNN0.6170.5960.6020.5860.6370.6930.6260.6170.6210.623
Tab.3  Models prediction results of advance rate on different datasets based on R2
Fig.10  Comparison of the predicted and measured advance rate based on RNNs: (a) RNN model and (b) LSTM model.
Fig.11  Comparison of absolute errors of all models.
Fig.12  Partial comparison between the measured and the predicted value of advance rate: (a) early period and (b) stable period.
modelRMSE (mm/min)MAE (mm/min)MAPER2
TRTSTRTSTRTSTRTS
TCN4.03934.34033.12823.33495.556%6.182%0.68910.7213
LSTM4.22424.42463.25643.48885.954%6.864%0.66360.7115
RNN4.39474.56763.36693.39785.929%6.808%0.63660.6925
Tab.4  Comparison of performance evaluation indexes of prediction models
Fig.13  Optimal cycles of evaluation indexes of each model.
Fig.14  Fitting of predicted and measured advance rate: (a) RNN model; (b) LSTM model; (c) TCN model.
1 M Qi. Promoting TBM in tunnel construction in China. Tunnel Construction, 2014, 34(11): 1019−1023 (in Chinese)
2 Y ShangZ YangZ QiY SunY ShiG Yuan. Retrospective analysis of TBM accidents from its poor flexibility to complicated geological conditions. Chinese Journal of Rock Mechanics and Engineering, 2007, 26(12): 2404−2411 (in Chinese)
3 L LiZ LiuH ZhouW QiW Zha. Weighted voting model for advanced intelligent perception of tunnel faults based on TBM rock-machine information. Chinese Journal of Rock Mechanics and Engineering, 2020, 39(S2): 3401−3411 (in Chinese)
4 Q LiuJ LiuY PanX Kong. Research advances of tunnel boring machine performance prediction models for hard rock. Chinese Journal of Rock Mechanics and Engineering, 2016, 35(S1): 2766−2786 (in Chinese)
5 F Khademi, M Akbari, S M Jamal, M Nikoo. Multiple linear regression, artificial neural network, and fuzzy logic prediction of 28 days compressive strength of concrete. Frontiers of Structural and Civil Engineering, 2017, 11( 1): 90–99
https://doi.org/10.1007/s11709-016-0363-9
6 A Sharafati, H Naderpour, S Q Salih, E Onyari, Z M Yaseen. Simulation of foamed concrete compressive strength prediction using adaptive neuro-fuzzy inference system optimized by nature-inspired algorithms. Frontiers of Structural and Civil Engineering, 2021, 15( 1): 61–79
https://doi.org/10.1007/s11709-020-0684-6
7 R Chen, P Zhang, H Wu, Z Wang, Z Zhong. Prediction of shield tunneling-induced ground settlement using machine learning techniques. Frontiers of Structural and Civil Engineering, 2019, 13( 6): 1363–1378
https://doi.org/10.1007/s11709-019-0561-3
8 Z Liu, J Shao, W Xu, Q Wu. Indirect estimation of unconfined compressive strength of carbonate rocks using extreme learning machine. Acta Geotechnica, 2015, 10( 5): 651–663
https://doi.org/10.1007/s11440-014-0316-1
9 S Lin, H Zheng, C Han, B Han, W Li. Evaluation and prediction of slope stability using machine learning approaches. Frontiers of Structural and Civil Engineering, 2021, 15( 4): 821–833
https://doi.org/10.1007/s11709-021-0742-8
10 Z Liu, J Shao, W Xu, H Chen, Y Zhang. An extreme learning machine approach for slope stability evaluation and prediction. Natural Hazards, 2014, 73( 2): 787–804
https://doi.org/10.1007/s11069-014-1106-7
11 B Gordan, D Jahed Armaghani, M Hajihassani, M Monjezi. Prediction of seismic slope stability through combination of particle swarm optimization and neural network. Engineering with Computers, 2016, 32( 1): 85–97
https://doi.org/10.1007/s00366-015-0400-7
12 Z Liu, J Shao, W Xu, H Chen, C Shi. Comparison on landslide nonlinear displacement analysis and prediction with computational intelligence approaches. Landslides, 2014, 11( 5): 889–896
https://doi.org/10.1007/s10346-013-0443-z
13 N D Hoang, D Tien Bui. A novel relevance vector machine classifier with cuckoo search optimization for spatial prediction of landslides. Journal of Computing in Civil Engineering, 2016, 30( 5): 04016001
https://doi.org/10.1061/(ASCE)CP.1943-5487.0000557
14 A Tabarsa, N Latifi, A Osouli, Y Bagheri. Unconfined compressive strength prediction of soils stabilized using artificial neural networks and support vector machines. Frontiers of Structural and Civil Engineering, 2021, 15( 2): 520–536
https://doi.org/10.1007/s11709-021-0689-9
15 L Jing, J Li, N Zhang, S Chen, C Yang, H Cao. A TBM advance rate prediction method considering the effects of operating factors. Tunnelling and Underground Space Technology, 2021, 107 : 103620
https://doi.org/10.1016/j.tust.2020.103620
16 J Hassanpour, J Rostami, M Khamehchiyan, A Bruland. Developing new equations for TBM performance prediction in carbonate-argillaceous rocks: A case history of Nowsood water conveyance tunnel. Geomechanics and Geoengineering, 2009, 4( 4): 287–297
https://doi.org/10.1080/17486020903174303
17 M Samaei, M Ranjbarnia, V Nourani, M Zare Naghadehi. Performance prediction of tunnel boring machine through developing high accuracy equations: A case study in adverse geological condition. Measurement, 2020, 152 : 107244
https://doi.org/10.1016/j.measurement.2019.107244
18 S Yagiz, H Karahan. Prediction of hard rock TBM penetration rate using particle swarm optimization. International Journal of Rock Mechanics and Mining Sciences, 2011, 48( 3): 427–433
https://doi.org/10.1016/j.ijrmms.2011.02.013
19 H Fattahi, N Babanouri. Applying optimized support vector regression models for prediction of tunnel boring machine performance. Geotechnical and Geological Engineering, 2017, 35( 5): 2205–2217
https://doi.org/10.1007/s10706-017-0238-4
20 S Mahdevari, K Shahriar, S Yagiz, M Akbarpour Shirazi. A support vector regression model for predicting tunnel boring machine penetration rates. International Journal of Rock Mechanics and Mining Sciences, 2014, 72 : 214–229
https://doi.org/10.1016/j.ijrmms.2014.09.012
21 E Ghasemi, S Yagiz, M Ataei. Predicting penetration rate of hard rock tunnel boring machine using fuzzy logic. Bulletin of Engineering Geology and the Environment, 2014, 73( 1): 23–35
https://doi.org/10.1007/s10064-013-0497-0
22 D J Armaghani, S Yagiz, E T Mohamad, J Zhou. Prediction of TBM performance in fresh through weathered granite using empirical and statistical approaches. Tunnelling and Underground Space Technology, 2021, 118 : 104183
https://doi.org/10.1016/j.tust.2021.104183
23 H Yang, Z Wang, K Song. A new hybrid grey wolf optimizer-feature weighted-multiple kernel-support vector regression technique to predict TBM performance. Engineering with Computers, 2020, 1–17
https://doi.org/10.1007/s00366-020-01217-2
24 D Jahed Armaghani, R S Faradonbeh, E Momeni, A Fahimifar, M Tahir. Performance prediction of tunnel boring machine through developing a gene expression programming equation. Engineering with Computers, 2018, 34( 1): 129–141
https://doi.org/10.1007/s00366-017-0526-x
25 M Zare Naghadehi, M Samaei, M Ranjbarnia, V Nourani. State-of-the-art predictive modeling of TBM performance in changing geological conditions through gene expression programming. Measurement, 2018, 126 : 46–57
https://doi.org/10.1016/j.measurement.2018.05.049
26 M R Moradi, M A E Farsangi. Application of the risk matrix method for geotechnical risk analysis and prediction of the advance rate in rock TBM tunneling. Rock Mechanics and Rock Engineering, 2014, 47( 5): 1951–1960
https://doi.org/10.1007/s00603-013-0464-x
27 J Zhou, Y Qiu, S Zhu, D J Armaghani, C Li, H Nguyen, S Yagiz. Optimization of support vector machine through the use of metaheuristic algorithms in forecasting TBM advance rate. Engineering Applications of Artificial Intelligence, 2021, 97 : 104015
https://doi.org/10.1016/j.engappai.2020.104015
28 X Gao, M Shi, X Song, C Zhang, H Zhang. Recurrent neural networks for real-time prediction of TBM operating parameters. Automation in Construction, 2019, 98 : 225–235
https://doi.org/10.1016/j.autcon.2018.11.013
29 A G Benardos, D C Kaliampakos. Modelling TBM performance with artificial neural networks. Tunnelling and Underground Space Technology, 2004, 19( 6): 597–605
https://doi.org/10.1016/j.tust.2004.02.128
30 J Zhou, B Y Bejarbaneh, D J Armaghani, M M Tahir. Forecasting of TBM advance rate in hard rock condition based on artificial neural network and genetic programming techniques. Bulletin of Engineering Geology and the Environment, 2019, 79( 2): 2069–2084
31 D J Armaghani, E T Mohamad, M S Narayanasamy, N Narita, S Yagiz. Development of hybrid intelligent models for predicting TBM penetration rate in hard rock condition. Tunnelling and Underground Space Technology, 2017, 63 : 29–43
https://doi.org/10.1016/j.tust.2016.12.009
32 M Koopialipoor, A Fahimifar, E N Ghaleini, M Momenzadeh, D J Armaghani. Development of a new hybrid ANN for solving a geotechnical problem related to tunnel boring machine performance. Engineering with Computers, 2020, 36( 1): 345–357
https://doi.org/10.1007/s00366-019-00701-8
33 D J Armaghani, M Koopialipoor, A Marto, S Yagiz. Application of several optimization techniques for estimating TBM advance rate in granitic rocks. Journal of Rock Mechanics and Geotechnical Engineering, 2019, 11( 4): 779–789
https://doi.org/10.1016/j.jrmge.2019.01.002
34 J Zeng, B Roy, D Kumar, A S Mohammed, D J Armaghani, J Zhou, E T Mohamad. Proposing several hybrid PSO-extreme learning machine techniques to predict TBM performance. Engineering with Computers, 2021, 1–17
https://doi.org/10.1007/s00366-020-01225-2
35 J Zhou, Y Qiu, S Zhu, D J Armaghani, E T Mohamad. Estimation of the TBM advance rate under hard rock conditions using XGBoost and Bayesian optimization. Underground Space, 2021, 6( 5): 506–515
36 D E Rumelhart, G E Hinton, R J Williams. Learning representations by back propagating errors. Nature, 1986, 323( 6088): 533–536
https://doi.org/10.1038/323533a0
37 Y Bengio, P Simard, P Frasconi. Learning long-term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks, 1994, 5( 2): 157–166
https://doi.org/10.1109/72.279181
38 H Chen, C Xiao, Z Yao, H Jiang, Y Guan. Prediction of TBM tunneling parameters through an LSTM neural network. In: 2019 IEEE International Conference on Robotics and Biomimetics (ROBIO). Dali: IEEE, 2019, 702–707
39 Z Liu, L Li, X Fang, W Qi, J Shen, H Zhou, Y Zhang. Hard-rock tunnel lithology prediction with TBM construction big data using a global-attention-mechanism-based LSTM network. Automation in Construction, 2021, 125 : 103647
https://doi.org/10.1016/j.autcon.2021.103647
40 S Qin, T Xu, W Zhou. Predicting pore-water pressure in front of a TBM using a deep learning approach. International Journal of Geomechanics, 2021, 21( 8): 04021140
https://doi.org/10.1061/(ASCE)GM.1943-5622.0002064
41 S BaiJ Z KolterV Koltun. An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. 2018, arXiv:1803.01271
42 A OordS DielemanH ZenK SimonyanO VinyalsA GravesN KalchbrennerA SeniorK Kavukcuoglu. Wavenet: A generative model for raw audio. 2016, arXiv:1609.03499
43 F YuV Koltun. Multi-scale context aggregation by dilated convolution. 2015, arXiv: 1511.07122
44 F ZhouL JinJ Dong. Review of convolutional neural network. Chinese Journal of Computers, 2017, 40(6): 1229−1251 (in Chinese)
45 E Strubell, P Verga, D Belanger, A McCallum. Fast and accurate entity recognition with iterated dilated convolutions. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Honolulu, HI: Association for Computational Linguistics, 2017, 2670–2680
46 S Raschka. Python Machine Learning. Birmingham: Packt Publishing Ltd., 2015
47 V Nair, G E Hinton. Rectified linear units improve restricted boltzmann machines. In: Proceedings of the 27th International Conference on Machine Learning. Haifa: Omnipress, 2010, 807–814
48 S Ioffe, C Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In: Proceedings of the 32nd International Conference on Machine Learning. Lille: PMLR, 2015, 448–456
49 D KingmaJ Ba. Adam: A method for stochastic optimization. 2014, arXiv:1412.6980
50 K Jamieson, A Talwalkar. Non-stochastic best arm identification and hyperparameter optimization. In: The 19th International Conference on Artificial Intelligence and Statistics. Cadiz: PMLR, 2016, 240–248
51 A Graves, A Mohamed, G Hinton. Speech recognition with deep recurrent neural networks. In: 2013 IEEE international conference on acoustics, speech and signal processing. Las Vegas, NV: IEEE, 2013, 6645–6649
52 P Baldi, P Sadowski. The dropout learning algorithm. Artificial Intelligence, 2014, 210 : 78–122
https://doi.org/10.1016/j.artint.2014.02.004
[1] Abbas PARSAIE,Amir Hamzeh HAGHIABI,Mojtaba SANEIE,Hasan TORABI. Predication of discharge coefficient of cylindrical weir-gate using adaptive neuro fuzzy inference systems (ANFIS)[J]. Front. Struct. Civ. Eng., 2017, 11(1): 111-122.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed