1. School of Mechanical Sciences, Indian Institute of Technology, Bhubaneswar 752050, India 2. Institute of Structural Mechanics, Bauhaus University of Weimar, Weimar 99423, Germany 3. Department of Mechanical Engineering, Indian Institute of Technology Madras, Chennai 600036, India
A combined deep machine learning (DML) and collocation based approach to solve the partial differential equations using artificial neural networks is proposed. The developed method is applied to solve problems governed by the Sine–Gordon equation (SGE), the scalar wave equation and elasto-dynamics. Two methods are studied: one is a space-time formulation and the other is a semi-discrete method based on an implicit Runge–Kutta (RK) time integration. The methodology is implemented using the Tensorflow framework and it is tested on several numerical examples. Based on the results, the relative normalized error was observed to be less than 5% in all cases.
L XuW HuiZ Zeng. The algorithm of neural networks on the initial value problems in ordinary differential equations. In: Proceedings of the 2nd IEEE Conference on Industrial Electronics and Applications. New York: Institute of Electrical and Electronics Engineers, 2007,813–816
2
S Mall, S Chakraverty. Comparison of artificial neural network architecture in solving ordinary differential equations. Advances in Artificial Neural Systems, 2013, 2013: 12–12
3
N YadavA YadavM Kumar. An Introduction to Neural Network Methods for Differential Equations. Berlin: Springer, 2015
4
I E Lagaris, A Likas, D I Fotiadis. Artificial neural networks for solving ordinary and partial differential equations. IEEE Transactions on Neural Networks, 1998, 9(5): 987–1000 https://doi.org/10.1109/72.712178
5
K Rudd. Solving partial differential equations using artificial neural networks. Dissertation for the Doctoral Degree. Durham: Duke University, 2013
6
A Al-AradiA CorreiaD NaiffG JardimY Saporito. Solving nonlinear and high-dimensional partial differential equations via deep learning. arXiv, 2018: 1811.08782
7
I E Lagaris, A C Likas, D G Papageorgiou. Neural-network methods for boundary value problems with irregular boundaries. IEEE Transactions on Neural Networks, 2000, 11(5): 1041–1049 https://doi.org/10.1109/72.870037
8
O Fuks, H A Tchelepi. Limitations of physics informed machine learning for nonlinear two-phase transport in porous media. Journal of Machine Learning for Modeling and Computing, 2020, 1(1): 39–61
9
M ChenS MaoY ZhangC M VictorV Leung. Big Data Generation and Acquisition. Springer, 2014, 39–61
10
S Gupta, S Modgil, A Gunasekaran. Big data in lean six sigma: A review and further research directions. International Journal of Production Research, 2020, 58(3): 947–969 https://doi.org/10.1080/00207543.2019.1598599
11
H Waheed, S U Hassan, N R Aljohani, J Hardman, S Alelyani, R Nawaz. Predicting academic performance of students from VLE big data using deep learning models. Computers in Human Behavior, 2020, 104: 106189 https://doi.org/10.1016/j.chb.2019.106189
12
R Yang, L Yu, Y Zhao, H Yu, G Xu, Y Wu, Z Liu. Big Data analytics for financial market volatility forecast based on support vector machine. International Journal of Information Management, 2020, 50: 452–462 https://doi.org/10.1016/j.ijinfomgt.2019.05.027
13
C Thongprayoon, W Kaewput, K Kovvuru, P Hansrivijit, S R Kanduri, T Bathini, A Chewcharat, N Leeaphorn, M L Gonzalez-Suarez, W Cheungpasitporn. Promises of big data and artificial intelligence in nephrology and transplantation. Journal of Clinical Medicine, 2020, 9(4): 1107
14
S Manzhos. Machine learning for the solution of the schrodinger equation. Machine Learning: Science and Technology, 2020, 1(1): 013002 https://doi.org/10.1088/2632-2153/ab7d30
15
G Kissas, Y Yang, E Hwuang, R Walter, W R Witschey, J A Detre, P Perdikaris. Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering, 2020, 358: 112623 https://doi.org/10.1016/j.cma.2019.112623
16
M Ghaith, Z Li. Propagation of parameter uncertainty in swat: A probabilistic forecasting method based on polynomial chaos expansion and machine learning. Journal of Hydrology, 2020, 586: 124854 https://doi.org/10.1016/j.jhydrol.2020.124854
17
R D Russell, L F Shampine. A collocation method for boundary value problems. Numerische Mathematik, 1972, 19(1): 1–28 https://doi.org/10.1007/BF01395926
18
E Samaniego, C Anitescu, S Goswami, V M Nguyen-Thanh, H Guo, K Hamdia, X Zhuang, T Rabczuk. An energy approach to the solution of partial differential equations in computational mechanics via machine learning: Concepts, implementation and applications. Computer Methods in Applied Mechanics and Engineering, 2020, 362: 112790 https://doi.org/10.1016/j.cma.2019.112790
19
C de Boor, B Swartz. Collocation at gaussian points. SIAM Journal on Numerical Analysis, 1973, 10(4): 582–606 https://doi.org/10.1137/0710052
20
M Raissi, P Perdikaris, G Karniadakis. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics, 2019, 378: 686–707 https://doi.org/10.1016/j.jcp.2018.10.045
21
S Goswami, C Anitescu, S Chakraborty, T Rabczuk. Transfer learning enhanced physics informed neural network for phase-field modeling of fracture. Theoretical and Applied Fracture Mechanics, 2020, 106: 102447 https://doi.org/10.1016/j.tafmec.2019.102447
22
C Anitescu, E Atroshchenko, N Alajlan, T Rabczuk. Artificial neural network methods for the solution of second order boundary value problems. Computers, Materials and Continua, 2019, 59(1): 345–359 https://doi.org/10.32604/cmc.2019.06641
23
H Guo, X Zhuang, T Rabczuk. A deep collocation method for the bending analysis of Kirchhoff plate. Computers, Materials and Continua, 2019, 59(2): 433–456 https://doi.org/10.32604/cmc.2019.06660
24
V M Nguyen-Thanh, X Zhuang, T Rabczuk. A deep energy method for finite deformation hyperelasticity. European Journal of Mechanics. A, Solids, 2020, 80: 103874 https://doi.org/10.1016/j.euromechsol.2019.103874
25
J Lin, S Zhou, H Guo. A deep collocation method for heat transfer in porous media: Verification from the finite element method. Journal of Energy Storage, 2020, 28: 101280 https://doi.org/10.1016/j.est.2020.101280
26
A Chen, X Zhang, Z Zhou. Machine learning: Accelerating materials development for energy storage and conversion. InfoMat, 2020, 2(3): 553–576 https://doi.org/10.1002/inf2.12094
27
K Hornik, M Stinchcombe, H White. Multilayer feedforward networks are universal approximators. Neural Networks, 1989, 2(5): 359–366 https://doi.org/10.1016/0893-6080(89)90020-8
28
Z LuH PuF WangZ HuL Wang. The expressive power of neural networks: A view from the width. In: Proceedings of the Conference and Workshop on Neural Information Processing Systems, Advances in neural information processing systems. Cambridge, MA: MIT press, 2017, 6231–6239
29
J Sirignano, K S Dgm. A deep learning algorithm for solving partial differential equations. Journal of Computational Physics, 2018, 375: 1339–1364 https://doi.org/10.1016/j.jcp.2018.08.029
30
D Speiser. Discovering the Principles of Mechanics 1600–1800. Berlin: Springer Science & Business Media, 2008
31
J R d’Alembert. Tracing back on the curve formed by the rope stretched in vibration. Paris: Memoirs of the Royal Academy of Sciences and Beautiful Literature, 1747 (in French)
32
C Wilson. D’Alembert versus Euler on the precession of the equinoxes and the mechanics of rigid bodies. Archive for History of Exact Sciences, 2008, 37(3): 233–273
33
A Barone, F Esposito, C J Magee, A C Scott. Theory and applications of the Sine-Gordon equation. La Rivista del Nuovo Cimento, 1971, 1(2): 227–267
34
E Bour. Surface deformation theory. Imperial College Magazine, 1862, 19: 1–48
35
E Gert. The Classical Sine-Gordon Equation (SGE). Berlin: Springer, 1981, 93–127
