Education, Science, Technology, Innovation and Life
Open Access
Sign In

An Adaptive Physics-Informed Neural Network by Sampling Alternately from Time and Space for Solving Spatiotemporal PDE

Download as PDF

DOI: 10.23977/jnca.2025.100110 | Downloads: 4 | Views: 414

Author(s)

Hanya Wen 1, Jin Su 1,2

Affiliation(s)

1 School of Science, Xi'an Polytechnic University, Xi'an, Shaanxi, 710048, China
2 Key Laboratory of Functional Textile Material and Product, Ministry of Education, Xi'an Polytechnic University, Xi'an, 710048, Shaanxi, China; Xi'an International Science and Technology Cooperation Base for Big Data Analysis and Algorithms, Xi'an, Shaanxi, 710048, China

Corresponding Author

Jin Su

ABSTRACT

In the past several years, Physics-Informed Neural Network (PINN) for solving partial differential equations (PDE) has an advance development, however, under the traditional sampling method, it is difficult for the network to accurately capture the changes of the solution in complex areas. For this reason, we propose a spatio-temporal collaborative sampling strategy of PINN for solving PDE, to optimize the layout of omni-directional sampling points. In our method, the time interval is first subdivided into multiple sub-intervals, and local optimization sampling is performed for each sub-interval. The entire procedures of sampling will be pulled out alternatively in two stages in each sub-interval: first, in the aspect of spatial adaptive sampling, we adopt a dynamic resampling strategy based on the dynamical training error of neural network, which can sensitively identify the changing region of the solution and automatically increase the sampling density in the region with dramatic changes to capture more details; Secondly, time dimension sampling was performed similarly. Numerical tests on the Schrödinger and heat-conduction PDE show over 40% faster convergence and a reduction in relative L2 compared to traditional PINN. This work presents a new approach for efficiently solving complex PDE with PINN.

KEYWORDS

Physical Information Neural Network; Sampling Alternately from Time and Space; Adaptive Sampling

CITE THIS PAPER

Hanya Wen, Jin Su, An Adaptive Physics-Informed Neural Network by Sampling Alternately from Time and Space for Solving Spatiotemporal PDE. Journal of Network Computing and Applications (2025) Vol. 10: 81-95. DOI: http://dx.doi.org/10.23977/jnca.2025.100110.

REFERENCES

[1] Raissi M, Yazdani A, Karniadakis G E. Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations [J]. Science, 2020, 367 (6481): 1026-1030.
[2] Raissi M, Perdikaris P, Karniadakis G E. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations [J]. Journal of Computational Physics, 2019, 378: 686-707.
[3] Waheed U B. Kronecker neural networks overcome spectral bias for PINN-Based wavefield computation[J]. IEEE Geoscience and Remote Sensing Letters, 2022, 19: 1-5.
[4] Roy S, Sarkar D R, Annavarapu C, et al. Adaptive Interface-PINN (AdaI-PINN) for transient diffusion: Applications to forward and inverse problems in heterogeneous media[J]. Finite Elements in Analysis and Design, 2025, 244: 104305.
[5] McClenny L D, Braga-Neto U M. Self-adaptive physics-informed neural networks [J]. Journal of Computational Physics, 2023, 474: 111722.
[6] Yu J, Lu L, Meng X, et al. Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems[J]. Computer Methods in Applied Mechanics and Engineering, 2022, 393: 114823.
[7] Bai Y, Chaolu T, Bilige S. The application of improved physics-informed neural network (IPINN) method in finance[J]. Nonlinear Dynamics, 2022, 107(4): 3655-3667.
[8] Xiang Z, Peng W, Liu X, et al. Self-adaptive loss balanced physics-informed neural networks[J]. Neurocomputing, 2022, 496: 11-34.
[9] Mattey R, Ghosh S. A novel sequential method to train physics informed neural networks for Allen Cahn and Cahn Hilliard equations[J]. Computer Methods in Applied Mechanics and Engineering, 2022, 390: 114474.
[10] Dong S, Li Z. Local extreme learning machines and domain decomposition for solving linear and nonlinear partial differential equations[J]. Computer Methods in Applied Mechanics and Engineering, 2021, 387: 114129.
[11] Yan J F, Pakalapati S N R, Nguyen T V, et al. Mathematical modeling of cathodic protection using the boundary element method with a nonlinear polarization curve[J]. Journal of the Electrochemical Society, 1992, 139(7): 1932.
[12] Raymond S J, Cecchi N J, Alizadeh H V, et al. Physics-informed machine learning improves detection of head impacts[J]. Annals of Biomedical Engineering, 2022, 50(11): 1534-1545.
[13] Zhang H, Wang M, Li H, et al. MeshKINN: A self-supervised mesh generation model based on Kolmogorov–Arnold-Informed neural network[J]. Expert Systems with Applications, 2025, 275: 126959.
[14] Cui K, Gao T, Shi D, et al. A Physics-Informed Event-Triggered Learning Approach to Long-Term Spacecraft Li-Ion Battery State-of-Charge Estimation[J].  IEEE Transactions on Industrial Informatics, 2024.
[15] Zhang R, Su J, Feng J. Solution of the Hirota equation using a physics-informed neural network method with embedded conservation laws[J]. Nonlinear Dynamics, 2023, 111(14): 13399-13414.
[16] Cao R, Su J, Feng J, et al. PhyICNet: Physics-informed interactive learning convolutional recurrent network for spatiotemporal dynamics[J]. Electronic Research Archive, 2024, 32(12).
[17] Krishnapriyan A, Gholami A, Zhe S, et al. Characterizing possible failure modes in physics-informed neural networks [J]. Advances in Neural Information Processing Systems, 2021, 34: 26548-26560.
[18] Wu C, Zhu M, Tan Q, et al. A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks[J]. Computer Methods in Applied Mechanics and Engineering, 2023, 403: 115671.
[19] Wang S, Teng Y, Perdikaris P. Understanding and mitigating gradient flow pathologies in physics-informed neural networks[J]. SIAM Journal on Scientific Computing, 2021, 43(5): A3055-A3081.
[20] Wang S, Yu X, Perdikaris P. When and why PINN fail to train: A neural tangent kernel perspective[J]. Journal of Computational Physics, 2022, 449: 110768.
[21] Pienaar J J, Boman A S, Malan K M. Hilbert curves for efficient exploratory landscape analysis neighbourhood sampling[C]//International Conference on the Applications of Evolutionary Computation (Part of EvoStar). Cham: Springer Nature Switzerland, 2024: 293-309.
[22] Nabian M A, Gladstone R J, Meidani H. Efficient training of physics‐informed neural networks via importance sampling[J]. Computer‐Aided Civil and Infrastructure Engineering, 2021, 36(8): 962-977.
[23] Luo J, Yang Y, Yuan Y, et al. An Imbalanced Learning-based Sampling Method for Physics-informed Neural Networks[J]. arXiv preprint arXiv:2501.11222, 2025.
[24] Fang Q, Mou X, Li S. A physics-informed neural network based on mixed data sampling for solving modified diffusion equations[J]. Scientific Reports, 2023, 13(1): 2491.
[25] Anticev J, Aghdaei A, Cheng W, et al. SGM-PINN: Sampling Graphical Models for Faster Training of Physics-Informed Neural Networks[C]//Proceedings of the 61st ACM/IEEE Design Automation Conference. 2024: 1-6.
[26] Guo J, Wang H, Gu S, et al. TCAS-PINN: Physics-informed neural networks with a novel temporal causality-based adaptive sampling method[J]. Chinese Physics B, 2024, 33(5): 050701.
[27] Lu L, Pestourie R, Yao W, et al. Physics-informed neural networks with hard constraints for inverse design [J]. SIAM Journal on Scientific Computing, 2021, 43 (6): B1105-B1132.
[28] Ouyang X, Chang H, Liu Z, et al. Application of adaptive sampling method in hull form optimization[J]. J. Shanghai Jiaotong Univ, 2022, 56: 937-943.
[29] Zhang S, Chi C, Yao Y, et al. Bridging the gap between anchor-based and anchor-free detection via adaptive training sample selection[C]//Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2020: 9759-9768.
[30] Lu L, Meng X, Mao Z, et al. DeepXDE: A deep learning library for solving differential equations[J]. SIAM Review, 2021, 63(1): 208-228.

Downloads: 1640
Visits: 157075

Sponsors, Associates, and Links


All published work is licensed under a Creative Commons Attribution 4.0 International License.

Copyright © 2016 - 2031 Clausius Scientific Press Inc. All Rights Reserved.