An Adaptive Physics-Informed Neural Network by Sampling Alternately from Time and Space for Solving Spatiotemporal PDE
DOI: 10.23977/jnca.2025.100110 | Downloads: 4 | Views: 414
Author(s)
Hanya Wen 1, Jin Su 1,2
Affiliation(s)
1 School of Science, Xi'an Polytechnic University, Xi'an, Shaanxi, 710048, China
2 Key Laboratory of Functional Textile Material and Product, Ministry of Education, Xi'an Polytechnic University, Xi'an, 710048, Shaanxi, China; Xi'an International Science and Technology Cooperation Base for Big Data Analysis and Algorithms, Xi'an, Shaanxi, 710048, China
Corresponding Author
Jin SuABSTRACT
In the past several years, Physics-Informed Neural Network (PINN) for solving partial differential equations (PDE) has an advance development, however, under the traditional sampling method, it is difficult for the network to accurately capture the changes of the solution in complex areas. For this reason, we propose a spatio-temporal collaborative sampling strategy of PINN for solving PDE, to optimize the layout of omni-directional sampling points. In our method, the time interval is first subdivided into multiple sub-intervals, and local optimization sampling is performed for each sub-interval. The entire procedures of sampling will be pulled out alternatively in two stages in each sub-interval: first, in the aspect of spatial adaptive sampling, we adopt a dynamic resampling strategy based on the dynamical training error of neural network, which can sensitively identify the changing region of the solution and automatically increase the sampling density in the region with dramatic changes to capture more details; Secondly, time dimension sampling was performed similarly. Numerical tests on the Schrödinger and heat-conduction PDE show over 40% faster convergence and a reduction in relative L2 compared to traditional PINN. This work presents a new approach for efficiently solving complex PDE with PINN.
KEYWORDS
Physical Information Neural Network; Sampling Alternately from Time and Space; Adaptive SamplingCITE THIS PAPER
Hanya Wen, Jin Su, An Adaptive Physics-Informed Neural Network by Sampling Alternately from Time and Space for Solving Spatiotemporal PDE. Journal of Network Computing and Applications (2025) Vol. 10: 81-95. DOI: http://dx.doi.org/10.23977/jnca.2025.100110.
REFERENCES
[1] Raissi M, Yazdani A, Karniadakis G E. Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations [J]. Science, 2020, 367 (6481): 1026-1030.
[2] Raissi M, Perdikaris P, Karniadakis G E. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations [J]. Journal of Computational Physics, 2019, 378: 686-707.
[3] Waheed U B. Kronecker neural networks overcome spectral bias for PINN-Based wavefield computation[J]. IEEE Geoscience and Remote Sensing Letters, 2022, 19: 1-5.
[4] Roy S, Sarkar D R, Annavarapu C, et al. Adaptive Interface-PINN (AdaI-PINN) for transient diffusion: Applications to forward and inverse problems in heterogeneous media[J]. Finite Elements in Analysis and Design, 2025, 244: 104305.
[5] McClenny L D, Braga-Neto U M. Self-adaptive physics-informed neural networks [J]. Journal of Computational Physics, 2023, 474: 111722.
[6] Yu J, Lu L, Meng X, et al. Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems[J]. Computer Methods in Applied Mechanics and Engineering, 2022, 393: 114823.
[7] Bai Y, Chaolu T, Bilige S. The application of improved physics-informed neural network (IPINN) method in finance[J]. Nonlinear Dynamics, 2022, 107(4): 3655-3667.
[8] Xiang Z, Peng W, Liu X, et al. Self-adaptive loss balanced physics-informed neural networks[J]. Neurocomputing, 2022, 496: 11-34.
[9] Mattey R, Ghosh S. A novel sequential method to train physics informed neural networks for Allen Cahn and Cahn Hilliard equations[J]. Computer Methods in Applied Mechanics and Engineering, 2022, 390: 114474.
[10] Dong S, Li Z. Local extreme learning machines and domain decomposition for solving linear and nonlinear partial differential equations[J]. Computer Methods in Applied Mechanics and Engineering, 2021, 387: 114129.
[11] Yan J F, Pakalapati S N R, Nguyen T V, et al. Mathematical modeling of cathodic protection using the boundary element method with a nonlinear polarization curve[J]. Journal of the Electrochemical Society, 1992, 139(7): 1932.
[12] Raymond S J, Cecchi N J, Alizadeh H V, et al. Physics-informed machine learning improves detection of head impacts[J]. Annals of Biomedical Engineering, 2022, 50(11): 1534-1545.
[13] Zhang H, Wang M, Li H, et al. MeshKINN: A self-supervised mesh generation model based on Kolmogorov–Arnold-Informed neural network[J]. Expert Systems with Applications, 2025, 275: 126959.
[14] Cui K, Gao T, Shi D, et al. A Physics-Informed Event-Triggered Learning Approach to Long-Term Spacecraft Li-Ion Battery State-of-Charge Estimation[J]. IEEE Transactions on Industrial Informatics, 2024.
[15] Zhang R, Su J, Feng J. Solution of the Hirota equation using a physics-informed neural network method with embedded conservation laws[J]. Nonlinear Dynamics, 2023, 111(14): 13399-13414.
[16] Cao R, Su J, Feng J, et al. PhyICNet: Physics-informed interactive learning convolutional recurrent network for spatiotemporal dynamics[J]. Electronic Research Archive, 2024, 32(12).
[17] Krishnapriyan A, Gholami A, Zhe S, et al. Characterizing possible failure modes in physics-informed neural networks [J]. Advances in Neural Information Processing Systems, 2021, 34: 26548-26560.
[18] Wu C, Zhu M, Tan Q, et al. A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks[J]. Computer Methods in Applied Mechanics and Engineering, 2023, 403: 115671.
[19] Wang S, Teng Y, Perdikaris P. Understanding and mitigating gradient flow pathologies in physics-informed neural networks[J]. SIAM Journal on Scientific Computing, 2021, 43(5): A3055-A3081.
[20] Wang S, Yu X, Perdikaris P. When and why PINN fail to train: A neural tangent kernel perspective[J]. Journal of Computational Physics, 2022, 449: 110768.
[21] Pienaar J J, Boman A S, Malan K M. Hilbert curves for efficient exploratory landscape analysis neighbourhood sampling[C]//International Conference on the Applications of Evolutionary Computation (Part of EvoStar). Cham: Springer Nature Switzerland, 2024: 293-309.
[22] Nabian M A, Gladstone R J, Meidani H. Efficient training of physics‐informed neural networks via importance sampling[J]. Computer‐Aided Civil and Infrastructure Engineering, 2021, 36(8): 962-977.
[23] Luo J, Yang Y, Yuan Y, et al. An Imbalanced Learning-based Sampling Method for Physics-informed Neural Networks[J]. arXiv preprint arXiv:2501.11222, 2025.
[24] Fang Q, Mou X, Li S. A physics-informed neural network based on mixed data sampling for solving modified diffusion equations[J]. Scientific Reports, 2023, 13(1): 2491.
[25] Anticev J, Aghdaei A, Cheng W, et al. SGM-PINN: Sampling Graphical Models for Faster Training of Physics-Informed Neural Networks[C]//Proceedings of the 61st ACM/IEEE Design Automation Conference. 2024: 1-6.
[26] Guo J, Wang H, Gu S, et al. TCAS-PINN: Physics-informed neural networks with a novel temporal causality-based adaptive sampling method[J]. Chinese Physics B, 2024, 33(5): 050701.
[27] Lu L, Pestourie R, Yao W, et al. Physics-informed neural networks with hard constraints for inverse design [J]. SIAM Journal on Scientific Computing, 2021, 43 (6): B1105-B1132.
[28] Ouyang X, Chang H, Liu Z, et al. Application of adaptive sampling method in hull form optimization[J]. J. Shanghai Jiaotong Univ, 2022, 56: 937-943.
[29] Zhang S, Chi C, Yao Y, et al. Bridging the gap between anchor-based and anchor-free detection via adaptive training sample selection[C]//Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2020: 9759-9768.
[30] Lu L, Meng X, Mao Z, et al. DeepXDE: A deep learning library for solving differential equations[J]. SIAM Review, 2021, 63(1): 208-228.
Downloads: | 1640 |
---|---|
Visits: | 157075 |
Sponsors, Associates, and Links
-
Power Systems Computation
-
Internet of Things (IoT) and Engineering Applications
-
Computing, Performance and Communication Systems
-
Journal of Artificial Intelligence Practice
-
Advances in Computer, Signals and Systems
-
Journal of Web Systems and Applications
-
Journal of Electrotechnology, Electrical Engineering and Management
-
Journal of Wireless Sensors and Sensor Networks
-
Journal of Image Processing Theory and Applications
-
Mobile Computing and Networking
-
Vehicle Power and Propulsion
-
Frontiers in Computer Vision and Pattern Recognition
-
Knowledge Discovery and Data Mining Letters
-
Big Data Analysis and Cloud Computing
-
Electrical Insulation and Dielectrics
-
Crypto and Information Security
-
Journal of Neural Information Processing
-
Collaborative and Social Computing
-
International Journal of Network and Communication Technology
-
File and Storage Technologies
-
Frontiers in Genetic and Evolutionary Computation
-
Optical Network Design and Modeling
-
Journal of Virtual Reality and Artificial Intelligence
-
Natural Language Processing and Speech Recognition
-
Journal of High-Voltage
-
Programming Languages and Operating Systems
-
Visual Communications and Image Processing
-
Journal of Systems Analysis and Integration
-
Knowledge Representation and Automated Reasoning
-
Review of Information Display Techniques
-
Data and Knowledge Engineering
-
Journal of Database Systems
-
Journal of Cluster and Grid Computing
-
Cloud and Service-Oriented Computing
-
Journal of Networking, Architecture and Storage
-
Journal of Software Engineering and Metrics
-
Visualization Techniques
-
Journal of Parallel and Distributed Processing
-
Journal of Modeling, Analysis and Simulation
-
Journal of Privacy, Trust and Security
-
Journal of Cognitive Informatics and Cognitive Computing
-
Lecture Notes on Wireless Networks and Communications
-
International Journal of Computer and Communications Security
-
Journal of Multimedia Techniques
-
Automation and Machine Learning
-
Computational Linguistics Letters
-
Journal of Computer Architecture and Design
-
Journal of Ubiquitous and Future Networks