论文标题

现实世界非线性动力学系统的贝叶斯物理信息信息网络

Bayesian Physics-Informed Neural Networks for real-world nonlinear dynamical systems

论文作者

Linka, Kevin, Schafer, Amelie, Meng, Xuhui, Zou, Zongren, Karniadakis, George Em, Kuhl, Ellen

论文摘要

了解现实世界的动态现象仍然是一项艰巨的任务。在各种科学学科中,机器学习已成为分析非线性动力学系统,确定大数据中的模式并围绕它们做出决定的首选技术。现在,神经网络一直用作通用函数近似值,用于具有未完全理解或极其复杂的潜在机制的数据。但是,仅神经网络就忽略了物理学的基本定律,并且通常无法做出合理的预测。在这里,我们通过结合神经网络,物理知识的建模和贝叶斯推断来整合数据,物理和不确定性,以提高传统神经网络模型的预测潜力。我们将阻尼谐波振荡器的物理模型嵌入到完全连接的馈电神经网络中,以探索简单而说明性的模型系统,即Covid-19的爆发动力学。我们的物理知识的神经网络可以无缝整合数据和物理,从而牢固地解决前进和反向问题,并且在插值和外推方面都表现良好,即使对于少量嘈杂和不完整的数据也是如此。他们只需较小的额外费用,他们就可以自适应地学习数据和物理学之间的加权。结合贝叶斯神经网络,它们可以在贝叶斯推论中充当先验,并提供可信的间隔以进行不确定性定量。我们的研究揭示了神经网络,贝叶斯推论以及两者结合的固有优势和缺点,并为模型选择提供了宝贵的指南。虽然我们仅证明了这些方法对于季节性流行传染病的简单模型问题,但我们预计,潜在的概念和趋势将概括为更复杂的疾病状况,更广泛地介绍了各种非线性动力学系统。

Understanding real-world dynamical phenomena remains a challenging task. Across various scientific disciplines, machine learning has advanced as the go-to technology to analyze nonlinear dynamical systems, identify patterns in big data, and make decision around them. Neural networks are now consistently used as universal function approximators for data with underlying mechanisms that are incompletely understood or exceedingly complex. However, neural networks alone ignore the fundamental laws of physics and often fail to make plausible predictions. Here we integrate data, physics, and uncertainties by combining neural networks, physics-informed modeling, and Bayesian inference to improve the predictive potential of traditional neural network models. We embed the physical model of a damped harmonic oscillator into a fully-connected feed-forward neural network to explore a simple and illustrative model system, the outbreak dynamics of COVID-19. Our Physics-Informed Neural Networks can seamlessly integrate data and physics, robustly solve forward and inverse problems, and perform well for both interpolation and extrapolation, even for a small amount of noisy and incomplete data. At only minor additional cost, they can self-adaptively learn the weighting between data and physics. Combined with Bayesian Neural Networks, they can serve as priors in a Bayesian Inference, and provide credible intervals for uncertainty quantification. Our study reveals the inherent advantages and disadvantages of Neural Networks, Bayesian Inference, and a combination of both and provides valuable guidelines for model selection. While we have only demonstrated these approaches for the simple model problem of a seasonal endemic infectious disease, we anticipate that the underlying concepts and trends generalize to more complex disease conditions and, more broadly, to a wide variety of nonlinear dynamical systems.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源