Welcome submissions to article collection of “Physics-informed Machine Learning”

We are welcoming submission of original research to an article collection entitled “Physics-informed Machine Learning and Its Real-world Applications” of Scientific Reports (Springer Nature). As Guest Editor for the Collection, I hope you will consider this excellent outlet for your research in this field.

This article collection is a great opportunity to highlight this important area, and we hope you will be able to contribute. Please don’t hesitate to contact me if you have any questions. The deadline is Nov. 30, 2022. For more details, please see https://www.nature.com/collections/hdjhcifhad/guest-editors

Two new publications in Physics of Fluids (editor’s Pick and featured articles)

  • 1. H. Gao*, L. Sun, J.-X. Wang, Super-resolution and denoising of fluid flow using physics-informed convolutional neural networks without high-resolution labels, Physics of Fluids, 33(7), 073603, 2021 (Editors’ Pick) [ArxivDOI, bib]
  • 2. A. Arzani, J.-X. Wang, R. D’Souza, Uncovering near-wall blood flow from sparse data with physics-informed neural networks, Physics of Fluids, 33, 071905, 2021 (Featured Article) [ArxivDOI, bib]

New publication in Computational Mechanics

H. Gao*, J.-X. Wang, A Bi-fidelity Ensemble Kalman Method for PDE-Constrained Inverse Problems, Computational Mechanics

https://link.springer.com/article/10.1007/s00466-021-01979-6?wt_mc=Internal.Event.1.SEM.ArticleAuthorOnlineFirst&utm_source=ArticleAuthorOnlineFirst&utm_medium=email&utm_content=AA_en_06082018&ArticleAuthorOnlineFirst_20210226

Mathematical modeling and simulation of complex physical systems based on partial differential equations (PDEs) have been widely used in engineering and industrial applications. To enable reliable predictions, it is crucial yet challenging to calibrate the model by inferring unknown parameters/fields (e.g., boundary conditions, mechanical properties, and operating parameters) from sparse and noisy measurements, which is known as a PDE-constrained inverse problem. In this work, we develop a novel bi-fidelity (BF) ensemble Kalman inversion method to tackle this challenge, leveraging the accuracy of high-fidelity models and the efficiency of low-fidelity models. The core concept is to build a BF model with a limited number of high-fidelity samples for efficient forward propagations in the iterative ensemble Kalman inversion. Compared to existing inversion techniques, salient features of the proposed methods can be summarized as follow: (1) achieving the accuracy of high-fidelity models but at the cost of low-fidelity models, (2) being robust and derivative-free, and (3) being code non-intrusive, enabling ease of deployment for different applications. The proposed method has been assessed by three inverse problems that are relevant to fluid dynamics, including both parameter estimation and field inversion. The numerical results demonstrate the excellent performance of the proposed BF ensemble Kalman inversion approach, which drastically outperforms the standard Kalman inversion in terms of efficiency and accuracy.

New Publication in JCP: Physics-Informed Geometry-Adaptive Convolutional Neural Networks

  • H. Gao*, L. Sun, J.-X. Wang, PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parametric PDEs on Irregular Domain. Journal of Computational Physics, 428, 110079, 2021 [ArxivDOI, bib]

Recently, the advent of deep learning has spurred interest in the development of physics-informed neural networks (PINN) for efficiently solving partial differential equations (PDEs), particularly in a parametric setting. Among all different classes of deep neural networks, the convolutional neural network (CNN) has attracted increasing attention in the scientific machine learning community, since the parameter-sharing feature in CNN enables efficient learning for problems with large-scale spatiotemporal fields. However, one of the biggest challenges is that CNN only can handle regular geometries with image-like format (i.e., rectangular domains with uniform grids). In this paper, we propose a novel physics-constrained CNN learning architecture, aiming to learn solutions of parametric PDEs on irregular domains without any labeled data. In order to leverage powerful classic CNN backbones, elliptic coordinate mapping is introduced to enable coordinate transforms between the irregular physical domain and regular reference domain. The proposed method has been assessed by solving a number of steady-state PDEs on irregular domains, including heat equations, Navier-Stokes equations, and Poisson equations with parameterized boundary conditions, varying geometries, and spatially-varying source fields. Moreover, the proposed method has also been compared against the state-of-the-art PINN with fully-connected neural network (FC-NN) formulation. The numerical results demonstrate the effectiveness of the proposed approach and exhibit notable superiority over the FC-NN based PINN in terms of efficiency and accuracy.

New publication: Physics-Constrained Bayesian Neural Network for Fluid Flow Reconstruction with Sparse and Noisy Data in TAML

L. Sun*, J.-X. Wang, Physics-Constrained Bayesian Neural Network for Fluid Flow Reconstruction with Sparse and Noisy Data, Theoretical and Applied Mechanics Letters, (Accepted), 2020 [Arxiv, DOI, bib]

In many applications, flow measurements are usually sparse and possibly noisy. The reconstruction of a high-resolution flow field from limited and imperfect flow information is significant yet challenging. In this work, we propose an innovative physics-constrained Bayesian deep learning approach to reconstruct flow fields from sparse, noisy velocity data, where equation-based constraints are imposed through the likelihood function and uncertainty of the reconstructed flow can be estimated. Specifically, a Bayesian deep neural network is trained on sparse measurement data to capture the flow field. In the meantime, the violation of physical laws will be penalized on a large number of spatiotemporal points where measurements are not available. A non-parametric variational inference approach is applied to enable efficient physics-constrained Bayesian learning. Several test cases on idealized vascular flows with synthetic measurement data are studied to demonstrate the merit of the proposed method.

 

New publication in Computer Methods in Applied Mechanics and Engineering

L. Sun*, H. Gao*, S. Pan, J.-X. Wang. Surrogate Modeling for Fluid Flows Based on Physics- Constrained Deep Learning Without Simulation Data. Computer Methods in Applied Mechanics and Engineering, 2019 (Forthcoming), see preprint

Numerical simulations on fluid dynamics problems primarily rely on spatially or/and temporally discretization of the governing equation into the finite-dimensional algebraic system solved by computers. Due to complicated nature of the physics and geometry, such process can be computational prohibitive for most real-time applications and many-query analyses. Therefore, developing a cost-effective surrogate model is of great practical significance. Deep learning (DL) has shown new promises for surrogate modeling due to its capability of handling strong nonlinearity and high dimensionality. However, the off-the-shelf DL architectures fail to operate when the data becomes sparse. Unfortunately, data is often insufficient in most parametric fluid dynamics problems since each data point in the parameter space requires an expensive numerical simulation based on the first principle, e.g., Naiver–Stokes equations. In this paper, we provide a physics-constrained DL approach for surrogate modeling of fluid flows without relying on any simulation data. Specifically, a structured deep neural network (DNN) architecture is devised to enforce the initial and boundary conditions, and the governing partial differential equations are incorporated into the loss of the DNN to drive the training. Numerical experiments are conducted on a number of internal flows relevant to hemodynamics applications, and the forward propagation of uncertainties in fluid properties and domain geometry is studied as well. The results show excellent agreement on the flow field and forward-propagated uncertainties between the DL surrogate approximations and the first-principle numerical simulations.

Luning and Han are second-year PhD students in J-X. Wang’s group. Congrats!