Must-read Papers on Physics-Informed Neural Networks.

Overview

PINNpapers

Contributed by IDRL lab.

Introduction

Physics-Informed Neural Network (PINN) has achieved great success in scientific computing since 2017. In this repo, we list some representative work on PINNs. Feel free to distribute or use it!

Corrections and suggestions are welcomed.

A script for converting bibtex to the markdown used in this repo is also provided for your convenience.

Software

  1. DeepXDE: A Deep Learning Library for Solving Differential Equations, Lu Lu, Xuhui Meng, Zhiping Mao, George Em Karniadakis, SIAM Review, 2021. [paper][code]
  2. NVIDIA SimNet™: An AI-Accelerated Multi-Physics Simulation Framework, Oliver Hennigh, Susheela Narasimhan, Mohammad Amin Nabian, Akshay Subramaniam, Kaustubh Tangsali, Zhiwei Fang, Max Rietmann, Wonmin Byeon, Sanjay Choudhry, ICCS, 2021. [paper]
  3. SciANN: A Keras wrapper for scientific computations and physics-informed deep learning using artificial neural networks, Ehsan Haghighat, Ruben Juanes, arXiv preprint arXiv:2005.08803, 2020. [paper][code]
  4. Elvet -- a neural network-based differential equation and variational problem solver, Jack Y. Araz, Juan Carlos Criado, Michael Spannowsky, arXiv:2103.14575 [hep-lat, physics:hep-ph, physics:hep-th, stat], 2021. [paper][code]
  5. TensorDiffEq: Scalable Multi-GPU Forward and Inverse Solvers for Physics Informed Neural Networks, Levi D. McClenny, Mulugeta A. Haile, Ulisses M. Braga-Neto, arXiv:2103.16034 [physics], 2021. [paper][code]
  6. PyDEns: a Python Framework for Solving Differential Equations with Neural Networks, Alex Koryagin, er, Roman Khudorozkov, Sergey Tsimfer, arXiv:1909.11544 [cs, stat], 2019. [paper][code]
  7. NeuroDiffEq: A Python package for solving differential equations with neural networks, Feiyu Chen, David Sondak, Pavlos Protopapas, Marios Mattheakis, Shuheng Liu, Devansh Agarwal, Marco Di Giovanni, Journal of Open Source Software, 2020. [paper][code]
  8. Universal Differential Equations for Scientific Machine Learning, Christopher Rackauckas, Yingbo Ma, Julius Martensen, Collin Warner, Kirill Zubov, Rohit Supekar, Dominic Skinner, Ali Ramadhan, Alan Edelman, arXiv:2001.04385 [cs, math, q-bio, stat], 2020. [paper][code]
  9. NeuralPDE: Automating Physics-Informed Neural Networks (PINNs) with Error Approximations, Kirill Zubov, Zoe McCarthy, Yingbo Ma, Francesco Calisto, Valerio Pagliarino, Simone Azeglio, Luca Bottero, Emmanuel Luján, Valentin Sulzer, Ashutosh Bharambe, N Vinchhi, , Kaushik Balakrishnan, Devesh Upadhyay, Chris Rackauckas, arXiv:2107.09443 [cs], 2021. [paper][code]
  10. IDRLnet: A Physics-Informed Neural Network Library, Wei Peng, Jun Zhang, Weien Zhou, Xiaoyu Zhao, Wen Yao, Xiaoqian Chen, arXiv:2107.04320 [cs, math], 2021. [paper][code]

Papers on PINN Models

  1. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations, M. Raissi, P. Perdikaris, G. E. Karniadakis, Journal of Computational Physics, 2019. [paper]
  2. The deep Ritz method: a deep learning-based numerical algorithm for solving variational problems, E Weinan, Bing Yu, Communications in Mathematics and Statistics, 2018. [paper]
  3. DGM: A deep learning algorithm for solving partial differential equations, Justin Sirignano, Konstantinos Spiliopoulos, Journal of Computational Physics, 2018. [paper]
  4. SPINN: Sparse, Physics-based, and partially Interpretable Neural Networks for PDEs, Amuthan A. Ramabathiran, Ramach, Prabhu ran, Journal of Computational Physics, 2021. [paper][code]
  5. Deep neural network methods for solving forward and inverse problems of time fractional diffusion equations with conformable derivative, Yinlin Ye, Yajing Li, Hongtao Fan, Xinyi Liu, Hongbing Zhang, arXiv:2108.07490 [cs, math], 2021. [paper]
  6. NH-PINN: Neural homogenization based physics-informed neural network for multiscale problems, Wing Tat Leung, Guang Lin, Zecheng Zhang, arXiv:2108.12942 [cs, math], 2021. [paper][code]

Papers on Parallel PINN

  1. Parallel Physics-Informed Neural Networks via Domain Decomposition, Khemraj Shukla, Ameya D. Jagtap, George Em Karniadakis, arXiv:2104.10013 [cs], 2021. [paper]
  2. Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equations, Ben Moseley, Andrew Markham, Tarje Nissen-Meyer, arXiv:2107.07871 [physics], 2021. [paper]
  3. PPINN: Parareal physics-informed neural network for time-dependent PDEs, Xuhui Meng, Zhen Li, Dongkun Zhang, George Em Karniadakis, Computer Methods in Applied Mechanics and Engineering, 2020. [paper]

Papers on PINN Accerleration

  1. Self-adaptive loss balanced Physics-informed neural networks for the incompressible Navier-Stokes equations, Zixue Xiang, Wei Peng, Xiaohu Zheng, Xiaoyu Zhao, Wen Yao, arXiv:2104.06217 [physics], 2021. [paper]
  2. A Dual-Dimer method for training physics-constrained neural networks with minimax architecture, Dehao Liu, Yan Wang, Neural Networks, 2021. [paper]
  3. Adversarial Multi-task Learning Enhanced Physics-informed Neural Networks for Solving Partial Differential Equations, Pongpisit Thanasutives, Masayuki Numao, Ken-ichi Fukui, arXiv:2104.14320 [cs, math], 2021. [paper]
  4. DPM: A Novel Training Method for Physics-Informed Neural Networks in Extrapolation, Jungeun Kim, Kookjin Lee, Dongeun Lee, Sheo Yon Jin, Noseong Park, AAAI, 2021. [paper]

Papers on Model Transfer & Meta-Learning

  1. A physics-aware learning architecture with input transfer networks for predictive modeling, Amir Behjat, Chen Zeng, Rahul Rai, Ion Matei, David Doermann, Souma Chowdhury, Applied Soft Computing, 2020. [paper]
  2. Transfer learning based multi-fidelity physics informed deep neural network, Souvik Chakraborty, Journal of Computational Physics, 2021. [paper]
  3. Transfer learning enhanced physics informed neural network for phase-field modeling of fracture, Somdatta Goswami, Cosmin Anitescu, Souvik Chakraborty, Timon Rabczuk, Theoretical and Applied Fracture Mechanics, 2020. [paper]
  4. Meta-learning PINN loss functions, Apostolos F. Psaros, Kenji Kawaguchi, George Em Karniadakis, arXiv:2107.05544 [cs], 2021. [paper]

Papers on Probabilistic PINNs and Uncertainty Quantification

  1. A physics-aware, probabilistic machine learning framework for coarse-graining high-dimensional systems in the Small Data regime, Constantin Grigo, Phaedon-Stelios Koutsourelakis, Journal of Computational Physics, 2019. [paper]
  2. Adversarial uncertainty quantification in physics-informed neural networks, Yibo Yang, Paris Perdikaris, Journal of Computational Physics, 2019. [paper]
  3. B-PINNs: Bayesian physics-informed neural networks for forward and inverse PDE problems with noisy data, Liu Yang, Xuhui Meng, George Em Karniadakis, Journal of Computational Physics, 2021. [paper]
  4. PID-GAN: A GAN Framework based on a Physics-informed Discriminator for Uncertainty Quantification with Physics, Arka Daw, M. Maruf, Anuj Karpatne, arXiv:2106.02993 [cs, stat], 2021. [paper]
  5. Quantifying Uncertainty in Physics-Informed Variational Autoencoders for Anomaly Detection, Marcus J. Neuer, ESTEP, 2020. [paper]
  6. A Physics-Data-Driven Bayesian Method for Heat Conduction Problems, Xinchao Jiang, Hu Wang, Yu li, arXiv:2109.00996 [cs, math], 2021. [paper][code]
  7. Wasserstein Generative Adversarial Uncertainty Quantification in Physics-Informed Neural Networks, Yihang Gao, Michael K. Ng, arXiv:2108.13054 [cs, math], 2021. [paper][code]

Papers on Applications

  1. Physics-informed neural networks for high-speed flows, Zhiping Mao, Ameya D. Jagtap, George Em Karniadakis, Computer Methods in Applied Mechanics and Engineering, 2020. [paper]
  2. Surrogate modeling for fluid flows based on physics-constrained deep learning without simulation data, Luning Sun, Han Gao, Shaowu Pan, Jian-Xun Wang, Computer Methods in Applied Mechanics and Engineering, 2020. [paper]
  3. Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations, Maziar Raissi, Alireza Yazdani, George Em Karniadakis, Science, 2020. [paper]
  4. NSFnets (Navier-Stokes flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations, Xiaowei Jin, Shengze Cai, Hui Li, George Em Karniadakis, Journal of Computational Physics, 2021. [paper]
  5. A High-Efficient Hybrid Physics-Informed Neural Networks Based on Convolutional Neural Network, Zhiwei Fang, IEEE Transactions on Neural Networks and Learning Systems, 2021. [paper]
  6. A Study on a Feedforward Neural Network to Solve Partial Differential Equations in Hyperbolic-Transport Problems, Eduardo Abreu, Joao B. Florindo, ICCS, 2021. [paper]
  7. A Physics Informed Neural Network Approach to Solution and Identification of Biharmonic Equations of Elasticity, Mohammad Vahab, Ehsan Haghighat, Maryam Khaleghi, Nasser Khalili, arXiv:2108.07243 [cs], 2021. [paper]
  8. Prediction of porous media fluid flow using physics informed neural networks, Muhammad M. Almajid, Moataz O. Abu-Alsaud, Journal of Petroleum Science and Engineering, 2021. [paper]
  9. Investigating a New Approach to Quasinormal Modes: Physics-Informed Neural Networks, Anele M. Ncube, Gerhard E. Harmsen, Alan S. Cornell, arXiv:2108.05867 [gr-qc], 2021. [paper]
  10. Towards neural Earth system modelling by integrating artificial intelligence in Earth system science, Christopher Irrgang, Niklas Boers, Maike Sonnewald, Elizabeth A. Barnes, Christopher Kadow, Joanna Staneva, Jan Saynisch-Wagner, Nature Machine Intelligence, 2021. [paper]
  11. Physics-informed Neural Network for Nonlinear Dynamics in Fiber Optics, Xiaotian Jiang, Danshi Wang, Qirui Fan, Min Zhang, Chao Lu, Alan Pak Tao Lau, arXiv:2109.00526 [physics], 2021. [paper][code]

Papers on PINN Analysis

  1. Estimates on the generalization error of physics-informed neural networks for approximating a class of inverse problems for PDEs, Siddhartha Mishra, Roberto Molinaro, IMA Journal of Numerical Analysis, 2021. [paper]
  2. Error analysis for physics informed neural networks (PINNs) approximating Kolmogorov PDEs, Tim De Ryck, Siddhartha Mishra, arXiv:2106.14473 [cs, math], 2021. [paper]
  3. Error Analysis of Deep Ritz Methods for Elliptic Equations, Yuling Jiao, Yanming Lai, Yisu Luo, Yang Wang, Yunfei Yang, arXiv:2107.14478 [cs, math], 2021. [paper]
You might also like...
 Physics-Aware Training (PAT) is a method to train real physical systems with backpropagation.
Physics-Aware Training (PAT) is a method to train real physical systems with backpropagation.

Physics-Aware Training (PAT) is a method to train real physical systems with backpropagation. It was introduced in Wright, Logan G. & Onodera, Tatsuhiro et al. (2021)1 to train Physical Neural Networks (PNNs) - neural networks whose building blocks are physical systems.

Code for PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Relighting and Material Editing

PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Relighting and Material Editing CVPR 2021. Project page: https://kai-46.github.io/

Brax is a differentiable physics engine that simulates environments made up of rigid bodies, joints, and actuators
Brax is a differentiable physics engine that simulates environments made up of rigid bodies, joints, and actuators

Brax is a differentiable physics engine that simulates environments made up of rigid bodies, joints, and actuators. It's also a suite of learning algorithms to train agents to operate in these environments (PPO, SAC, evolutionary strategy, and direct trajectory optimization are implemented).

Original code for
Original code for "Zero-Shot Domain Adaptation with a Physics Prior"

Zero-Shot Domain Adaptation with a Physics Prior [arXiv] [sup. material] - ICCV 2021 Oral paper, by Attila Lengyel, Sourav Garg, Michael Milford and J

McGill Physics Hackathon 2021: Reaction-Diffusion Models for the Generation of Biological Patterns
McGill Physics Hackathon 2021: Reaction-Diffusion Models for the Generation of Biological Patterns

DiffuseAnimals: Reaction-Diffusion Models for the Generation of Biological Patterns Introduction Reaction-diffusion equations can be utilized in order

PyTorch implementation for the visual prior component (i.e. perception module) of the Visually Grounded Physics Learner [Li et al., 2020].
PyTorch implementation for the visual prior component (i.e. perception module) of the Visually Grounded Physics Learner [Li et al., 2020].

VGPL-Visual-Prior PyTorch implementation for the visual prior component (i.e. perception module) of the Visually Grounded Physics Learner (VGPL). Give

[ICLR 2022] Contact Points Discovery for Soft-Body Manipulations with Differentiable Physics
[ICLR 2022] Contact Points Discovery for Soft-Body Manipulations with Differentiable Physics

CPDeform Code and data for paper Contact Points Discovery for Soft-Body Manipulations with Differentiable Physics at ICLR 2022 (Spotlight). @InProceed

This repository contains notebook implementations of the following Neural Process variants: Conditional Neural Processes (CNPs), Neural Processes (NPs), Attentive Neural Processes (ANPs).

The Neural Process Family This repository contains notebook implementations of the following Neural Process variants: Conditional Neural Processes (CN

A framework that constructs deep neural networks, autoencoders, logistic regressors, and linear networks

A framework that constructs deep neural networks, autoencoders, logistic regressors, and linear networks without the use of any outside machine learning libraries - all from scratch.

Comments
Owner
IDRL
Intelligent Design and Robust Learning Laboratory
IDRL
IDRLnet, a Python toolbox for modeling and solving problems through Physics-Informed Neural Network (PINN) systematically.

IDRLnet IDRLnet is a machine learning library on top of PyTorch. Use IDRLnet if you need a machine learning library that solves both forward and inver

IDRL 105 Dec 17, 2022
PINN(s): Physics-Informed Neural Network(s) for von Karman vortex street

PINN(s): Physics-Informed Neural Network(s) for von Karman vortex street This is

ShotaDEGUCHI 2 Apr 18, 2022
A python implementation of Physics-informed Spline Learning for nonlinear dynamics discovery

PiSL A python implementation of Physics-informed Spline Learning for nonlinear dynamics discovery. Sun, F., Liu, Y. and Sun, H., 2021. Physics-informe

Fangzheng (Andy) Sun 8 Jul 13, 2022
The tl;dr on a few notable transformer/language model papers + other papers (alignment, memorization, etc).

The tl;dr on a few notable transformer/language model papers + other papers (alignment, memorization, etc).

Will Thompson 166 Jan 4, 2023
arxiv-sanity, but very lite, simply providing the core value proposition of the ability to tag arxiv papers of interest and have the program recommend similar papers.

arxiv-sanity, but very lite, simply providing the core value proposition of the ability to tag arxiv papers of interest and have the program recommend similar papers.

Andrej 671 Dec 31, 2022
Pytorch implementation of CVPR2021 paper "MUST-GAN: Multi-level Statistics Transfer for Self-driven Person Image Generation"

MUST-GAN Code | paper The Pytorch implementation of our CVPR2021 paper "MUST-GAN: Multi-level Statistics Transfer for Self-driven Person Image Generat

TianxiangMa 46 Dec 26, 2022
Official PyTorch implementation of "Physics-aware Difference Graph Networks for Sparsely-Observed Dynamics".

Physics-aware Difference Graph Networks for Sparsely-Observed Dynamics This repository is the official PyTorch implementation of "Physics-aware Differ

USC-Melady 46 Nov 20, 2022
Pytorch Implementation of Interaction Networks for Learning about Objects, Relations and Physics

Interaction-Network-Pytorch Pytorch Implementraion of Interaction Networks for Learning about Objects, Relations and Physics. Interaction Network is a

null 117 Nov 5, 2022
Official implementation of "Learning Forward Dynamics Model and Informed Trajectory Sampler for Safe Quadruped Navigation" (RSS 2022)

Intro Official implementation of "Learning Forward Dynamics Model and Informed Trajectory Sampler for Safe Quadruped Navigation" Robotics:Science and

Yunho Kim 21 Dec 7, 2022
Complex-Valued Neural Networks (CVNN)Complex-Valued Neural Networks (CVNN)

Complex-Valued Neural Networks (CVNN) Done by @NEGU93 - J. Agustin Barrachina Using this library, the only difference with a Tensorflow code is that y

youceF 1 Nov 12, 2021