Awesome Neural Physics

A curated list of papers that utilize **AI techniques for physics simulation** in the fields of computer graphics and AI.

Awesome Neural Physics Awesome

This repository hosts a curated list of papers on AI techniques for physics simulation in computer graphics.

If you find this list useful, please consider citing it and giving it a :star:. Feel free to share it with others!

Fluid

Name Info Link Label
Data-driven fluid simulations using regression forests TOG 2015 Link
Data-driven projection method in fluid simulation CAVW 2016 Link
Accelerating eulerian fluid simulation with convolutional networks ICML 2017 Link
Data-driven synthesis of smoke flows with CNN-based feature descriptors TOG 2017 Link
tempoGAN: A temporally coherent, volumetric GAN for super-resolution fluid flow TOG 2018 Link
Fluid directed rigid body control using deep reinforcement learning TOG 2018 Link
Deep dynamical modeling and control of unsteady fluid flows NeurIPS 2018 Link
Lagrangian fluid simulation with continuous convolutions ICLR 2019 Link
A CNN-based Flow Correction Method for Fast Preview CGF 2019 Link
Transport-based neural style transfer for smoke simulations TOG 2019 Link
ScalarFlow: a large-scale volumetric data set of real-world scalar transport flows for computer animation and machine learning TOG 2019 Link
Video-guided real-to-virtual parameter transfer for viscous fluids TOG 2019 Link
Machine learning for fluid mechanics 2020 Link
A Novel CNN-Based Poisson Solver for Fluid Simulation TVCG 2020 Link
Latent space subdivision: stable and controllable time predictions for fluid flow CGF 2020 Link
Dynamic fluid surface reconstruction using deep neural network CVPR 2020 Link
Tomofluid: Reconstructing dynamic fluid from sparse view videos CVPR 2020 Link
Interactive liquid splash modeling by user sketches TOG 2020 Link
Lagrangian neural style transfer for fluids TOG 2020 Link
Dynamic Upsampling of Smoke through Dictionary-based Learning TOG 2020 Link
Learning meaningful controls for fluids TOG 2021 Link
Differentiable Fluids with Solid Coupling for Learning and Control AAAI 2021 Link
Predicting high-resolution turbulence details in space and time TOG 2021 Link
Neural upflow: A scene flow learning approach to increase the apparent resolution of particle-based liquids PACMCGIT 2021 Link
Data-driven simulation in fluids animation: A survey 2021 Link
Global transport for fluid reconstruction with learned self-supervision CVPR 2021 Link
Volumetric appearance stylization with stylizing kernel prediction network TOG 2021 Link
Two-step Temporal Interpolation Network Using Forward Advection for Efficient Smoke Simulation CGF 2021 Link
Half-Inverse Gradients for Physical Deep Learning ICLR 2022 Link
Guaranteed conservation of momentum for learning particle-based fluid dynamics NeurIPS 2022 Link
Neurofluid: Fluid dynamics grounding with particle-driven neural radiance fields ICML 2022 Link
Physics informed neural fields for smoke reconstruction with sparse data TOG 2022 Link
Efficient Neural Style Transfer for Volumetric Simulations TOG 2022 Link
Versatile Control of Fluid-directed Solid Objects Using Multi-task Reinforcement Learning TOG 2022 Link
Transformer with implicit edges for particle-based physics simulation ECCV 2022 Link
Deep Reconstruction of 3D Smoke Densities from Artist Sketches CGF 2022 Link
Fluid Simulation on Neural Flow Maps TOG 2023 Link
DiffFR: Differentiable SPH-Based Fluid-Rigid Coupling for Rigid Body Control TOG 2023 Link
Fast fluid simulation via dynamic multi-scale gridding AAAI 2023 Link
Solving Inverse Physics Problems with Score Matching NeurIPS 2023 Link
Learning Vortex Dynamics for Fluid Inference and Prediction ICLR 2023 Link
Neural vortex method: From finite Lagrangian particles to infinite dimensional Eulerian dynamics 2023 Link
FluidLab: A Differentiable Environment for Benchmarking Complex Fluid Manipulation ICLR 2023 Link
Learning to Estimate Single-View Volumetric Flow Motions without 3D Supervision ICLR 2023 Link
Physics-Informed Neural Corrector for Deformation-based Fluid Control CGF 2023 Link
Fluid Inverse Volumetric Modeling and Applications from Surface Motion TVCG 2024 Link
Laplacian Projection Based Global Physical Prior Smoke Reconstruction TVCG 2024 Link
Inferring Hybrid Neural Fluid Fields from Videos NeurIPS 2024 Link
Gaussian Splashing: Dynamic Fluid Synthesis with Gaussian Splatting 2024 Link
Differentiable Voronoi Diagrams for Simulation of Cell-Based Mechanical Systems TOG 2024 Link
Learning Reduced Fluid Dynamics AAAI 2024 Link
Symmetric Basis Convolutions for Learning Lagrangian Fluid Mechanics ICLR 2024 Link
Dynamic ocean inverse modeling based on differentiable rendering CVM 2024 Link

Cloth

Name Info Link Label
Differentiable Cloth Simulation for Inverse Problems NeurIPS 2019 Link
Learning an intrinsic garment space for interactive authoring of garment animation TOG 2019 Link
Projective dynamics with dry frictional contact TOG 2020 Link
Cloth in the wind: A case study of physical measurement through simulation CVPR 2020 Link
Learning to measure the static friction coefficient in cloth contact CVPR 2020 Link
PBNS: physically based neural simulation for unsupervised garment pose space deformation TOG 2021 Link
Self-supervised collision handling via generative 3d garment models for virtual try-on CVPR 2021 Link
Dynamic neural garments TOG 2021 Link
Neural cloth simulation TOG 2022 Link
Dressing avatars: Deep photorealistic appearance for physically simulated clothing TOG 2022 Link
DiffCloth: Differentiable Cloth Simulation with Dry Frictional Contact TOG 2022 Link
Snug: Self-supervised neural dynamic garments CVPR 2022 Link
Predicting loose-fitting garment deformations using bone-driven motion networks Siggraph 2022 Link
Pattern-based cloth registration and sparse-view animation TOG 2022 Link
Learning-based bending stiffness parameter estimation by a drape tester TOG 2022 Link
ClothCombo: Modeling Inter-Cloth Interaction for Draping Multi-Layered Clothes TOG 2023 Link
Detail-Aware Deep Clothing Animations Infused with Multi-Source Attributes CGF 2023 Link
D-Cloth: Skinning-based Cloth Dynamic Prediction with a Three-stage Network CGF 2023 Link
DiffXPBD: Differentiable Position-Based Simulation of Compliant Constraint Dynamics PACMCGIT 2023 Link
Bayesian Differentiable Physics for Cloth Digitalization CVPR 2024 Link
{DiffAvatar}: Simulation-Ready Garment Optimization with Differentiable Simulation CVPR 2024 Link
GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Details Arxiv 2024 Link

Softbody

Name Info Link Label
Latent-space dynamics for reduced deformable simulation CGF 2019 Link
Real2Sim: visco-elastic parameter estimation from dynamic motion TOG 2019 Link
SoftCon: simulation and control of soft-bodied animals with biomimetic actuators TOG 2019 Link
ChainQueen: A Real-Time Differentiable Physical Simulator for Soft Robotics ICRA 2019 Link
Real-time hair simulation with neural interpolation TVCG 2020 Link
Learning to manipulate amorphous materials TOG 2020 Link
Learning active quasistatic physics-based models from data TOG 2021 Link
Diffpd: Differentiable projective dynamics TOG 2021 Link
Learning contact corrections for handle-based subspace dynamics TOG 2021 Link
High-order differentiable autoencoder for nonlinear model reduction TOG 2021 Link
Efficient deformable shape correspondence via multiscale spectral manifold wavelets preservation CVPR 2021 Link
Differentiable simulation of soft multi-body systems NeurIPS 2021 Link
Implicit neural representation for physics-driven actuated soft bodies TOG 2022 Link
Differentiable solver for time-dependent deformation problems with contact TOG 2022 Link
Differentiable simulation of inertial musculotendons TOG 2022 Link
Contact-centric deformation learning TOG 2022 Link
Neuphysics: Editable neural geometry and physics from monocular videos NeurIPS 2022 Link
Neural Stress Fields for Reduced-order Elastoplasticity and Fracture Siggraph Asia 2023 Link
Neuwigs: A neural dynamic model for volumetric hair capture and animation CVPR 2023 Link
Learning Contact Deformations with General Collider Descriptors Siggraph Asia 2023 Link
Data-Free Learning of Reduced-Order Kinematics Siggraph 2023 Link
DiffVL: Scaling Up Soft Body Manipulation using Vision-Language Driven Differentiable Physics NeurIPS 2023 Link
LiCROM: Linear-Subspace Continuous Reduced Order Modeling with Neural Fields Siggraph Asia 2023 Link
Neural Metamaterial Networks for Nonlinear Material Design TOG 2023 Link
{PhysDreamer}: Physics-Based Interaction with 3D Objects via Video Generation Arxiv 2024 Link
ElastoGen: 4D Generative Elastodynamics Arxiv 2024 Link
Feature Splatting: Language-Driven Physics-Based Scene Synthesis and Editing Arxiv 2024 Link

Rigidbody

Name Info Link Label
MuJoCo: A physics engine for model-based control 2012 Link
PyBullet, a Python module for physics simulation for games, robotics and machine learning 2016–2021 Link
Shapestacks: Learning vision-based physical intuition for generalised object stacking ECCV 2018 Link
Drake: Model-based design and verification for robotics 2019 Link
Learning to fly: computational controller design for hybrid UAVs with reinforcement learning TOG 2019 Link
Rl-cyclegan: Reinforcement learning aware simulation-to-real CVPR 2020 Link
Use the force, luke! learning to predict physical forces by simulating effects CVPR 2020 Link
ADD: analytically differentiable dynamics for multi-body systems with frictional contact TOG 2020 Link
Efficient Differentiable Simulation of Articulated Bodies ICML 2021 Link
Brax - A Differentiable Physics Engine for Large Scale Rigid Body Simulation 2021 Link
Fast and Feature-Complete Differentiable Physics Engine for Articulated Rigid Bodies with Contact Constraints 2021 Link
The Role of Physics-Based Simulators in Robotics 2021 Link
Single-view robot pose and joint angle estimation via render \& compare CVPR 2021 Link
Dojo: A Differentiable Physics Engine for Robotics Arxiv 2022 Link
Learning physics constrained dynamics using autoencoders NeurIPS 2022 Link
Learning physical dynamics with subequivariant graph neural networks NeurIPS 2022 Link
Neural Collision Fields for Triangle Primitives Siggraph Asia 2023 Link
Vr-handnet: A visually and physically plausible hand manipulation system in virtual reality TVCG 2023 Link
DOC: Differentiable Optimal Control for Retargeting Motions onto Legged Robots TOG 2023 Link
An Extensible, Data-Oriented Architecture for High-Performance, Many-World Simulation TOG 2023 Link
Jade: A Differentiable Physics Engine for Articulated Rigid Bodies with Intersection-Free Frictional Contact ICRA 2024 Link

Multiphys

Name Info Link Label
Learning to simulate complex physics with graph networks ICML 2020 Link
Neural{S}im: Augmenting Differentiable Simulators with Neural Networks ICRA 2021 Link
NVIDIA SimNet{\texttrademark}: An AI-Accelerated Multi-Physics Simulation Framework 2021 Link
MPMNet: A data-driven MPM framework for dynamic fluid-solid interaction TVCG 2023 Link
Learning neural constitutive laws from motion observations for generalizable pde dynamics ICML 2023 Link
PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamics Arxiv 2023 Link
A generalized constitutive model for versatile mpm simulation and inverse learning with differentiable physics PACMCGIT 2023 Link
{PAC}-Ne{RF}: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identification ICLR 2023 Link
Dynamic mesh-aware radiance fields ICCV 2023 Link
Neural Physical Simulation with Multi-Resolution Hash Grid Encoding AAAI 2024 Link

Survey

Name Info Link Label
Machine learning for fluid mechanics 2020 Link
The Role of Physics-Based Simulators in Robotics 2021 Link
Data-driven simulation in fluids animation: A survey 2021 Link

Citation

If you find this repository helpful, please consider citing it!

@misc{wang2024awesomelist,
  title = {Awesome Neural Physics - A Curated List of Papers on AI Techniques for Physics Simulation in Computer Graphics},
  author = {Hui Wang},
  journal = {GitHub repository},
  url = {https://github.com/awesome-physics/awesome-neural-physics},
  year = {2023},
}