A curated list of awesome neural radiance fields papers

Related tags

Deep Learning nerf
Overview

Awesome Neural Radiance Fields Awesome

A curated list of awesome neural radiance fields papers, inspired by awesome-computer-vision.

How to submit a pull request?

Table of Contents

Survey

Papers

Faster Inference

Faster Training

Unconstrained Images

Deformable

Video

Generalization

Pose Estimation

Lighting

Compositionality

Scene Labelling and Understanding

Editing

Object Category Modeling

Multi-scale

Model Reconstruction

Depth Estimation

Talks

Implementations

Tensorflow

PyTorch

Jax

License

MIT

Comments
  • Plan to implement NeRF-W

    Plan to implement NeRF-W

    Hi, I recently started implementing NeRF-W, and my experiment (on the lego dataset, section D) seems working successfully: https://github.com/kwea123/nerf_pl/blob/nerfw/test_nerfu_occ.ipynb

    Currently I only tested NeRF-U with occluders, the code is ready for other experiments, I just need some more time to run all the trainings.

    My branch: https://github.com/kwea123/nerf_pl/tree/nerfw

    It would be great if you can include this as a reference source to NeRF-W, as it seems that they won't publish the code ~~(and the data)~~.

    Update: NeRF-A with color perturbation also passed. https://github.com/kwea123/nerf_pl/blob/nerfw/test_nerfa_color.ipynb

    Update: NeRF-W with color perturbation & occluder passed. https://github.com/kwea123/nerf_pl/blob/nerfw/test_nerfw_all.ipynb

    These experiments should be enough to demonstrate that the implementation is almost correct.

    opened by kwea123 8
  • Add NeRF--

    Add NeRF--

    opened by mwtarnowski 7
  • Add a few works and a category of Model Reconstruction

    Add a few works and a category of Model Reconstruction

    Works:

    • BARF: Bundle-Adjusting Neural Radiance Fields
    • Dynamic View Synthesis from Dynamic Monocular Video
    • Light Field Networks: Neural Scene Representations with Single-Evaluation Rendering
    • NeRF-Tex: Neural Reflectance Field Textures
    • Neural Rays for Occlusion-aware Image-based Rendering
    • SRF (Stereo Radiance Fields (SRF): Learning View Synthesis from Sparse Views of Novel Scenes)
    • ST-NeRF (Editable free-viewpoint video using a layered neural representation)
    • UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction
    • UORF (Unsupervised Discovery of Object Radiance Fields)

    Category:

    • Model Reconstruction
    opened by csvt32745 6
  • Added DONeRF project page and bibtex.

    Added DONeRF project page and bibtex.

    opened by thomasneff 6
  • Added Pytorch3D implementation by facebook

    Added Pytorch3D implementation by facebook

    opened by arnabdeypolimi 6
  • Add nerf-atlas implementation

    Add nerf-atlas implementation

    opened by JulianKnodt 5
  • Find a new maintainer and transfer the repo?

    Find a new maintainer and transfer the repo?

    There's some good PRs but no updates in several months.

    I volunteer to be a temporary custodian if it moves things forward but I'm sure there are better qualified people who would be happy to take over.

    opened by andybak 4
  • Add 4D Facial Avatars

    Add 4D Facial Avatars

    Hey, Thanks for maintaining this great repo. Would be great if you added 'Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction'

    https://arxiv.org/pdf/2012.03065

    opened by gafniguy 4
  • Add Visu3d to the tools

    Add Visu3d to the tools

    Visu3d is a library to help build Nerf-like ML models (in TF, Jax and Numpy). Among things, it includes differentiable camera/rays primitives, Dataclass manipulable as numpy arrays,...

    The goal is to allow downstream ML research codebase to avoid re-implementing the same set of primitives and facilitate interoperability across codebases.

    opened by Conchylicultor 3
  • Wrong author info

    Wrong author info

    opened by jeongyw12382 3
  • Add CoNeRF

    Add CoNeRF

    opened by pixel-alex 3
  • adding nan: noise aware nerf

    adding nan: noise aware nerf

    opened by NaamaPearl 1
  • add pix2nerf and ICARUS

    add pix2nerf and ICARUS

    Pull requests

    1. add Pix2NeRF: Unsupervised Conditional π-GAN for Single Image to Neural Radiance Fields Translation in Generalization
    2. add ICARUS: A Lightweight Neural Plenoptic Rendering Architecture in fast training
    opened by Yuqifan1117 1
Owner
Yen-Chen Lin
PhD student at MIT CSAIL
Yen-Chen Lin
A curated list of awesome resources related to Semantic Search🔎 and Semantic Similarity tasks.

A curated list of awesome resources related to Semantic Search?? and Semantic Similarity tasks.

null 224 Jan 4, 2023
This is the code for Deformable Neural Radiance Fields, a.k.a. Nerfies.

Deformable Neural Radiance Fields This is the code for Deformable Neural Radiance Fields, a.k.a. Nerfies. Project Page Paper Video This codebase conta

Google 1k Jan 9, 2023
Open source repository for the code accompanying the paper 'Non-Rigid Neural Radiance Fields Reconstruction and Novel View Synthesis of a Deforming Scene from Monocular Video'.

Non-Rigid Neural Radiance Fields This is the official repository for the project "Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synt

Facebook Research 296 Dec 29, 2022
(Arxiv 2021) NeRF--: Neural Radiance Fields Without Known Camera Parameters

NeRF--: Neural Radiance Fields Without Known Camera Parameters Project Page | Arxiv | Colab Notebook | Data Zirui Wang¹, Shangzhe Wu², Weidi Xie², Min

Active Vision Laboratory 411 Dec 26, 2022
Unofficial & improved implementation of NeRF--: Neural Radiance Fields Without Known Camera Parameters

[Unofficial code-base] NeRF--: Neural Radiance Fields Without Known Camera Parameters [ Project | Paper | Official code base ] ⬅️ Thanks the original

Jianfei Guo 239 Dec 22, 2022
Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields.

This repository contains the code release for Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields. This implementation is written in JAX, and is a fork of Google's JaxNeRF implementation. Contact Jon Barron if you encounter any issues.

Google 625 Dec 30, 2022
Code for KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs

KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs Check out the paper on arXiv: https://arxiv.org/abs/2103.13744 This repo cont

Christian Reiser 373 Dec 20, 2022
This repository contains a PyTorch implementation of "AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis".

AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis | Project Page | Paper | PyTorch implementation for the paper "AD-NeRF: Audio

null 551 Dec 29, 2022
Code release for DS-NeRF (Depth-supervised Neural Radiance Fields)

Depth-supervised NeRF: Fewer Views and Faster Training for Free Project | Paper | YouTube Pytorch implementation of our method for learning neural rad

null 524 Jan 8, 2023
PyTorch implementation for MINE: Continuous-Depth MPI with Neural Radiance Fields

MINE: Continuous-Depth MPI with Neural Radiance Fields Project Page | Video PyTorch implementation for our ICCV 2021 paper. MINE: Towards Continuous D

Zijian Feng 325 Dec 29, 2022
This repository contains the source code for the paper "DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networks",

DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networks Project Page | Video | Presentation | Paper | Data L

Facebook Research 281 Dec 22, 2022
BARF: Bundle-Adjusting Neural Radiance Fields 🤮 (ICCV 2021 oral)

BARF ?? : Bundle-Adjusting Neural Radiance Fields Chen-Hsuan Lin, Wei-Chiu Ma, Antonio Torralba, and Simon Lucey IEEE International Conference on Comp

Chen-Hsuan Lin 539 Dec 28, 2022
[ICCV21] Self-Calibrating Neural Radiance Fields

Self-Calibrating Neural Radiance Fields, ICCV, 2021 Project Page | Paper | Video Author Information Yoonwoo Jeong [Google Scholar] Seokjun Ahn [Google

null 381 Dec 30, 2022
[ICCV 2021 Oral] NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereo

NerfingMVS Project Page | Paper | Video | Data NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereo Yi Wei, Shaohui

Yi Wei 369 Dec 24, 2022
This is the code for "HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields".

HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields This is the code for "HyperNeRF: A Higher-Dimensional

Google 702 Jan 2, 2023
A PyTorch implementation of NeRF (Neural Radiance Fields) that reproduces the results.

NeRF-pytorch NeRF (Neural Radiance Fields) is a method that achieves state-of-the-art results for synthesizing novel views of complex scenes. Here are

Yen-Chen Lin 3.2k Jan 8, 2023
pixelNeRF: Neural Radiance Fields from One or Few Images

pixelNeRF: Neural Radiance Fields from One or Few Images Alex Yu, Vickie Ye, Matthew Tancik, Angjoo Kanazawa UC Berkeley arXiv: http://arxiv.org/abs/2

Alex Yu 1k Jan 4, 2023
D-NeRF: Neural Radiance Fields for Dynamic Scenes

D-NeRF: Neural Radiance Fields for Dynamic Scenes [Project] [Paper] D-NeRF is a method for synthesizing novel views, at an arbitrary point in time, of

Albert Pumarola 291 Jan 2, 2023
Code release for NeRF (Neural Radiance Fields)

NeRF: Neural Radiance Fields Project Page | Video | Paper | Data Tensorflow implementation of optimizing a neural representation for a single scene an

null 6.5k Jan 1, 2023