Code for paper Novel View Synthesis via Depth-guided Skip Connections

Last update: Mar 14, 2022

Related tags

Deep Learning warped-skipconnection-nvs

Overview

Novel View Synthesis via Depth-guided Skip Connections

Code for paper Novel View Synthesis via Depth-guided Skip Connections

@InProceedings{Hou_2021_WACV,
    author    = {Hou, Yuxin and Solin, Arno and Kannala, Juho},
    title     = {Novel View Synthesis via Depth-Guided Skip Connections},
    booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
    month     = {January},
    year      = {2021},
    pages     = {3119-3128}
}

Data

Download the dataset from the Google Drive provided by [1] and unzip the dataset under ./datasets/ folder.

Download the evaluation list files from the Google Drive. Put the corresponding file under corresponding dataset folder. E.g. ./datasets/dataset_kitti/eval_kitti.txt.

Training

python train.py\
    --name chair\
    --category chair\
    --niter 2000\
    --niter_decay 2000\
    --save_epoch_freq 100\
    --random_elevation\
    --lr 1e-4

If you don't want to view the real-time results, you can add command --display_id 0

If you want to view training results and loss plots, run python -m visdom.server and click the URL http://localhost:8097.

Testing

Download our pre-trained model from our Google Drive To evaluate the performance, run

python eval.py\
    --name chair\
    --category chair\
    --checkpoints_dir checkpoints\ 
    --which_epoch best

Acknowledgments

The code is based on the source code of the paper:

[1] Chen, Xu and Song, Jie and Hilliges, Otmar (2019). Monocular Neural Image-based Rendering with Continuous View Control. In: International Conference on Computer Vision (ICCV). (https://github.com/xuchen-ethz/continuous_view_synthesis),

The implemention of Video Depth Estimation by Fusing Flow-to-Depth Proposals

Flow-to-depth (FDNet) video-depth-estimation This is the implementation of paper Video Depth Estimation by Fusing Flow-to-Depth Proposals Jiaxin Xie,

32 Jun 14, 2022

Monocular Depth Estimation Using Laplacian Pyramid-Based Depth Residuals

LapDepth-release This repository is a Pytorch implementation of the paper "Monocular Depth Estimation Using Laplacian Pyramid-Based Depth Residuals" M

205 Dec 30, 2022

Beyond Image to Depth: Improving Depth Prediction using Echoes (CVPR 2021)

Beyond Image to Depth: Improving Depth Prediction using Echoes (CVPR 2021) Kranti Kumar Parida, Siddharth Srivastava, Gaurav Sharma. We address the pr

33 Jun 27, 2022

Python script for performing depth completion from sparse depth and rgb images using the msg_chn_wacv20. model in ONNX

ONNX msg_chn_wacv20 depth completion Python script for performing depth completion from sparse depth and rgb images using the msg_chn_wacv20 model in

19 Oct 22, 2022

Python script for performing depth completion from sparse depth and rgb images using the msg_chn_wacv20. model in Tensorflow Lite.

TFLite-msg_chn_wacv20-depth-completion Python script for performing depth completion from sparse depth and rgb images using the msg_chn_wacv20. model

2 Oct 4, 2021

Light-weight network, depth estimation, knowledge distillation, real-time depth estimation, auxiliary data.

Comments

depth map

Hello, I would like to ask how to save the depth map, I have added the following content in the code, but the image is all black. Thank you!

img_numpy = util.tensor2depthim(self.depth_b.detach()) image_pil = Image.fromarray(img_numpy) image_pil.save(source_name)

opened by 04lm40 0

Code for paper Novel View Synthesis via Depth-guided Skip Connections

Related tags

Overview

Novel View Synthesis via Depth-guided Skip Connections

Data

Training

Testing

Acknowledgments

You might also like...

The implemention of Video Depth Estimation by Fusing Flow-to-Depth Proposals

Monocular Depth Estimation Using Laplacian Pyramid-Based Depth Residuals

Beyond Image to Depth: Improving Depth Prediction using Echoes (CVPR 2021)

Python script for performing depth completion from sparse depth and rgb images using the msg_chn_wacv20. model in ONNX

Python script for performing depth completion from sparse depth and rgb images using the msg_chn_wacv20. model in Tensorflow Lite.

Light-weight network, depth estimation, knowledge distillation, real-time depth estimation, auxiliary data.

Data-depth-inference - Data depth inference with python

ICRA 2021 "Towards Precise and Efficient Image Guided Depth Completion"

[ACM MM 2021] Joint Implicit Image Function for Guided Depth Super-Resolution

Comments

depth map

Owner

Cross-modal Deep Face Normals with Deactivable Skip Connections

Open source repository for the code accompanying the paper 'Non-Rigid Neural Radiance Fields Reconstruction and Novel View Synthesis of a Deforming Scene from Monocular Video'.

Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenes

Implementation of "Generalizable Neural Performer: Learning Robust Radiance Fields for Human Novel View Synthesis"

Aerial Single-View Depth Completion with Image-Guided Uncertainty Estimation (RA-L/ICRA 2020)

Blender add-on: Add to Cameras menu: View → Camera, View → Add Camera, Camera → View, Previous Camera, Next Camera

Code for 'Self-Guided and Cross-Guided Learning for Few-shot segmentation. (CVPR' 2021)'

[CVPR'21] Projecting Your View Attentively: Monocular Road Scene Layout Estimation via Cross-view Transformation

MVGCN: a novel multi-view graph convolutional network (MVGCN) framework for link prediction in biomedical bipartite networks.

Monocular Depth Estimation - Weighted-average prediction from multiple pre-trained depth estimation models