implicit displacement field

Related tags

Deep Learning idf
Overview

Geometry-Consistent Neural Shape Representation with Implicit Displacement Fields

[project page][paper][cite]

overview

overview video

demos

cuda 11.1 and pytorch 3.8

preparations

git clone https://github.com/yifita/idf.git
cd idf

# conda environment and dependencies
# update conda
conda update -n base -c defaults conda
# install requirements
conda env create --name idf -f environment.yml
conda activate idf

# download data. This will download 8 mesh and point clouds to data/benchmark_shapes
sh data/get_data.sh

surface reconstruction

# surface reconstruction from point cloud
# replace {asian_dragon} with another model name inside the benchmark_shape folder
python net/classes/runner.py net/experiments/displacement_benchmark/ablation/ablation_phased_scaledTanh_yes_act_yes_baseLoss_yes.json --name asian_dragon

detail transfer

This example uses provided base shapes

sh data/get_dt_shapes.sh
python net/classes/runner.py net/experiments/displacement_benchmark/transfer/shorts_2phase.json

bibtex

@misc{yifan2021geometryconsistent,
      title={Geometry-Consistent Neural Shape Representation with Implicit Displacement Fields},
      author={Wang Yifan and Lukas Rahmann and Olga Sorkine-Hornung},
      year={2021},
      eprint={2106.05187},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}
Comments
  • Could not find 'net/experiments/transfer/exec.json'

    Could not find 'net/experiments/transfer/exec.json'

    Thanks for your great work and excellent open-source code!

    However, when I try to train the base shapes for the source and target shapes, I could not find the file named 'net/experiments/transfer/exec.json'. Has it been added in the repository?

    Thanks!

    opened by RainbowRui 1
  • Directly rendering the IDF

    Directly rendering the IDF

    Thanks for your work! Maybe I overlooked it, but I didn't find any code for rendering the IDF (e.g. by means of sphere tracing). Are you planning to provide such code for rendering the IDF directly, because the images in your paper (where you compare to other work) seem to display such direct renderings.

    opened by coledea 1
  • Data scripts

    Data scripts

    Hi @yifita!

    Thanks a lot for this exiting work!

    I wanted to mention a minor thing with the data download scripts. I ended up running both data/gen_data.sh and the data/get_dt_shapes.sh. Maybe we could combine both into one single one for clarity, right?

    Thanks again for sharing the code!!

    opened by pablopalafox 1
  • benchmark shapes

    benchmark shapes

    Hi Yifan,

    IDF is an excellent work and I want to use it as the baseline for my research. However, I download the benchmark_shapes.zip and it does not contain all the shapes that you use in your paper. I know maybe several models are limited by the copyright. For your convenience, would you mind share the link to download these shapes and preprocessing code for your IDF? Very thanks for your help.

    opened by wangjingbo1219 0
  • Then JSON file for detail transfer seems not correct

    Then JSON file for detail transfer seems not correct

    Hi, Thanks for open-sourcing this awesome work! I tried to train the detail transfer network by using the command in the Readme

    python net/classes/executor.py net/experiments/transfer/exec.json

    But the extracted plys are empty with only one vertex. It seems the JSON file is not correct. Could you please upload the JSON file used for the experiment in the paper? Any help is appreciated.

    opened by iris112358 1
  • How to train a network with other shapes

    How to train a network with other shapes

    Hi,

    First thank you for presenting this amazing work! Now I want to train the network with shapes which are not the benchmark shapes. Can you please share some instructions to do so?

    Thanks

    opened by zhijieW94 1
  • Question about large memory usage when calculating chamfer distance with KDTree

    Question about large memory usage when calculating chamfer distance with KDTree

    When we try to reproduce the experiment result, it seems we have a peak memory usage when trying to calculate chamfer distance with KDTree. We are using a mesh ~2M with ~50k vertices, but get ~250G memory usage for this and cause a out of memory issue. Is this an expected behavior? WechatIMG454

    Thanks again for your help!

    opened by dc3505 0
  • Is it possible to provide with the experiment setup for nglod?

    Is it possible to provide with the experiment setup for nglod?

    Thanks so much for sharing this! Just want to see if it is possible to also have the experiment setting for nglod so that we can reproduce the result~

    Thanks in advance!

    opened by dc3505 0
Owner
Yifan Wang
PhD student @ ETH Zurich
Yifan Wang
GitHub
Dewarping Document Image By Displacement Flow Estimation with Fully Convolutional Network

Dewarping Document Image By Displacement Flow Estimation with Fully Convolutional Network

null 39 Aug 2, 2021
High performance, easy-to-use, and scalable machine learning (ML) package, including linear model (LR), factorization machines (FM), and field-aware factorization machines (FFM) for Python and CLI interface.

What is xLearn? xLearn is a high performance, easy-to-use, and scalable machine learning package that contains linear model (LR), factorization machin

Chao Ma 3k Jan 3, 2023
High performance, easy-to-use, and scalable machine learning (ML) package, including linear model (LR), factorization machines (FM), and field-aware factorization machines (FFM) for Python and CLI interface.

What is xLearn? xLearn is a high performance, easy-to-use, and scalable machine learning package that contains linear model (LR), factorization machin

Chao Ma 2.8k Feb 12, 2021
Code for Transformers Solve Limited Receptive Field for Monocular Depth Prediction

Official PyTorch code for Transformers Solve Limited Receptive Field for Monocular Depth Prediction. Guanglei Yang, Hao Tang, Mingli Ding, Nicu Sebe,

stanley 152 Dec 16, 2022
CPF: Learning a Contact Potential Field to Model the Hand-object Interaction

Contact Potential Field This repo contains model, demo, and test codes of our paper: CPF: Learning a Contact Potential Field to Model the Hand-object

Lixin YANG 99 Dec 26, 2022
Editing a Conditional Radiance Field

Editing Conditional Radiance Fields Project | Paper | Video | Demo Editing Conditional Radiance Fields Steven Liu, Xiuming Zhang, Zhoutong Zhang, Rich

Steven Liu 216 Dec 30, 2022
Cancer metastasis detection with neural conditional random field (NCRF)

NCRF Prerequisites Data Whole slide images Annotations Patch images Model Training Testing Tissue mask Probability map Tumor localization FROC evaluat

Baidu Research 731 Jan 1, 2023
PyTorch Implementation of "Light Field Image Super-Resolution with Transformers"

LFT PyTorch implementation of "Light Field Image Super-Resolution with Transformers", arXiv 2021. [pdf]. Contributions: We make the first attempt to a

Squidward 62 Nov 28, 2022
RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matching

RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matching This repository contains the source code for our paper: RAFT-Stereo: Multilevel

Princeton Vision & Learning Lab 328 Jan 9, 2023
GRF: Learning a General Radiance Field for 3D Representation and Rendering

GRF: Learning a General Radiance Field for 3D Representation and Rendering [Paper] [Video] GRF: Learning a General Radiance Field for 3D Representatio

Alex Trevithick 243 Dec 29, 2022
PN-Net a neural field-based framework for depth estimation from single-view RGB images.

PN-Net We present a neural field-based framework for depth estimation from single-view RGB images. Rather than representing a 2D depth map as a single

null 1 Oct 2, 2021
Code for sound field predictions in domains with impedance boundaries. Used for generating results from the paper

Code for sound field predictions in domains with impedance boundaries. Used for generating results from the paper

DTU Acoustic Technology Group 11 Dec 17, 2022
Code release for Local Light Field Fusion at SIGGRAPH 2019

Local Light Field Fusion Project | Video | Paper Tensorflow implementation for novel view synthesis from sparse input images. Local Light Field Fusion

null 1.1k Dec 27, 2022
Code release for Local Light Field Fusion at SIGGRAPH 2019

Local Light Field Fusion Project | Video | Paper Tensorflow implementation for novel view synthesis from sparse input images. Local Light Field Fusion

null 748 Nov 27, 2021
Receptive Field Block Net for Accurate and Fast Object Detection, ECCV 2018

Receptive Field Block Net for Accurate and Fast Object Detection By Songtao Liu, Di Huang, Yunhong Wang Updatas (2021/07/23): YOLOX is here!, stronger

Liu Songtao 1.4k Dec 21, 2022
TUPÃ was developed to analyze electric field properties in molecular simulations

TUPÃ: Electric field analyses for molecular simulations What is TUPÃ? TUPÃ (pronounced as tu-pan) is a python algorithm that employs MDAnalysis engine

Marcelo D. Polêto 10 Jul 17, 2022
This is the official implementation code repository of Underwater Light Field Retention : Neural Rendering for Underwater Imaging (Accepted by CVPR Workshop2022 NTIRE)

Underwater Light Field Retention : Neural Rendering for Underwater Imaging (UWNR) (Accepted by CVPR Workshop2022 NTIRE) Authors: Tian Ye†, Sixiang Che

jmucsx 17 Dec 14, 2022
Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network)

Deep Daze mist over green hills shattered plates on the grass cosmic love and attention a time traveler in the crowd life during the plague meditative

Phil Wang 4.4k Jan 3, 2023
Learning Continuous Image Representation with Local Implicit Image Function

LIIF This repository contains the official implementation for LIIF introduced in the following paper: Learning Continuous Image Representation with Lo

Yinbo Chen 1k Dec 25, 2022