Neural Material
Official code repository for the paper:
Generative Modelling of BRDF Textures from Flash Images [SIGGRAPH Asia, 2021]
Henzler, Deschaintre, J. Mitra, Ritschel
[Paper] [Project page]
Data
The dataset is stored under flash_images
and contains 306 train folders and 116 test folders (including images from Aitalla et al).
Install dependencies
conda create -n neuralmaterial python=3.8
conda activate neuralmaterial
pip install hydra-core --upgrade
pip install tqdm
conda install pytorch==1.7.1 torchvision==0.8.2 cudatoolkit=10.1 -c pytorch
Training
For training please run
python scripts/train.py
The default config is located at config/config_default.yaml
.
Inference
Note, flash_images/test
and
trainings/
folder.
Synthesis
In order to synthesise given flash images located in the test
folder please run
python scripts/test.py --model
--test_image_id
--finetune
Interpolation
Given two images for interpolation please run
python scripts/interpolate.py --model
--weights1
--weights2
--test_image_id1
--test_image_id2
If you would like to use fine-tuned weights please run the scripts/test.py
command above in order to retrieve them.
Examples
Run the file run_examples.sh
to synthesise / interpolate a few examples.
Citation
If you find our work useful in your research, please cite:
@article{henzler2021neuralmaterial,
title={Generative Modelling of BRDF Textures from Flash Images},
author={Henzler, Philipp and Deschaintre, Valentin and Mitra, Niloy J and Ritschel, Tobias},
journal={ACM Trans Graph (Proc. SIGGRAPH Asia)},
year={2021},
volume={40},
number={6},
}
Contact
If you have any questions, please email Philipp Henzler at [email protected].