When you run the demo: python -m cmr.demo --name bird_net --num_train_epoch 500 --img_path cmr/demo_data/img1.jpg

I am getting this error:

/home/ubuntu/akshay/cmr/venv_cmr/local/lib/python2.7/site-packages/h5py/init.py:36: FutureWarning: Conversion of the second argument of issubdtype from float to np.floating is deprecated. In future, it will be treated as np.float64 == np.dtype(float).type. from ._conv import register_converters as _register_converters Setting up model.. loading /home/ubuntu/akshay/cmr/nnutils/../cachedir/snapshots/bird_net/pred_net_500.pth.. Traceback (most recent call last): File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main "main", fname, loader, pkg_name) File "/usr/lib/python2.7/runpy.py", line 72, in _run_code exec code in run_globals File "/home/ubuntu/akshay/cmr/demo.py", line 119, in app.run(main) File "/home/ubuntu/akshay/cmr/venv_cmr/local/lib/python2.7/site-packages/absl/app.py", line 274, in run _run_main(main, argv) File "/home/ubuntu/akshay/cmr/venv_cmr/local/lib/python2.7/site-packages/absl/app.py", line 238, in _run_main sys.exit(main(argv)) File "/home/ubuntu/akshay/cmr/demo.py", line 108, in main outputs = predictor.predict(batch) File "cmr/nnutils/predictor.py", line 110, in predict self.forward() File "cmr/nnutils/predictor.py", line 149, in forward self.cam_pred) File "cmr/nnutils/nmr.py", line 183, in forward return Render(self.renderer)(verts, faces) File "cmr/nnutils/nmr.py", line 114, in forward masks = self.renderer.forward_mask(vs, fs) File "cmr/nnutils/nmr.py", line 50, in forward_mask self.masks = self.renderer.render_silhouettes(self.vertices, self.faces) File "build/bdist.linux-x86_64/egg/neural_renderer/renderer.py", line 38, in render_silhouettes File "/home/ubuntu/akshay/cmr/venv_cmr/local/lib/python2.7/site-packages/chainer/functions/array/concat.py", line 90, in concat y, = Concat(axis).apply(xs) File "/home/ubuntu/akshay/cmr/venv_cmr/local/lib/python2.7/site-packages/chainer/function_node.py", line 245, in apply outputs = self.forward(in_data) File "/home/ubuntu/akshay/cmr/venv_cmr/local/lib/python2.7/site-packages/chainer/functions/array/concat.py", line 44, in forward return xp.concatenate(xs, self.axis), File "/home/ubuntu/akshay/cmr/venv_cmr/local/lib/python2.7/site-packages/cupy/manipulation/join.py", line 49, in concatenate return core.concatenate_method(tup, axis) File "cupy/core/core.pyx", line 2439, in cupy.core.core.concatenate_method File "cupy/core/core.pyx", line 2482, in cupy.core.core.concatenate_method File "cupy/core/core.pyx", line 2533, in cupy.core.core.concatenate File "cupy/core/core.pyx", line 1630, in cupy.core.core.ndarray.setitem File "cupy/core/core.pyx", line 3101, in cupy.core.core._scatter_op File "cupy/core/elementwise.pxi", line 823, in cupy.core.core.ufunc.call File "cupy/util.pyx", line 39, in cupy.util.memoize.decorator.ret File "cupy/core/elementwise.pxi", line 622, in cupy.core.core._get_ufunc_kernel File "cupy/core/elementwise.pxi", line 33, in cupy.core.core._get_simple_elementwise_kernel File "cupy/core/carray.pxi", line 170, in cupy.core.core.compile_with_cache File "/home/ubuntu/akshay/cmr/venv_cmr/local/lib/python2.7/site-packages/cupy/cuda/compiler.py", line 123, in compile_with_cache base = _preprocess('', options, arch) File "/home/ubuntu/akshay/cmr/venv_cmr/local/lib/python2.7/site-packages/cupy/cuda/compiler.py", line 86, in _preprocess result = prog.compile(options) File "/home/ubuntu/akshay/cmr/venv_cmr/local/lib/python2.7/site-packages/cupy/cuda/compiler.py", line 233, in compile raise CompileException(log, self.src, self.name, options) cupy.cuda.compiler.CompileException: nvrtc: error: failed to load builtins

I tried the solution mentioned in this: https://groups.google.com/forum/#!topic/chainer-jp/GKNe5KY_fm0 yet it is not working

As in the title. I have cuda version 9.0 and this is causing a lot of problems in installing cupy. I installed it seperately using "pip install cupy-cuda90", removed it from requirements.txt and then installed everything else. When I try to install the external repos, i.e, Perceptual Loss and Neural Renderer, I got this Traceback: Traceback (most recent call last): File "setup.py", line 3, in import neural_renderer File "/home/nsajjan/WORK/Capstone/cmr/external/neural_renderer/neural_renderer/init.py", line 1, in from cross import cross File "/home/nsajjan/WORK/Capstone/cmr/external/neural_renderer/neural_renderer/cross.py", line 2, in import cupy as cp File "/home/nsajjan/WORK/Capstone/cmr/venv_cmr/lib/python2.7/site-packages/cupy/init.py", line 7, in from cupy import _version ImportError: cannot import name _version

Any suggestions?

Hi, I'm a beginner in 3d reconstruction. It's a really impressive work! I'm now trying to implement it on PASCAL3D+ dataset, facing some problems on camera pose. I find PASCAL3D+ dataset offer cam_pose in azi/ele system for each picture and the perspective projection codes. I just wonder how did you process the dataset to match cmr?

1. Simply run SfM again, ignoring the ground-truth cam_pose provided by PASCAL3D+?
2. Calculate the scale/trans/rotation for PASCAL correspond to CUB dataset? But I don't know if it's ok because PASCAL is under perspective projection and CUB is under weak-perspective projection.
3. Rewrite python codes to project PASCAL using perspective camera? If I want to do this, I guess the main problem would be how to adjust neural renderer to match the projection.

I'd really appreciate it if you could offer any ideas/materials/codes in this. Thanks a lot!

Hi, When I tested the model using the snapshot provided, I got the below result

But when I trained the model while following the instructions provided, similar snapshot is not able to generate similar output

I checked with snapshots later in the training as well, similar output as above.

The only thing I have changed is that I ported the code to Torch 1.0 and had to make one small change: replace things like self.total_loss.data[0] with self.total_loss.item(). I am sure this is not the reason but just mentioned it for the sake of completion.

Could you suggest what might I be doing wrong ?

EDIT: The losses are way higher as compared to the loss_log I got when I downloaded the snapshot.

Professor Angjoo Kanazawa: I want to try to reconstruct the textured human body shape from a single image with your represent model.So,I want to ask you about whether it's feasible or not?Would you give me some suggestions about these?Thanks! @akanazawa @shubhtuls

Nice work! I've been working on a similar task, your code is clean and intuitive, a good start for the project.

But I struggle to set up the env. So I make some updates:

• upgrade support to Python3 Python 2 support ends today.

• upgrade to PyTorch 1.3 PyTorch 0.3 was like two years ago.

• Remove chainer/cupy dependancy. Setting up cupy is too complicated and now there is pytorch version neural renderer

The repo is in chenyuntc/cmr. I can make a pull request if you would like.

When I tried to download CUB annotation file by running: wget https://people.eecs.berkeley.edu/~shubhtuls/cachedir/cmr/cachedir.tar.gz I got 404 error. Is this file currently available for downloading?

Hi, thanks for sharing the code! I encountered the following error, and I am wondering how to solve this?

venv_cmr/local/lib/python2.7/site-packages/cupy/cuda/compiler.py", line 233, in compile
    raise CompileException(log, self.src, self.name, options)
cupy.cuda.compiler.CompileException: nvrtc: error: failed to load builtins

Hi, It seems the 'testval_cub_cleaned.mat' and 'train_cub_cleaned.mat' downloaded from https://people.eecs.berkeley.edu/~kanazawa/cachedir/cmr/cachedir.tar.gz are incomplete since they are 45 bytes only.

Thanks.

Thanks a lot for the great code.

I want to evaluate my model on CUB, but I notice the key point annotations are in mat format, and there is no such annotation in the CUB official site. So where can I download key point annotations?

I find that the link of annotation mat files is down. I found a temporary link of CUB in issue #7, but PASCAL's annotation is still not found. Would I find it in some other link? Thank you so much!

conda create -n cmr python=3
conda activate cmr
conda install pytorch torchvision -c pytorch
pip install -r requirements.txt

But I get many errors for almost all dependencies in requirements.txt starting with

h5py:

(cmr) [moldach@cedar5 cmr]$ pip install -r requirements.txt
Looking in links: /cvmfs/soft.computecanada.ca/custom/python/wheelhouse/nix/avx2, /cvmfs/soft.computecanada.ca/custom/python/wheelhouse/nix/generic, /cvmfs/soft.computecanada.ca/custom/python/wheelhouse/generic
Collecting absl-py
  Downloading absl_py-0.12.0-py3-none-any.whl (129 kB)
     |████████████████████████████████| 129 kB 10.4 MB/s 
Collecting Cython
  Downloading Cython-0.29.22-py2.py3-none-any.whl (980 kB)
     |████████████████████████████████| 980 kB 18.1 MB/s 
ERROR: Could not find a version that satisfies the requirement h5py
ERROR: No matching distribution found for h5py

Did you train the CMR on Pascal3D+ car and aeroplane together or separately? I noticed in DRC, you mentioned you train category-agnostic CNN, which means you train DRC on aeroplane and car together and you report DRC's 3D IoU on aeroplane and car test data, which are 0.42 and 0.67 separately. However, in this repo, the p3d dataloader only loads 'car'.

Hi, could you please tell me where is the code to calculate 3D IOU on Pascal 3D+ dataset (aero, car)? In my understanding, in order to calculate it, we have to voxelize the mesh first, right?

Hi Angjoo, I'm still trying to find a way to plot the bird demo as an interactive 3d visualization, similiar to projects like this. Have you maybe discussed to use plot_trisurf function from matplotlib in demo.py to do something similar?