I think is something wrong with the code, it can't read the image in the folder. After I change the code, there is no corresponding _info.mat : What the format of testing images should be? Thank you for your response.

When I run src/run/prepare_dataset.py, I encounter an error: FileNotFoundError: [Errno 2] No such file or directory: 'data/dataset/Extra_LP/all_image_data.pkl'

skip  data/dataset/300W_LP_crop/HELEN_Flip/HELEN_173153923_2_12
skip  data/dataset/300W_LP_crop/HELEN_Flip/HELEN_2236814888_2_3
skip  data/dataset/300W_LP_crop/IBUG_Flip/IBUG_image_018_5
skip  data/dataset/300W_LP_crop/LFPW/LFPW_image_train_0328_6
skip  data/dataset/300W_LP_crop/LFPW_Flip/LFPW_image_train_0380_3
skip  data/dataset/300W_LP_crop/landmarks/AFW
skip  data/dataset/300W_LP_crop/landmarks/HELEN
skip  data/dataset/300W_LP_crop/landmarks/IBUG
skip  data/dataset/300W_LP_crop/landmarks/LFPW
0 data added
saving data path list
data path list saved
0 data added
saving data path list
Traceback (most recent call last):
  File "src/run/prepare_dataset.py", line 19, in <module>
    train_dataset = make_dataset(TRAIN_DIR, 'train')
  File "./src/dataset/dataloader.py", line 217, in make_dataset
    raw_dataset.add_image_data(folder, mode)
  File "./src/dataset/dataloader.py", line 116, in add_image_data
    self.save_image_data_paths(all_data, data_dir)
  File "./src/dataset/dataloader.py", line 120, in save_image_data_paths
    ft = open(f'{data_dir}/all_image_data.pkl', 'wb')
FileNotFoundError: [Errno 2] No such file or directory: 'data/dataset/Extra_LP/all_image_data.pkl'
worker: 7 end 236/250  data/packs/AFLW2000/image00451.jpgLEN_2208472833_2_8.jpgpgg
worker: 3 end 230/15307  data/packs/300W_LP/HELEN/HELEN_2618147986_1_3.jpg.jpgpgpg
worker: 5 end 236/15307  data/packs/300W_LP/LFPW/LFPW_image_train_0304_13.jpgjpgg
worker: 1 end 242/15307  data/packs/300W_LP/IBUG_Flip/IBUG_image_030_3.jpgpg0.jpgg
worker: 4 end 245/250  data/packs/AFLW2000/image02453.jpgW_image_train_0731_3.jpg
worker: 0 end 239/15307  data/packs/300W_LP/HELEN/HELEN_248684423_1_12.jpg1_10.jpg
worker: 6 end 235/15301  data/packs/300W_LP/HELEN_Flip/HELEN_2419679570_1_5.jpg
worker: 2 end 245/15307  data/packs/300W_LP/HELEN/HELEN_2345048760_1_10.jpggjpgpg
worker: 6 end 15168/15307  data/packs/300W_LP/LFPW/LFPW_image_train_0476_15.jpgpgggg
worker: 0 end 15281/15301  data/packs/300W_LP/HELEN_Flip/HELEN_2466594504_1_9.jpgggg
worker: 5 end 15270/15307  data/packs/300W_LP/HELEN/HELEN_2882149940_1_6.jpg0.jpgg
worker: 1 end 15287/15301  data/packs/300W_LP/HELEN_Flip/HELEN_3026147764_1_11.jpg
worker: 7 end 15272/15307  data/packs/300W_LP/HELEN/HELEN_111835766_1_16.jpgjpgpgg
worker: 2 end 15259/15307  data/packs/300W_LP/LFPW/LFPW_image_train_0741_0.jpgg
worker: 3 end 15270/15307  data/packs/300W_LP/LFPW/LFPW_image_train_0051_4.jpgg
worker: 4 end 15306/15307  data/packs/300W_LP/LFPW/LFPW_image_train_0382_5.jpgg

My question is what is Extra_LP? Is it a dataset? It is not mentioned in the readme.md nor the paper. And where should I get the Extra_LP/all_image_data.pkl ?

Another problem is after I run src/run/prepare_dataset.py, I find SADRNet/data/dataset/train_blocks is generated, but it is empty. Is it correct? Or I missed something?

When I run src/run/predict.py thanks

folders= 1
dirs= data/example
dirs= ['image00354', 'image00357', 'image00351', 'image00355', 'image00359', 'image00350', 'image00352']
7dirs= []
dirs= []
dirs= []
dirs= []
dirs= []
dirs= []
dirs= []
7 data added
saving data path list
data path list saved
get data 7
 11 7
Traceback (most recent call last):
  File "src/run/predict.py", line 246, in <module>
    evaluator.evaluate_example(predictor_1)
  File "src/run/predict.py", line 223, in evaluate_example
    out = predictor.model({'img': image}, 'predict')
  File "/root/anaconda/envs/ai/lib/python3.7/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
    result = self.forward(*input, **kwargs)
  File "./src/model/SADRNv2.py", line 98, in forward
    x = self.block1(x)
  File "/root/anaconda/envs/ai/lib/python3.7/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
    result = self.forward(*input, **kwargs)
  File "./src/model/modules.py", line 540, in forward
    out += identity
RuntimeError: The size of tensor a (129) must match the size of tensor b (128) at non-singleton dimension 3

Thanks for your great work! When I run src/run/predirct.py, it pointed out No module named 'config'. Should I set the working directory ? My current working directory is already SADRN.

Thanks for your great work!!!

During the process of data augmentation, especially for the occlusion augmentation, I find that the whole face region in the image would be occluded for its random character. I want to know your operation on these ill images. Maybe just delete these images? Or others?

Hope for your reply! Thanks again!

When I run the python src/run/train_block_data.py command, the following error is reported. How can I solve it?

note: UV_TRIANGLES_PATH = '../data/uv_data/uv_triangles.npy' exists.

Traceback (most recent call last):
  File "src/run/train_block_data.py", line 343, in <module>
    trainer = SADRNv2Trainer()
  File "src/run/train_block_data.py", line 319, in __init__
    super(SADRNTrainer, self).__init__()
  File "src/run/train_block_data.py", line 122, in __init__
    self.model = self.get_model()
  File "src/run/train_block_data.py", line 325, in get_model
    from src.model.SADRNv2 import get_model
  File "/media/bangyanhe/disk/SADRNet-main/src/model/SADRNv2.py", line 2, in <module>
    from src.model.loss import *
  File "/media/bangyanhe/disk/SADRNet-main/src/model/loss.py", line 7, in <module>
    from src.dataset.uv_face import face_mask_np, face_mask_fix_rate, foreface_ind, uv_kpt_ind, uv_edges, uv_triangles
ImportError: cannot import name 'uv_triangles'

Hi, Thanks a lot for sharing the code and the pre-trained model of your awesome paper. Really appreciated.

We tried to load and test the pre-trained model, but we face this error: Unexpected tensor shape for one of the building blocks, class ResBlock4(nn.Module)..

It seems that there was an update for the Conv layers after version 1.4 (https://discuss.pytorch.org/t/did-conv2d-shapes-change-between-torch-1-4-0-and-1-6-0/93859).

I like to ask whether you can share with us a new pre-trained model that trained with Pytorch version > 1.4 ?

Thanks, Amin

Thanks for sharing this project. As mentioned in the paper

we choose the face region containing 19K points

I am interested in extracting point cloud and use CPD to skin displacement. Can you point me to location to extract these point clouds?

Thanks

To compute RecLoss, why do you compute outer_interocular_dist? https://github.com/MCG-NJU/SADRNet/blob/a5e6fac904c66711a6e9457fc603bd7b6d348d21/src/model/loss.py#L353-L359

Why do not you use bbox_size in KptNME2D directly? https://github.com/MCG-NJU/SADRNet/blob/a5e6fac904c66711a6e9457fc603bd7b6d348d21/src/model/loss.py#L255-L260

POSMAP_FIX_RATE OFFSET_FIX_RATE: https://github.com/MCG-NJU/SADRNet/blob/8c0741713bd2ae5c66506659a5b0ae5c99cacc9a/src/configs/config_SADRN_v2_eval.py#L3-L4

NME.rate: https://github.com/MCG-NJU/SADRNet/blob/a5e6fac904c66711a6e9457fc603bd7b6d348d21/src/model/loss.py#L67-L69

Hey guys

Thanks for sharing your work and releasing the code. However officially you would need to add a license to allow people to use your code or to build upon it for academic/industrial research.

You can probably add Apache-2.0 License like the mmediting (https://github.com/open-mmlab/mmediting) or BSD License like pix2pixHD (https://github.com/NVIDIA/pix2pixHD) or anything else

Do you plan to add a License to your code?

raceback (most recent call last): File "src/run/predict.py", line 22, in from src.visualize.render_mesh import render_uvm #render_face_orthographic, File "/workspace/SADRNet/./src/visualize/render_mesh.py", line 16, in r = pyrender.OffscreenRenderer(CROPPED_IMAGE_SIZE, CROPPED_IMAGE_SIZE) File "/usr/local/lib/python3.8/dist-packages/pyrender/offscreen.py", line 31, in init self._create() File "/usr/local/lib/python3.8/dist-packages/pyrender/offscreen.py", line 134, in _create self._platform.init_context() File "/usr/local/lib/python3.8/dist-packages/pyrender/platforms/osmesa.py", line 19, in init_context from OpenGL.osmesa import ( ImportError: cannot import name 'OSMesaCreateContextAttribs' from 'OpenGL.osmesa' (/usr/local/lib/python3.8/dist-packages/OpenGL/osmesa/init.py)