By running given following command with code on the main
branch:
python test.py --alpha 0.05 --backbone fcn-resnet101 --ckp_name assets/model/mmnet_fcnresnet101_spair.pth --resize 224,320 --benchmark spair
I expect to get the reported accuracy in the Table.2 of paper, i.e. 50.4
"all" accuracy, or spair with fcn-resnet101 backbone([email protected]:46.6%):
as noted in the README.md file.
However I get the following output, finding nowhere the related results. Can you point out the steps to reproduce the test accuracy?
2021-11-19 00:49:54,452 - INFO - Options listed below:----------------
2021-11-19 00:49:54,452 - INFO - name: framework_train
2021-11-19 00:49:54,453 - INFO - benchmark: spair
2021-11-19 00:49:54,453 - INFO - thresh_type: auto
2021-11-19 00:49:54,454 - INFO - backbone_name: fcn-resnet101
2021-11-19 00:49:54,455 - INFO - ms_rate: 4
2021-11-19 00:49:54,455 - INFO - feature_channel: 21
2021-11-19 00:49:54,456 - INFO - batch: 5
2021-11-19 00:49:54,456 - INFO - gpu: 0
2021-11-19 00:49:54,457 - INFO - data_path: /data/SC_Dataset
2021-11-19 00:49:54,457 - INFO - ckp_path: ./checkpoints_debug
2021-11-19 00:49:54,458 - INFO - visualization_path: visualization
2021-11-19 00:49:54,458 - INFO - model_type: MMNet
2021-11-19 00:49:54,459 - INFO - ckp_name: assets/model/mmnet_fcnresnet101_spair.pth
2021-11-19 00:49:54,459 - INFO - log_path: ./logs/
2021-11-19 00:49:54,460 - INFO - resize: 224,320
2021-11-19 00:49:54,460 - INFO - max_kps_num: 50
2021-11-19 00:49:54,461 - INFO - split_type: test
2021-11-19 00:49:54,461 - INFO - alpha: 0.05
2021-11-19 00:49:54,462 - INFO - resolution: 2
2021-11-19 00:49:54,462 - INFO - Options all listed.------------------
2021-11-19 00:49:54,463 - INFO - ckp file: assets/model/mmnet_fcnresnet101_spair.pth
2021-11-19 00:50:04,950 - INFO - [ 0/12234]: [Pair PCK: 0.333] [Average: 0.333] aeroplane
2021-11-19 00:50:04,953 - INFO - [ 1/12234]: [Pair PCK: 0.100] [Average: 0.217] aeroplane
2021-11-19 00:50:04,956 - INFO - [ 2/12234]: [Pair PCK: 0.308] [Average: 0.247] aeroplane
2021-11-19 00:50:04,958 - INFO - [ 3/12234]: [Pair PCK: 0.364] [Average: 0.276] aeroplane
2021-11-19 00:50:04,960 - INFO - [ 4/12234]: [Pair PCK: 0.000] [Average: 0.221] aeroplane
2021-11-19 00:50:05,575 - INFO - [ 5/12234]: [Pair PCK: 0.200] [Average: 0.217] aeroplane
2021-11-19 00:50:05,577 - INFO - [ 6/12234]: [Pair PCK: 0.250] [Average: 0.222] aeroplane
2021-11-19 00:50:05,580 - INFO - [ 7/12234]: [Pair PCK: 0.308] [Average: 0.233] aeroplane
2021-11-19 00:50:05,583 - INFO - [ 8/12234]: [Pair PCK: 0.182] [Average: 0.227] aeroplane
2021-11-19 00:50:05,585 - INFO - [ 9/12234]: [Pair PCK: 0.636] [Average: 0.268] aeroplane
2021-11-19 00:50:06,153 - INFO - [ 10/12234]: [Pair PCK: 0.667] [Average: 0.304] aeroplane
2021-11-19 00:50:06,156 - INFO - [ 11/12234]: [Pair PCK: 0.385] [Average: 0.311] aeroplane
2021-11-19 00:50:06,158 - INFO - [ 12/12234]: [Pair PCK: 0.455] [Average: 0.322] aeroplane
2021-11-19 00:50:06,160 - INFO - [ 13/12234]: [Pair PCK: 0.250] [Average: 0.317] aeroplane
2021-11-19 00:50:06,163 - INFO - [ 14/12234]: [Pair PCK: 0.615] [Average: 0.337] aeroplane
2021-11-19 00:50:06,731 - INFO - [ 15/12234]: [Pair PCK: 0.000] [Average: 0.316] aeroplane
...
2021-11-19 01:13:47,264 - INFO - [12216/12234]: [Pair PCK: 0.222] [Average: 0.333] tvmonitor
2021-11-19 01:13:47,265 - INFO - [12217/12234]: [Pair PCK: 0.200] [Average: 0.333] tvmonitor
2021-11-19 01:13:47,266 - INFO - [12218/12234]: [Pair PCK: 0.250] [Average: 0.333] tvmonitor
2021-11-19 01:13:47,268 - INFO - [12219/12234]: [Pair PCK: 0.222] [Average: 0.333] tvmonitor
2021-11-19 01:13:47,837 - INFO - [12220/12234]: [Pair PCK: 0.000] [Average: 0.333] tvmonitor
2021-11-19 01:13:47,838 - INFO - [12221/12234]: [Pair PCK: 0.000] [Average: 0.333] tvmonitor
2021-11-19 01:13:47,848 - INFO - [12222/12234]: [Pair PCK: 0.000] [Average: 0.333] tvmonitor
2021-11-19 01:13:47,850 - INFO - [12223/12234]: [Pair PCK: 0.000] [Average: 0.333] tvmonitor
2021-11-19 01:13:47,853 - INFO - [12224/12234]: [Pair PCK: 0.000] [Average: 0.333] tvmonitor
2021-11-19 01:13:48,422 - INFO - [12225/12234]: [Pair PCK: 0.000] [Average: 0.333] tvmonitor
2021-11-19 01:13:48,424 - INFO - [12226/12234]: [Pair PCK: 0.000] [Average: 0.333] tvmonitor
2021-11-19 01:13:48,425 - INFO - [12227/12234]: [Pair PCK: 0.000] [Average: 0.333] tvmonitor
2021-11-19 01:13:48,427 - INFO - [12228/12234]: [Pair PCK: 0.333] [Average: 0.333] tvmonitor
2021-11-19 01:13:48,429 - INFO - [12229/12234]: [Pair PCK: 0.222] [Average: 0.333] tvmonitor
2021-11-19 01:13:48,896 - INFO - [12230/12234]: [Pair PCK: 0.333] [Average: 0.333] tvmonitor
2021-11-19 01:13:48,899 - INFO - [12231/12234]: [Pair PCK: 0.000] [Average: 0.333] tvmonitor
2021-11-19 01:13:48,899 - INFO - [12232/12234]: [Pair PCK: 0.000] [Average: 0.333] tvmonitor
2021-11-19 01:13:48,901 - INFO - [12233/12234]: [Pair PCK: 0.111] [Average: 0.333] tvmonitor