Human Pose Estimation with TensorFlow
Here you can find the implementation of the Human Body Pose Estimation algorithm, presented in the DeeperCut and ArtTrack papers:
Eldar Insafutdinov, Leonid Pishchulin, Bjoern Andres, Mykhaylo Andriluka and Bernt Schiele DeeperCut: A Deeper, Stronger, and Faster Multi-Person Pose Estimation Model. In European Conference on Computer Vision (ECCV), 2016
Eldar Insafutdinov, Mykhaylo Andriluka, Leonid Pishchulin, Siyu Tang, Evgeny Levinkov, Bjoern Andres and Bernt Schiele ArtTrack: Articulated Multi-person Tracking in the Wild. In Conference on Computer Vision and Pattern Recognition (CVPR), 2017
For more information visit http://pose.mpi-inf.mpg.de
Prerequisites
The implementation is in Python 3 and TensorFlow. We recommended using conda to install the dependencies. First, create a Python 3.6 environment:
conda create -n py36 python=3.6
conda activate py36
Then, install basic dependencies with conda:
conda install numpy scikit-image pillow scipy pyyaml matplotlib cython
Install TensorFlow and remaining packages with pip:
pip install tensorflow-gpu easydict munkres
When running training or prediction scripts, please make sure to set the environment variable TF_CUDNN_USE_AUTOTUNE to 0 (see this ticket for explanation).
If your machine has multiple GPUs, you can select which GPU you want to run on by setting the environment variable, eg. CUDA_VISIBLE_DEVICES=0.
Demo code
Single-Person (if there is only one person in the image)
# Download pre-trained model files
$ cd models/mpii
$ ./download_models.sh
$ cd -
# Run demo of single person pose estimation
$ TF_CUDNN_USE_AUTOTUNE=0 python3 demo/singleperson.py
Multiple People
# Compile dependencies
$ ./compile.sh
# Download pre-trained model files
$ cd models/coco
$ ./download_models.sh
$ cd -
# Run demo of multi person pose estimation
$ TF_CUDNN_USE_AUTOTUNE=0 python3 demo/demo_multiperson.py
Training models
Please follow these instructions
Citation
Please cite ArtTrack and DeeperCut in your publications if it helps your research:
@inproceedings{insafutdinov2017cvpr,
title = {ArtTrack: Articulated Multi-person Tracking in the Wild},
booktitle = {CVPR'17},
url = {http://arxiv.org/abs/1612.01465},
author = {Eldar Insafutdinov and Mykhaylo Andriluka and Leonid Pishchulin and Siyu Tang and Evgeny Levinkov and Bjoern Andres and Bernt Schiele}
}
@article{insafutdinov2016eccv,
title = {DeeperCut: A Deeper, Stronger, and Faster Multi-Person Pose Estimation Model},
booktitle = {ECCV'16},
url = {http://arxiv.org/abs/1605.03170},
author = {Eldar Insafutdinov and Leonid Pishchulin and Bjoern Andres and Mykhaylo Andriluka and Bernt Schiele}
}
![F tensorflow/python/lib/core/bfloat16.cc:664] Check failed: PyBfloat16_Type.tp_base != nullptr Aborted](https://avatars.githubusercontent.com/u/1892917?v=4)
66 Dec 21, 2022
71 Jan 5, 2023
4 Dec 15, 2022
42 Nov 24, 2022
256 Dec 24, 2022
52 Nov 25, 2022
3.9k Jan 5, 2023
295 Dec 29, 2022
108 Dec 1, 2022
367 Dec 27, 2022
53 Dec 4, 2022
36 Oct 30, 2022
363 Dec 28, 2022
347 Dec 24, 2022
579 Dec 22, 2022
1.1k Dec 30, 2022
37 Nov 21, 2022
176 Dec 15, 2022