PoseViz – Multi-person, multi-camera 3D human pose visualization tool built using Mayavi.

Overview

PoseViz – 3D Human Pose Visualizer

Multi-person, multi-camera 3D human pose visualization tool built using Mayavi. As used in MeTRAbs visualizations.

This repo does not contain pose estimation code, only the visualization part.

Gist of usage

import poseviz

viz = poseviz.PoseViz(...)
camera = poseviz.Camera(...)
for frame in frames:
    bounding_boxes, poses3d = run_pose_estimation_model(frame)
    viz.update(frame=frame, boxes=bounding_boxes, poses=poses3d, camera=camera)

The main feature of this tool is that the graphical event loop is hidden from the library user. We want to write code in terms of the prediction loop of the human pose estimator, not from the point of view of the visualizer tool.

Behind the scenes, this is achieved through forking a dedicated visualization process and passing new scene information via multiprocessing queues.

Detailed docs TBA.

Installation

Install Mayavi via Conda (the Mayavi pip package has compilation problems), clone this repo and install PoseViz via pip.

conda install mayavi -c conda-forge
pip install .

Then run demo.py to test if installation was successful.

You might also like...
PyTorch Implementation of Realtime Multi-Person Pose Estimation project.

PyTorch Realtime Multi-Person Pose Estimation This is a pytorch version of Realtime_Multi-Person_Pose_Estimation, origin code is here Realtime_Multi-P

Code repo for realtime multi-person pose estimation in CVPR'17 (Oral)
Code repo for realtime multi-person pose estimation in CVPR'17 (Oral)

Realtime Multi-Person Pose Estimation By Zhe Cao, Tomas Simon, Shih-En Wei, Yaser Sheikh. Introduction Code repo for winning 2016 MSCOCO Keypoints Cha

Keras implementation of PersonLab for Multi-Person Pose Estimation and Instance Segmentation.

PersonLab This is a Keras implementation of PersonLab for Multi-Person Pose Estimation and Instance Segmentation. The model predicts heatmaps and vari

Camera-caps - Examine the camera capabilities for V4l2 cameras
Camera-caps - Examine the camera capabilities for V4l2 cameras

camera-caps This is a graphical user interface over the v4l2-ctl command line to

Visualize Camera's Pose Using Extrinsic Parameter by Plotting Pyramid Model on 3D Space
Visualize Camera's Pose Using Extrinsic Parameter by Plotting Pyramid Model on 3D Space

extrinsic2pyramid Visualize Camera's Pose Using Extrinsic Parameter by Plotting Pyramid Model on 3D Space Intro A very simple and straightforward modu

(ICCV 2021) Official code of
(ICCV 2021) Official code of "Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-on and Outfit Editing."

Dressing in Order (DiOr) 👚 [Paper] 👖 [Webpage] 👗 [Running this code] The official implementation of "Dressing in Order: Recurrent Person Image Gene

Exploring the Dual-task Correlation for Pose Guided Person Image Generation
Exploring the Dual-task Correlation for Pose Guided Person Image Generation

Dual-task Pose Transformer Network The source code for our paper "Exploring Dual-task Correlation for Pose Guided Person Image Generation“ (CVPR2022)

This is the official implementation of 3D-CVF: Generating Joint Camera and LiDAR Features Using Cross-View Spatial Feature Fusion for 3D Object Detection, built on SECOND.

3D-CVF This is the official implementation of 3D-CVF: Generating Joint Camera and LiDAR Features Using Cross-View Spatial Feature Fusion for 3D Object

[ICCV 2021] Encoder-decoder with Multi-level Attention for 3D Human Shape and Pose Estimation
[ICCV 2021] Encoder-decoder with Multi-level Attention for 3D Human Shape and Pose Estimation

MAED: Encoder-decoder with Multi-level Attention for 3D Human Shape and Pose Estimation Getting Started Our codes are implemented and tested with pyth

Comments
  • get 3d pose rotation angle ?

    get 3d pose rotation angle ?

    i notice you use mayavi, can we get the 3d pose rotation angle with parent-children by this project or other module ? i try to shoe the result 3d pose in UE, can you give me some advices ? maybe it needs to change to smpl pose ?

    opened by luoww1992 1
  • Demo launch is failed

    Demo launch is failed

    I have an error when I execute python demo.py

      File "/home/ivan/miniconda3/envs/metrabs/lib/python3.8/multiprocessing/process.py", line 315, in _bootstrap
        self.run()
      File "/home/ivan/miniconda3/envs/metrabs/lib/python3.8/multiprocessing/process.py", line 108, in run
        self._target(*self._args, **self._kwargs)
      File "/home/ivan/Desktop/poseviz/poseviz/poseviz.py", line 311, in _main_visualize
        viz.run_loop()
      File "/home/ivan/Desktop/poseviz/poseviz/poseviz.py", line 155, in run_loop
        _ = mlab.animate(delay=delay, ui=False)(self.animate)(fig)
      File "/home/ivan/miniconda3/envs/metrabs/lib/python3.8/site-packages/mayavi/tools/animator.py", line 248, in _wrapper
        return decorator(Wrapper(function).decorator_call, function)
      File "/home/ivan/.local/lib/python3.8/site-packages/decorator.py", line 262, in decorator
        return decorate(_func, caller)
      File "/home/ivan/.local/lib/python3.8/site-packages/decorator.py", line 250, in decorate
        fun = FunctionMaker.create(
      File "/home/ivan/.local/lib/python3.8/site-packages/decorator.py", line 213, in create
        self = cls(func, name, signature, defaults, doc, module)
      File "/home/ivan/.local/lib/python3.8/site-packages/decorator.py", line 143, in __init__
        raise TypeError('You are decorating a non function: %s' % func)
    TypeError: You are decorating a non function: <bound method PoseVizMayaviSide.animate of <poseviz.poseviz.PoseVizMayaviSide object at 0x7fcd9eb0f0a0>>
    
    opened by 4ku 0
  • The demo problem

    The demo problem

    Hello, I tried to run the demo.py, but the output is as follows:

    The X11 connection broke: No error (code 0) XIO: fatal IO error 22 (Invalid argument) on X server "localhost:10.0" after 400 requests (400 known processed) with 0 events remaining.

    And I found it happened after this line: viz = poseviz.PoseViz(joint_names, joint_edges)

    How to solve it? My operating system is Ubuntu 18.04.5 LTS.

    opened by LeeHY-1 0
Owner
István Sárándi
PhD candidate at RWTH Aachen University, making robots and machines see people better
István Sárándi
SE3 Pose Interp - Interpolate camera pose or trajectory in SE3, pose interpolation, trajectory interpolation

SE3 Pose Interpolation Pose estimated from SLAM system are always discrete, and

Ran Cheng 4 Dec 15, 2022
Python scripts for performing 3D human pose estimation using the Mobile Human Pose model in ONNX.

Python scripts for performing 3D human pose estimation using the Mobile Human Pose model in ONNX.

Ibai Gorordo 99 Dec 31, 2022
Official PyTorch implementation of "Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Image", ICCV 2019

PoseNet of "Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Image" Introduction This repo is official Py

Gyeongsik Moon 677 Dec 25, 2022
Simple Pose: Rethinking and Improving a Bottom-up Approach for Multi-Person Pose Estimation

SimplePose Code and pre-trained models for our paper, “Simple Pose: Rethinking and Improving a Bottom-up Approach for Multi-Person Pose Estimation”, a

Jia Li 256 Dec 24, 2022
Towards Multi-Camera 3D Human Pose Estimation in Wild Environment

PanopticStudio Toolbox This repository has a toolbox to download, process, and visualize the Panoptic Studio (Panoptic) data. Note: Sep-21-2020: Curre

null 335 Jan 9, 2023
Code for "Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereo"

Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereo This repository includes the source code for our CVPR 2021 paper on multi-view mult

Jiahao Lin 66 Jan 4, 2023
《Unsupervised 3D Human Pose Representation with Viewpoint and Pose Disentanglement》(ECCV 2020) GitHub: [fig9]

Unsupervised 3D Human Pose Representation [Paper] The implementation of our paper Unsupervised 3D Human Pose Representation with Viewpoint and Pose Di

null 42 Nov 24, 2022
Repository for the paper "PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimation", CVPR 2021.

PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimation Code repository for the paper: PoseAug: A Differentiable Pose Augme

Pyjcsx 328 Dec 17, 2022
Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensors, CVPR 2021

Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensors Human POSEitioning System (H

Aymen Mir 66 Dec 21, 2022
3D Multi-Person Pose Estimation by Integrating Top-Down and Bottom-Up Networks

3D Multi-Person Pose Estimation by Integrating Top-Down and Bottom-Up Networks Introduction This repository contains the code and models for the follo

null 124 Jan 6, 2023