PoseViz – Multi-person, multi-camera 3D human pose visualization tool built using Mayavi.

Last update: Dec 30, 2022

Overview

PoseViz – 3D Human Pose Visualizer

Multi-person, multi-camera 3D human pose visualization tool built using Mayavi. As used in MeTRAbs visualizations.

This repo does not contain pose estimation code, only the visualization part.

Gist of usage

import poseviz

viz = poseviz.PoseViz(...)
camera = poseviz.Camera(...)
for frame in frames:
    bounding_boxes, poses3d = run_pose_estimation_model(frame)
    viz.update(frame=frame, boxes=bounding_boxes, poses=poses3d, camera=camera)

The main feature of this tool is that the graphical event loop is hidden from the library user. We want to write code in terms of the prediction loop of the human pose estimator, not from the point of view of the visualizer tool.

Behind the scenes, this is achieved through forking a dedicated visualization process and passing new scene information via multiprocessing queues.

Detailed docs TBA.

Installation

Install Mayavi via Conda (the Mayavi pip package has compilation problems), clone this repo and install PoseViz via pip.

conda install mayavi -c conda-forge
pip install .

Then run demo.py to test if installation was successful.

PyTorch Implementation of Realtime Multi-Person Pose Estimation project.

PyTorch Realtime Multi-Person Pose Estimation This is a pytorch version of Realtime_Multi-Person_Pose_Estimation, origin code is here Realtime_Multi-P

157 Nov 12, 2022

Code repo for realtime multi-person pose estimation in CVPR'17 (Oral)

Realtime Multi-Person Pose Estimation By Zhe Cao, Tomas Simon, Shih-En Wei, Yaser Sheikh. Introduction Code repo for winning 2016 MSCOCO Keypoints Cha

4.9k Dec 31, 2022

Keras implementation of PersonLab for Multi-Person Pose Estimation and Instance Segmentation.

PersonLab This is a Keras implementation of PersonLab for Multi-Person Pose Estimation and Instance Segmentation. The model predicts heatmaps and vari

160 Dec 21, 2022

Camera-caps - Examine the camera capabilities for V4l2 cameras

camera-caps This is a graphical user interface over the v4l2-ctl command line to

25 Dec 26, 2022

Visualize Camera's Pose Using Extrinsic Parameter by Plotting Pyramid Model on 3D Space

extrinsic2pyramid Visualize Camera's Pose Using Extrinsic Parameter by Plotting Pyramid Model on 3D Space Intro A very simple and straightforward modu

106 Dec 28, 2022

(ICCV 2021) Official code of "Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-on and Outfit Editing."

Dressing in Order (DiOr) 👚 [Paper] 👖 [Webpage] 👗 [Running this code] The official implementation of "Dressing in Order: Recurrent Person Image Gene

277 Dec 28, 2022

Exploring the Dual-task Correlation for Pose Guided Person Image Generation

Dual-task Pose Transformer Network The source code for our paper "Exploring Dual-task Correlation for Pose Guided Person Image Generation“ (CVPR2022)

63 Dec 15, 2022

This is the official implementation of 3D-CVF: Generating Joint Camera and LiDAR Features Using Cross-View Spatial Feature Fusion for 3D Object Detection, built on SECOND.

3D-CVF This is the official implementation of 3D-CVF: Generating Joint Camera and LiDAR Features Using Cross-View Spatial Feature Fusion for 3D Object

97 Dec 20, 2022

[ICCV 2021] Encoder-decoder with Multi-level Attention for 3D Human Shape and Pose Estimation

MAED: Encoder-decoder with Multi-level Attention for 3D Human Shape and Pose Estimation Getting Started Our codes are implemented and tested with pyth

176 Dec 15, 2022

Comments

get 3d pose rotation angle ?

i notice you use mayavi, can we get the 3d pose rotation angle with parent-children by this project or other module ? i try to shoe the result 3d pose in UE, can you give me some advices ? maybe it needs to change to smpl pose ?

opened by luoww1992 1

Demo launch is failed

I have an error when I execute python demo.py

  File "/home/ivan/miniconda3/envs/metrabs/lib/python3.8/multiprocessing/process.py", line 315, in _bootstrap
    self.run()
  File "/home/ivan/miniconda3/envs/metrabs/lib/python3.8/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/home/ivan/Desktop/poseviz/poseviz/poseviz.py", line 311, in _main_visualize
    viz.run_loop()
  File "/home/ivan/Desktop/poseviz/poseviz/poseviz.py", line 155, in run_loop
    _ = mlab.animate(delay=delay, ui=False)(self.animate)(fig)
  File "/home/ivan/miniconda3/envs/metrabs/lib/python3.8/site-packages/mayavi/tools/animator.py", line 248, in _wrapper
    return decorator(Wrapper(function).decorator_call, function)
  File "/home/ivan/.local/lib/python3.8/site-packages/decorator.py", line 262, in decorator
    return decorate(_func, caller)
  File "/home/ivan/.local/lib/python3.8/site-packages/decorator.py", line 250, in decorate
    fun = FunctionMaker.create(
  File "/home/ivan/.local/lib/python3.8/site-packages/decorator.py", line 213, in create
    self = cls(func, name, signature, defaults, doc, module)
  File "/home/ivan/.local/lib/python3.8/site-packages/decorator.py", line 143, in __init__
    raise TypeError('You are decorating a non function: %s' % func)
TypeError: You are decorating a non function: <bound method PoseVizMayaviSide.animate of <poseviz.poseviz.PoseVizMayaviSide object at 0x7fcd9eb0f0a0>>

opened by 4ku 0

The demo problem

Hello, I tried to run the demo.py, but the output is as follows：

The X11 connection broke: No error (code 0) XIO: fatal IO error 22 (Invalid argument) on X server "localhost:10.0" after 400 requests (400 known processed) with 0 events remaining.

And I found it happened after this line: viz = poseviz.PoseViz(joint_names, joint_edges)

How to solve it? My operating system is Ubuntu 18.04.5 LTS.

opened by LeeHY-1 0

Owner

István Sárándi

PhD candidate at RWTH Aachen University, making robots and machines see people better

GitHub

SE3 Pose Interp - Interpolate camera pose or trajectory in SE3, pose interpolation, trajectory interpolation

SE3 Pose Interpolation Pose estimated from SLAM system are always discrete, and

4 Dec 15, 2022

Python scripts for performing 3D human pose estimation using the Mobile Human Pose model in ONNX.

99 Dec 31, 2022

Official PyTorch implementation of "Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Image", ICCV 2019

PoseNet of "Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Image" Introduction This repo is official Py

677 Dec 25, 2022

Simple Pose: Rethinking and Improving a Bottom-up Approach for Multi-Person Pose Estimation

SimplePose Code and pre-trained models for our paper, “Simple Pose: Rethinking and Improving a Bottom-up Approach for Multi-Person Pose Estimation”, a

256 Dec 24, 2022

Towards Multi-Camera 3D Human Pose Estimation in Wild Environment

PanopticStudio Toolbox This repository has a toolbox to download, process, and visualize the Panoptic Studio (Panoptic) data. Note: Sep-21-2020: Curre

335 Jan 9, 2023

Code for "Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereo"

Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereo This repository includes the source code for our CVPR 2021 paper on multi-view mult

66 Jan 4, 2023

《Unsupervised 3D Human Pose Representation with Viewpoint and Pose Disentanglement》(ECCV 2020) GitHub: [fig9]

Unsupervised 3D Human Pose Representation [Paper] The implementation of our paper Unsupervised 3D Human Pose Representation with Viewpoint and Pose Di

42 Nov 24, 2022

Repository for the paper "PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimation", CVPR 2021.

PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimation Code repository for the paper: PoseAug: A Differentiable Pose Augme

328 Dec 17, 2022

Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensors, CVPR 2021

Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensors Human POSEitioning System (H

66 Dec 21, 2022

3D Multi-Person Pose Estimation by Integrating Top-Down and Bottom-Up Networks

3D Multi-Person Pose Estimation by Integrating Top-Down and Bottom-Up Networks Introduction This repository contains the code and models for the follo

124 Jan 6, 2023