Code repository for paper `Skeleton Merger: an Unsupervised Aligned Keypoint Detector`.

Related tags

Deep Learning pytorch unsupervised-learning 3d-computer-vision cvpr2021
Overview

Skeleton Merger

Skeleton Merger, an Unsupervised Aligned Keypoint Detector. The paper is available at https://arxiv.org/abs/2103.10814.

Intro pic

A map of the repository

  • The merger/pointnetpp folder contains the Pytorch Implementation of PointNet and PointNet++ repository with some minor changes. It is adapted to make compatible relative imports.
  • The merger/composed_chamfer.py file contains an efficient implementation of proposed Composite Chamfer Distance (CCD).
  • The merger/data_flower.py file is for data loading and preprocessing.
  • The merger/merger_net.py file contains the Skeleton Merger implementation.
  • The root folder contains several scripts for training and testing.

Usage of script files

Usage of the script files, together with a brief description of data format, are available through the -h command line option.

Dataset

The ShapeNetCore.v2 dataset used in the paper is available from the Point Cloud Datasets repository.

Comments
  • Error while training the model using ShapeNetCore.v2

    Error while training the model using ShapeNetCore.v2

    Hello,

    I downloaded the "ShapeNetCore.v2" from https://github.com/AnTao97/PointCloudDatasets, as mentioned in the readme. I try to train the model using following configurations: python train.py -t '/home/username/datasets/shapenetcorev2_hdf5_2048' -v '/home/username/datasets/shapenetcorev2_hdf5_2048/val' -c 1 -m airplane-merger.pt -d gpu

    And, I get the following error messages: Traceback (most recent call last): File "/home/projects/SkeletonMerger/train.py", line 79, in x, xl = all_h5(DATASET, True, True, subclasses=(ns.subclass,), sample=None) # n x 2048 x 3 File "/home/projects/SkeletonMerger/merger/data_flower.py", line 36, in all_h5 xy = tuple(lazy) File "/home/projects/SkeletonMerger/merger/data_flower.py", line 33, in lazy = map(lambda x: load_h5(x, normalize, include_label), File "/home/projects/SkeletonMerger/merger/data_flower.py", line 14, in load_h5 f = h5py.File(h5_filename, 'r') File "/home/anaconda3/envs/pytorchworkshop/lib/python3.9/site-packages/h5py/_hl/files.py", line 455, in init fid = make_fid(name, mode, userblock_size, File "/home/anaconda3/envs/pytorchworkshop/lib/python3.9/site-packages/h5py/_hl/files.py", line 199, in make_fid fid = h5f.open(name, flags, fapl=fapl) File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper File "h5py/h5f.pyx", line 100, in h5py.h5f.open OSError: Unable to open file (file signature not found)

    It seems there is some issue in reading the h5 file. Please let me know.

    opened by amarmhrjn 6
  • annotation-json and pcd files for predictor_keypoint.py

    annotation-json and pcd files for predictor_keypoint.py

    Where can I get the annotation json and pcd file to predict keypoint? I only have the shapenetcorev2 dataset ,only .h5 files and some json files. Thanks!

    opened by xypu98 2
  • The error of predictor_keypointnet.py

    The error of predictor_keypointnet.py

    Hi, nice job

    I am very sorry to bother you, when I ran the predictor_keypointnet.py on the guitar category, I met the following error: 99%|█████████▉| 696/704 [03:42<00:02, 3.12it/s] Traceback (most recent call last): recon, key_points, kpa, emb, null_activation = net(torch.Tensor(np.array(Q)).to(ns.device)) x = batch_norm(x) merger_net.py", line 35, in forward ValueError: expected 2D or 3D input (got 1D input)

    Thank you very much!

    bug 
    opened by zwy1996 2
  • Want a pretrained model

    Want a pretrained model

    I trained your model locally with default settings, however, the result is not as good as shown in the paper. I write this issue to ask for your help. Could you please provide me with your training settings( epoch, batch num, optimizer). Also, I would be very glad to get a pretrained model from you. Best wishes! 😄

    opened by YYYYYHC 1
  • The subclass id of Airplanes and Guitars ?

    The subclass id of Airplanes and Guitars ?

    Hi, nice job!

    I have noticed that you changed the subclass id of chair category(0 to 14). So , would you please tell me the subclass id of Airplanes and Guitars?

    Thank you very much!

    opened by zwy1996 1
Owner
北海若
北海若
GitHub
KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Control

KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Control Tomas Jakab, Richard Tucker, Ameesh Makadia, Jiajun Wu, Noah Snavely, Angjoo Ka

Tomas Jakab 87 Nov 30, 2022
Implementation of "JOKR: Joint Keypoint Representation for Unsupervised Cross-Domain Motion Retargeting"

JOKR: Joint Keypoint Representation for Unsupervised Cross-Domain Motion Retargeting Pytorch implementation for the paper "JOKR: Joint Keypoint Repres

null 45 Dec 25, 2022
This repository contains the code for the paper "PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization"

PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization News: [2020/05/04] Added EGL rendering option for training data g

Shunsuke Saito 1.5k Jan 3, 2023
A whale detector design for the Kaggle whale-detector challenge!

CNN (InceptionV1) + STFT based Whale Detection Algorithm So, this repository is my PyTorch solution for the Kaggle whale-detection challenge. The obje

Tarin Ziyaee 92 Sep 28, 2021
Lane follower: Lane-detector (OpenCV) + Object-detector (YOLO5) + CAN-bus

Lane Follower This code is for the lane follower, including perception and control, as shown below. Environment Hardware Industrial Camera Intel-NUC(1

Siqi Fan 3 Jul 7, 2022
HeartRate detector with ArduinoandPython - Use Arduino and Python create a heartrate detector.

Syllabus of Contents Syllabus of Contents Introduction Of Project Features Develop With Python code introduction Installation License Developer Contac

null 1 Jan 5, 2022
Video lie detector using xgboost - A video lie detector using OpenFace and xgboost

video_lie_detector_using_xgboost a video lie detector using OpenFace and xgboost

null 2 Jan 11, 2022
Imposter-detector-2022 - HackED 2022 Team 3IQ - 2022 Imposter Detector

HackED 2022 Team 3IQ - 2022 Imposter Detector By Aneeljyot Alagh, Curtis Kan, Jo

Joshua Ji 3 Aug 20, 2022
This is an official implementation of our CVPR 2021 paper "Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regression" (https://arxiv.org/abs/2104.02300)

Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regression Introduction In this paper, we are interested in the bottom-up paradigm of estima

HRNet 367 Dec 27, 2022
Implementation for our ICCV 2021 paper: Dual-Camera Super-Resolution with Aligned Attention Modules

DCSR: Dual Camera Super-Resolution Implementation for our ICCV 2021 oral paper: Dual-Camera Super-Resolution with Aligned Attention Modules paper | pr

Tengfei Wang 110 Dec 20, 2022
Implementation for our ICCV 2021 paper: Dual-Camera Super-Resolution with Aligned Attention Modules

DCSR: Dual Camera Super-Resolution Implementation for our ICCV 2021 oral paper: Dual-Camera Super-Resolution with Aligned Attention Modules paper | pr

Tengfei Wang 110 Dec 20, 2022
[ICCV2021] Official code for "Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action Recognition"

CTR-GCN This repo is the official implementation for Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action Recognition. The pap

Yuxin Chen 148 Dec 16, 2022
OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation

Build Type Linux MacOS Windows Build Status OpenPose has represented the first real-time multi-person system to jointly detect human body, hand, facia

null 25.7k Jan 9, 2023
CharacterGAN: Few-Shot Keypoint Character Animation and Reposing

CharacterGAN Implementation of the paper "CharacterGAN: Few-Shot Keypoint Character Animation and Reposing" by Tobias Hinz, Matthew Fisher, Oliver Wan

Tobias Hinz 181 Dec 27, 2022
Single-stage Keypoint-based Category-level Object Pose Estimation from an RGB Image

CenterPose Overview This repository is the official implementation of the paper "Single-stage Keypoint-based Category-level Object Pose Estimation fro

NVIDIA Research Projects 188 Dec 27, 2022
68 keypoint annotations for COFW test data

68 keypoint annotations for COFW test data This repository contains manually annotated 68 keypoints for COFW test data (original annotation of CFOW da

null 31 Dec 6, 2022
Solving SMPL/MANO parameters from keypoint coordinates.

Minimal-IK A simple and naive inverse kinematics solver for MANO hand model, SMPL body model, and SMPL-H body+hand model. Briefly, given joint coordin

Yuxiao Zhou 305 Dec 30, 2022
UDP++ (ECCVW 2020 Oral), (Winner of COCO 2020 Keypoint Challenge).

UDP-Pose This is the pytorch implementation for UDP++, which won the Fisrt place in COCO Keypoint Challenge at ECCV 2020 Workshop. Top-Down Results on

null 20 Jul 29, 2022
Multi-Scale Aligned Distillation for Low-Resolution Detection (CVPR2021)

MSAD Multi-Scale Aligned Distillation for Low-Resolution Detection Lu Qi*, Jason Kuen*, Jiuxiang Gu, Zhe Lin, Yi Wang, Yukang Chen, Yanwei Li, Jiaya J

Jia Research Lab 115 Dec 23, 2022