ICCV2021 Paper: AutoShape: Real-Time Shape-Aware Monocular 3D Object Detection

Overview

AutoShape

ICCV2021 Paper: AutoShape: Real-Time Shape-Aware Monocular 3D Object Detection

arXiv

Auto-labeling Car Shape for KITTI

We release our Auto-labeling car shape data for KITTI with COCO formate. Each car instance has been assigned a 3D model. Trainset and Valset with 3000 vertexes 3D models annotations can be download from Google Drive.

Data Formate

# we add 2D/3D keypoints in KITTI car instance annotations
annotations: [
    '2dkeypoints': list # (3000 + 9) * 3 (u, v, visiblity),
    '3dkeypoints': list # (3000 + 9) * 3 (x, y, z in model local coordinate)
    ...
    ], ...
You might also like...
Real-Time-Student-Attendence-System - Real Time Student Attendence System

Real-Time-Student-Attendence-System The Student Attendance Management System Pro

Implementation of ICCV2021(Oral) paper - VMNet: Voxel-Mesh Network for Geodesic-aware 3D Semantic Segmentation
Implementation of ICCV2021(Oral) paper - VMNet: Voxel-Mesh Network for Geodesic-aware 3D Semantic Segmentation

VMNet: Voxel-Mesh Network for Geodesic-Aware 3D Semantic Segmentation Created by Zeyu HU Introduction This work is based on our paper VMNet: Voxel-Mes

This is an official implementation of the paper "Distance-aware Quantization", accepted to ICCV2021.

PyTorch implementation of DAQ This is an official implementation of the paper "Distance-aware Quantization", accepted to ICCV2021. For more informatio

PyTorch implementation of
PyTorch implementation of "Representing Shape Collections with Alignment-Aware Linear Models" paper.

deep-linear-shapes PyTorch implementation of "Representing Shape Collections with Alignment-Aware Linear Models" paper. If you find this code useful i

Implementation for paper "STAR: A Structure-aware Lightweight Transformer for Real-time Image Enhancement" (ICCV 2021).

STAR-pytorch Implementation for paper "STAR: A Structure-aware Lightweight Transformer for Real-time Image Enhancement" (ICCV 2021). CVF (pdf) STAR-DC

TOOD: Task-aligned One-stage Object Detection, ICCV2021 Oral
TOOD: Task-aligned One-stage Object Detection, ICCV2021 Oral

One-stage object detection is commonly implemented by optimizing two sub-tasks: object classification and localization, using heads with two parallel branches, which might lead to a certain level of spatial misalignment in predictions between the two tasks.

Exploring Classification Equilibrium in Long-Tailed Object Detection, ICCV2021
Exploring Classification Equilibrium in Long-Tailed Object Detection, ICCV2021

Exploring Classification Equilibrium in Long-Tailed Object Detection (LOCE, ICCV 2021) Paper Introduction The conventional detectors tend to make imba

Semi-Supervised Learning, Object Detection, ICCV2021
Semi-Supervised Learning, Object Detection, ICCV2021

End-to-End Semi-Supervised Object Detection with Soft Teacher By Mengde Xu*, Zheng Zhang*, Han Hu, Jianfeng Wang, Lijuan Wang, Fangyun Wei, Xiang Bai,

Official PyTorch Code of GrooMeD-NMS: Grouped Mathematically Differentiable NMS for Monocular 3D Object Detection (CVPR 2021)
Official PyTorch Code of GrooMeD-NMS: Grouped Mathematically Differentiable NMS for Monocular 3D Object Detection (CVPR 2021)

GrooMeD-NMS: Grouped Mathematically Differentiable NMS for Monocular 3D Object Detection GrooMeD-NMS: Grouped Mathematically Differentiable NMS for Mo

Comments
  • question about '3dkeypoints'.

    question about '3dkeypoints'.

    Hi, @zongdai I have question about 3dkeypoints. Do we need to modify the 3dkeypoints in your json files? (that is to say, 3dkeypoints in the same coordinate system with original kitti official coordinate system?)

    opened by Senwang98 2
  • no visualization effect but only original image

    no visualization effect but only original image

    after run:

    python src/faster.py --demo /home/kitti/testing/image_2 --calib_dir /home/kitti/testing/calib --load_model trainval_model_batch16_gpu2_200epoch_pc48_adaptivekp_rightaug.pth --gpus 0 --arch dla_34 --num_joints 57 --sample_pc 48 --vis
    

    i only got empty white bev and original image

    image

    not as expected

    opened by Light-- 0
  • zipimport.ZipImportError: not a Zip file: 'dist/iou3d-0.0.0-py3.6-linux-x86_64.egg'

    zipimport.ZipImportError: not a Zip file: 'dist/iou3d-0.0.0-py3.6-linux-x86_64.egg'

    i followed the instructions to install autoshape but error reports:

    $ python setup.py install
    running install
    running bdist_egg
    running egg_info
    writing iou3d.egg-info/PKG-INFO
    writing dependency_links to iou3d.egg-info/dependency_links.txt
    writing top-level names to iou3d.egg-info/top_level.txt
    reading manifest file 'iou3d.egg-info/SOURCES.txt'
    writing manifest file 'iou3d.egg-info/SOURCES.txt'
    installing library code to build/bdist.linux-x86_64/egg
    running install_lib
    running build_ext
    creating build/bdist.linux-x86_64/egg
    copying build/lib.linux-x86_64-3.6/iou3d_cuda.cpython-36m-x86_64-linux-gnu.so -> build/bdist.linux-x86_64/egg
    creating stub loader for iou3d_cuda.cpython-36m-x86_64-linux-gnu.so
    byte-compiling build/bdist.linux-x86_64/egg/iou3d_cuda.py to iou3d_cuda.cpython-36.pyc
    creating build/bdist.linux-x86_64/egg/EGG-INFO
    copying iou3d.egg-info/PKG-INFO -> build/bdist.linux-x86_64/egg/EGG-INFO
    copying iou3d.egg-info/SOURCES.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
    copying iou3d.egg-info/dependency_links.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
    copying iou3d.egg-info/top_level.txt -> build/bdist.linux-x86_64/egg/EGG-INFO
    writing build/bdist.linux-x86_64/egg/EGG-INFO/native_libs.txt
    zip_safe flag not set; analyzing archive contents...
    __pycache__.iou3d_cuda.cpython-36: module references __file__
    creating dist
    creating 'dist/iou3d-0.0.0-py3.6-linux-x86_64.egg' and adding 'build/bdist.linux-x86_64/egg' to it
    removing 'build/bdist.linux-x86_64/egg' (and everything under it)
    Processing iou3d-0.0.0-py3.6-linux-x86_64.egg
    Traceback (most recent call last):
      File "setup.py", line 14, in <module>
        cmdclass={'build_ext': BuildExtension})
      File "/home/miniconda3/envs/autoshape/lib/python3.6/site-packages/setuptools/__init__.py", line 153, in setup
        return distutils.core.setup(**attrs)
      File "/home/miniconda3/envs/autoshape/lib/python3.6/distutils/core.py", line 148, in setup
        dist.run_commands()
      File "/home/miniconda3/envs/autoshape/lib/python3.6/distutils/dist.py", line 955, in run_commands
        self.run_command(cmd)
      File "/home/miniconda3/envs/autoshape/lib/python3.6/distutils/dist.py", line 974, in run_command
        cmd_obj.run()
      File "/home/miniconda3/envs/autoshape/lib/python3.6/site-packages/setuptools/command/install.py", line 67, in run
        self.do_egg_install()
      File "/home/miniconda3/envs/autoshape/lib/python3.6/site-packages/setuptools/command/install.py", line 117, in do_egg_install
        cmd.run(show_deprecation=False)
      File "/home/miniconda3/envs/autoshape/lib/python3.6/site-packages/setuptools/command/easy_install.py", line 408, in run
        self.easy_install(spec, not self.no_deps)
      File "/home/miniconda3/envs/autoshape/lib/python3.6/site-packages/setuptools/command/easy_install.py", line 650, in easy_install
        return self.install_item(None, spec, tmpdir, deps, True)
      File "/home/miniconda3/envs/autoshape/lib/python3.6/site-packages/setuptools/command/easy_install.py", line 695, in install_item
        dists = self.install_eggs(spec, download, tmpdir)
      File "/home/miniconda3/envs/autoshape/lib/python3.6/site-packages/setuptools/command/easy_install.py", line 855, in install_eggs
        return [install_dist(dist_filename, tmpdir)]
      File "/home/miniconda3/envs/autoshape/lib/python3.6/site-packages/setuptools/command/easy_install.py", line 910, in install_egg
        dist = self.egg_distribution(egg_path)
      File "/home/miniconda3/envs/autoshape/lib/python3.6/site-packages/setuptools/command/easy_install.py", line 897, in egg_distribution
        metadata = EggMetadata(zipimport.zipimporter(egg_path))
    zipimport.ZipImportError: not a Zip file: 'dist/iou3d-0.0.0-py3.6-linux-x86_64.egg'
    
    opened by Light-- 0
  • Is there any code for  3D Shape Auto-Labeling ?

    Is there any code for 3D Shape Auto-Labeling ?

    Thanks for your great work. After reading the paper, I am still confused about how the 3d keypoints generate. I read the code, and find that the keypoints are directly reading from json. Is there any code for 3D Shape Auto-Labeling section ?

    opened by yjcn 1
Owner
Zongdai
Zongdai
Official Repo for Ground-aware Monocular 3D Object Detection for Autonomous Driving

Visual 3D Detection Package: This repo aims to provide flexible and reproducible visual 3D detection on KITTI dataset. We expect scripts starting from

Yuxuan Liu 305 Dec 19, 2022
Real-Time SLAM for Monocular, Stereo and RGB-D Cameras, with Loop Detection and Relocalization Capabilities

ORB-SLAM2 Authors: Raul Mur-Artal, Juan D. Tardos, J. M. M. Montiel and Dorian Galvez-Lopez (DBoW2) 13 Jan 2017: OpenCV 3 and Eigen 3.3 are now suppor

Raul Mur-Artal 7.8k Dec 30, 2022
Official code for ICCV2021 paper "M3D-VTON: A Monocular-to-3D Virtual Try-on Network"

M3D-VTON: A Monocular-to-3D Virtual Try-On Network Official code for ICCV2021 paper "M3D-VTON: A Monocular-to-3D Virtual Try-on Network" Paper | Suppl

null 109 Dec 29, 2022
Object tracking and object detection is applied to track golf puts in real time and display stats/games.

Putting_Game Object tracking and object detection is applied to track golf puts in real time and display stats/games. Works best with the Perfect Prac

Max 1 Dec 29, 2021
Code and models for ICCV2021 paper "Robust Object Detection via Instance-Level Temporal Cycle Confusion".

Robust Object Detection via Instance-Level Temporal Cycle Confusion This repo contains the implementation of the ICCV 2021 paper, Robust Object Detect

Xin Wang 69 Oct 13, 2022
Code for "LASR: Learning Articulated Shape Reconstruction from a Monocular Video". CVPR 2021.

LASR Installation Build with conda conda env create -f lasr.yml conda activate lasr # install softras cd third_party/softras; python setup.py install;

Google 157 Dec 26, 2022
Shape Matching of Real 3D Object Data to Synthetic 3D CADs (3DV project @ ETHZ)

Real2CAD-3DV Shape Matching of Real 3D Object Data to Synthetic 3D CADs (3DV project @ ETHZ) Group Member: Yue Pan, Yuanwen Yue, Bingxin Ke, Yujie He

null 24 Jun 22, 2022
Code for "NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Video", CVPR 2021 oral

NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Video Project Page | Paper NeuralRecon: Real-Time Coherent 3D Reconstruction from Mon

ZJU3DV 1.4k Dec 30, 2022
PhysCap: Physically Plausible Monocular 3D Motion Capture in Real Time

PhysCap: Physically Plausible Monocular 3D Motion Capture in Real Time The implementation is based on SIGGRAPH Aisa'20. Dependencies Python 3.7 Ubuntu

soratobtai 124 Dec 8, 2022
Implementation for the paper 'YOLO-ReT: Towards High Accuracy Real-time Object Detection on Edge GPUs'

YOLO-ReT This is the original implementation of the paper: YOLO-ReT: Towards High Accuracy Real-time Object Detection on Edge GPUs. Prakhar Ganesh, Ya

null 69 Oct 19, 2022