Transfer SemanticKITTI labeles into other dataset/sensor formats.

Overview

LiDAR-Transfer

Transfer SemanticKITTI labeles into other dataset/sensor formats.

Motivation

Content

Usage

Install Dependencies
pip install pyaml pyqt5 scikit-image scipy torchvision

pip install pycuda

pip install vispy

Or use local installation to apply antialias patch

git clone https://github.com/vispy/vispy.git
cd vispy
git apply ../lidar_transfer/vispy_antialias.patch
pip install -e .

Finally, you have to compile the ray tracer in auxiliary/raytracer, i.e.,

$ cd auxiliary/raytracer/ 
$ make
Get started
  1. Unzip minimal.zip
  2. Run
    python lidar_deform.py -d minimal
    
  3. Run with target sensor
    python lidar_deform.py -d minimal -t minimal/target.yaml
    
  4. Change parameter in config/lidar_transfer.yaml

Credits

Developed by Ferdinand Langer, 2019. This tool uses the following open source software:

License

Copyright 2020, Ferdinand Langer, Cyrill Stachniss. University of Bonn.

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

Citation

When you use our code in any academic work, please cite the original paper.

@inproceedings{langer2020iros,
    author = {F. Langer and A. Milioto and A. Haag and J. Behley and C. Stachniss},
    title = {{Domain Transfer for Semantic Segmentation of LiDAR Data using Deep Neural Networks}},
    booktitle = {Proc.~of the IEEE/RSJ Intl. Conf. on Intelligent Robots and System (IROS)},
    year = {2020},
    url = {http://www.ipb.uni-bonn.de/pdfs/langer2020iros.pdf},
    videourl = {https://youtu.be/6FNGF4hKBD0},
}
You might also like...
Automatic labeling, conversion of different data set formats, sample size statistics, model cascade
Automatic labeling, conversion of different data set formats, sample size statistics, model cascade

Simple Gadget Collection for Object Detection Tasks Automatic image annotation Conversion between different annotation formats Obtain statistical info

A colab notebook for training Stylegan2-ada on colab, transfer learning onto your own dataset.

Stylegan2-Ada-Google-Colab-Starter-Notebook A no thrills colab notebook for training Stylegan2-ada on colab. transfer learning onto your own dataset h

Extract MNIST handwritten digits dataset binary file into bmp images

MNIST-dataset-extractor Extract MNIST handwritten digits dataset binary file into bmp images More info at http://yann.lecun.com/exdb/mnist/ Dependenci

Official Implementation and Dataset of
Official Implementation and Dataset of "PPR10K: A Large-Scale Portrait Photo Retouching Dataset with Human-Region Mask and Group-Level Consistency", CVPR 2021

Portrait Photo Retouching with PPR10K Paper | Supplementary Material PPR10K: A Large-Scale Portrait Photo Retouching Dataset with Human-Region Mask an

This is the dataset and code release of the OpenRooms Dataset.
This is the dataset and code release of the OpenRooms Dataset.

This is the dataset and code release of the OpenRooms Dataset.

A large dataset of 100k Google Satellite and matching Map images, resembling pix2pix's Google Maps dataset.
A large dataset of 100k Google Satellite and matching Map images, resembling pix2pix's Google Maps dataset.

Larger Google Sat2Map dataset This dataset extends the aerial ⟷ Maps dataset used in pix2pix (Isola et al., CVPR17). The provide script download_sat2m

This is the official repo for TransFill:  Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformations at CVPR'21. According to some product reasons, we are not planning to release the training/testing codes and models. However, we will release the dataset and the scripts to prepare the dataset. Dataset used in
Dataset used in "PlantDoc: A Dataset for Visual Plant Disease Detection" accepted in CODS-COMAD 2020

PlantDoc: A Dataset for Visual Plant Disease Detection This repository contains the Cropped-PlantDoc dataset used for benchmarking classification mode

EMNLP 2021: Single-dataset Experts for Multi-dataset Question-Answering

MADE (Multi-Adapter Dataset Experts) This repository contains the implementation of MADE (Multi-adapter dataset experts), which is described in the pa

Comments
  • ModuleNotFoundError: No module named 'auxiliary.raytracer.RayTracerCython'

    ModuleNotFoundError: No module named 'auxiliary.raytracer.RayTracerCython'

    Hi all,

    thank you very much for sharing your amazing work! I cloned your repo and installed all the required dependencies, but unfortunately while running python lidar_deform.py -d minimal I get the error ModuleNotFoundError: No module named 'auxiliary.raytracer.RayTracerCython', namely:

    Screenshot 2021-02-15 at 12 13 06

    Any suggestion? FYI: I'm running everything inside a docker NVIDIA NGC container

    Thank you in advance!

    opened by saltoricristiano 7
  • Reproduce results of IROS paper

    Reproduce results of IROS paper

    Hi, Thanks for your interesting work and the provided code!

    I'd like to reproduce your results from your IROS paper. However, I struggle to understand if all elements are actually available in this repo. Could you provide the steps that are necessary to re-sample the SemanticKitti dataset (64 layers) with the nuScenes sensor setup (32 layers)? I believe that the target config file is missing.

    Best, Max

    opened by maxjaritz 6
  • Running offscreen

    Running offscreen

    Hi,

    thx again for your work! Did you have experience in running your code offscreen? I tried to run QT_QPA_PLATFORM=offscreen python lidar_deform.py -d minimal but after many lines of output, it got stacked in

    Screenshot 2021-03-12 at 10 46 30

    and got to KeyboardInterrupt. Any suggestion? Is it possible to run your code offscreen? Another thing, I saw that your code saved a test.ply file. So I opened it with open3d and got this

    Screenshot 2021-03-12 at 10 42 28

    is this the pcl transferred? Thx in advance for any help!

    opened by saltoricristiano 1
  • How do I convert VLS128 to HDL64

    How do I convert VLS128 to HDL64

    Thank you very much for your work. But I am not clear about how to convert tha data of VLS128 to that of HDL64.

    from the link below, I can know that rays are not lined up at equal intervals in the VLS128 lidar (unlike the HDL64) https://perceptionengine.jp/blog/autoware/lidar-laser-distributions/

    I prepared target and source yaml files respectively and implemented lidar_deform.py, but I couldn't get the good result. Is it difficult to convert between HDL64 and VLS128?

    opened by nakaotatsuya 1
Owner
Photogrammetry & Robotics Bonn
Photogrammetry & Robotics Lab at the University of Bonn
Photogrammetry & Robotics Bonn
Transfer-Learn is an open-source and well-documented library for Transfer Learning.

Transfer-Learn is an open-source and well-documented library for Transfer Learning. It is based on pure PyTorch with high performance and friendly API. Our code is pythonic, and the design is consistent with torchvision. You can easily develop new algorithms, or readily apply existing algorithms.

THUML @ Tsinghua University 2.2k Jan 3, 2023
Transfer style api - An API to use with Tranfer Style App, where you can use two image and transfer the style

Transfer Style API It's an API to use with Tranfer Style App, where you can use

Brian Alejandro 1 Feb 13, 2022
Python interface for the DIGIT tactile sensor

DIGIT-INTERFACE Python interface for the DIGIT tactile sensor. For updates and discussions please join the #DIGIT channel at the www.touch-sensing.org

Facebook Research 35 Dec 22, 2022
Official code for "EagerMOT: 3D Multi-Object Tracking via Sensor Fusion" [ICRA 2021]

EagerMOT: 3D Multi-Object Tracking via Sensor Fusion Read our ICRA 2021 paper here. Check out the 3 minute video for the quick intro or the full prese

Aleksandr Kim 276 Dec 30, 2022
An air quality monitoring service with a Raspberry Pi and a SDS011 sensor.

Raspberry Pi Air Quality Monitor A simple air quality monitoring service for the Raspberry Pi. Installation Clone the repository and run the following

rydercalmdown 24 Dec 9, 2022
MaRS - a recursive filtering framework that allows for truly modular multi-sensor integration

The Modular and Robust State-Estimation Framework, or short, MaRS, is a recursive filtering framework that allows for truly modular multi-sensor integration

Control of Networked Systems - University of Klagenfurt 143 Dec 29, 2022
Demo code for ICCV 2021 paper "Sensor-Guided Optical Flow"

Sensor-Guided Optical Flow Demo code for "Sensor-Guided Optical Flow", ICCV 2021 This code is provided to replicate results with flow hints obtained f

null 10 Mar 16, 2022
Fast and robust clustering of point clouds generated with a Velodyne sensor.

Depth Clustering This is a fast and robust algorithm to segment point clouds taken with Velodyne sensor into objects. It works with all available Velo

Photogrammetry & Robotics Bonn 957 Dec 21, 2022
DeepLearning Anomalies Detection with Bluetooth Sensor Data

Final Year Project. Constructing models to create offline anomalies detection using Travel Time Data collected from Bluetooth sensors along the route.

null 1 Jan 10, 2022
Scikit-event-correlation - Event Correlation and Forecasting over High Dimensional Streaming Sensor Data algorithms

scikit-event-correlation Event Correlation and Changing Detection Algorithm Theo

Intellia ICT 5 Oct 30, 2022