[ACMMM 2021, Oral] Code release for "Elastic Tactile Simulation Towards Tactile-Visual Perception"

Yikai Wang

Last update: Dec 20, 2022

Related tags

Overview

EIP: Elastic Interaction of Particles

Code release for "Elastic Tactile Simulation Towards Tactile-Visual Perception", in ACMMM (Oral) 2021.

By Yikai Wang, Wenbing Huang, Bin Fang, Fuchun Sun, Chang Li.

If you find our work useful for your research, please consider citing the following paper.

@inproceedings{wang2021eip,
  title={Elastic Tactile Simulation Towards Tactile-Visual Perception},
  author={Wang, Yikai and Huang, Wenbing and Fang, Bin and Sun, Fuchun and Li, Chang},
  booktitle={ACM International Conference on Multimedia (ACM MM)},
  year={2021}
}

Dependencies

python==3.7.6
taichi==0.6.32
pytorch==1.6.0
pytorch3d==0.2.5
imageio==2.9.0
open3d==0.11.0
opencv-python==4.4.0
openexr==2.4.1

Scripts

First, transform mesh to voxels

python mesh2voxel.py --path obj_path  # e.g., obj/torus.obj

Then perform EIP, for example,

python show_torus_vertical.py --name exp_name

Will obtain fine-grained tacile patterns like,

Simulated particles of the tactile sensor will be automatically saved, which can be visualized with Meshlab,

Particles can be reconstructed to meshes by Meshlab (e.g., Surface Reconstruction). We adopt Mitsuba for rendering.

We thank a lot for the flexible codebase of Taichi.

License

EIP is released under MIT License.

This repo is the code release of EMNLP 2021 conference paper "Connect-the-Dots: Bridging Semantics between Words and Definitions via Aligning Word Sense Inventories".

Connect-the-Dots: Bridging Semantics between Words and Definitions via Aligning Word Sense Inventories This repo is the code release of EMNLP 2021 con

12 Nov 22, 2022

Code for "NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Video", CVPR 2021 oral

NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Video Project Page | Paper NeuralRecon: Real-Time Coherent 3D Reconstruction from Mon

1.4k Dec 30, 2022

Code for "Single-view robot pose and joint angle estimation via render & compare", CVPR 2021 (Oral).

Single-view robot pose and joint angle estimation via render & compare Yann Labbé, Justin Carpentier, Mathieu Aubry, Josef Sivic CVPR: Conference on C

51 Oct 14, 2022

Code for CVPR 2021 oral paper "Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts"

Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts The rapid progress in 3D scene understanding has come with growing dem

182 Dec 30, 2022

Code for "Reconstructing 3D Human Pose by Watching Humans in the Mirror", CVPR 2021 oral

Reconstructing 3D Human Pose by Watching Humans in the Mirror Qi Fang*, Qing Shuai*, Junting Dong, Hujun Bao, Xiaowei Zhou CVPR 2021 Oral The videos a

178 Dec 13, 2022

Code for "Human Pose Regression with Residual Log-likelihood Estimation", ICCV 2021 Oral

Human Pose Regression with Residual Log-likelihood Estimation [Paper] [arXiv] [Project Page] Human Pose Regression with Residual Log-likelihood Estima

347 Dec 24, 2022

This is the code for CVPR 2021 oral paper: Jigsaw Clustering for Unsupervised Visual Representation Learning

JigsawClustering Jigsaw Clustering for Unsupervised Visual Representation Learning Pengguang Chen, Shu Liu, Jiaya Jia Introduction This project provid

73 Sep 18, 2022

Code for the ICCV 2021 paper "Pixel Difference Networks for Efficient Edge Detection" (Oral).

Pixel Difference Convolution This repository contains the PyTorch implementation for "Pixel Difference Networks for Efficient Edge Detection" by Zhuo

236 Dec 21, 2022

Official PyTorch code of DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimization (ICCV 2021 Oral).

DeepPanoContext (DPC) [Project Page (with interactive results)][Paper] DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context G

66 Nov 16, 2022

Comments

Reference for installation and running log

conda create -n EIP python=3.7
conda install pytorch torchvision torchaudio cudatoolkit=10.2
pip install taichi==0.6.32
pip install pytorch3d==0.2.5 imageio==2.9.0 open3d==0.11.0 opencv-python==4.4.0
pip install openexr

apt install libtinfo5

# Anaconda Cloud
conda install pytorch3d -c pytorch3d-nightly
``

opened by yyf17 2

[ACMMM 2021, Oral] Code release for "Elastic Tactile Simulation Towards Tactile-Visual Perception"

Related tags

Overview

EIP: Elastic Interaction of Particles

Dependencies

Scripts

License

You might also like...

This repo is the code release of EMNLP 2021 conference paper "Connect-the-Dots: Bridging Semantics between Words and Definitions via Aligning Word Sense Inventories".

Code for "NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Video", CVPR 2021 oral

Code for "Single-view robot pose and joint angle estimation via render & compare", CVPR 2021 (Oral).

Code for CVPR 2021 oral paper "Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts"

Code for "Reconstructing 3D Human Pose by Watching Humans in the Mirror", CVPR 2021 oral

Code for "Human Pose Regression with Residual Log-likelihood Estimation", ICCV 2021 Oral

This is the code for CVPR 2021 oral paper: Jigsaw Clustering for Unsupervised Visual Representation Learning

Code for the ICCV 2021 paper "Pixel Difference Networks for Efficient Edge Detection" (Oral).

Official PyTorch code of DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimization (ICCV 2021 Oral).

Comments

Reference for installation and running log

Owner

Yikai Wang

CoReD: Generalizing Fake Media Detection with Continual Representation using Distillation (ACMMM'21 Oral Paper)

【ACMMM 2021】DSANet: Dynamic Segment Aggregation Network for Video-Level Representation Learning

Code Release for ICCV 2021 (oral), "AdaFit: Rethinking Learning-based Normal Estimation on Point Clouds"

Code release for "Transferable Semantic Augmentation for Domain Adaptation" (CVPR 2021)

Code release for "Self-Tuning for Data-Efficient Deep Learning" (ICML 2021)

Code release for the ICML 2021 paper "PixelTransformer: Sample Conditioned Signal Generation".

Code release for ICCV 2021 paper "Anticipative Video Transformer"

Official code release for ICCV 2021 paper SNARF: Differentiable Forward Skinning for Animating Non-rigid Neural Implicit Shapes.

Official code release for "Learned Spatial Representations for Few-shot Talking-Head Synthesis" ICCV 2021