Code for HodgeNet: Learning Spectral Geometry on Triangle Meshes, in SIGGRAPH 2021.

Related tags

Deep Learning HodgeNet
Overview

HodgeNet | Webpage | Paper | Video

HodgeNet

HodgeNet: Learning Spectral Geometry on Triangle Meshes
Dmitriy Smirnov, Justin Solomon
SIGGRAPH 2021

Set-up

To install the neecssary dependencies, run:

conda env create -f environment.yml
conda activate hodgenet

Training

To train the segmentation model, first download the Shape COSEG dataset. Then, run:

python train_segmentation.py --out out_dir --mesh_path path_to_meshes --seg_path path_to_segs

To train the classification model, first download the SHREC 2011 dataset:

wget -O shrec.tar.gz https://www.dropbox.com/s/4z4v1x30jsy0uoh/shrec.tar.gz?dl=0
tar -xvf shrec.tar.gz -C data

Then, run:

python train_classification.py --out out_dir

To train the dihedral angle stress test model, run:

python train_origami.py --out out_dir

To monitor the training, launch a TensorBoard instance with --logdir out_dir

To finetune a model, add the flag --fine_tune to the above training commands.

BibTeX

@article{smirnov2021hodgenet,
  title={{HodgeNet}: Learning Spectral Geometry on Triangle Meshes},
  author={Smirnov, Dmitriy and Solomon, Justin},
  year={2021},
  journal={SIGGRAPH}
}
Comments
  • Does the code use GPU

    Does the code use GPU

    Hi, @dmsm ,

    Thanks a lot for releasing the HodgeNet. I wonder if the code only uses CPU in running. The running doesn't initiate my GPU card and I cannot find any CUDA option in your code.

    opened by amiltonwong 2
  • The code got error.

    The code got error.

    Hi @dmsm , When I train the code in segmentation model, the code run to the hodgeautograd.py line 149， got error. I am new to code, and got the error Process finished with exit code 255. My torch is with gpu version.

    image

    opened by ziwenjie 1
  • GPU training support

    GPU training support

    Hello! Thank you for code. Is it possible to train HodgeNet on gpu partially? For instance do all calculations before eigenvalues computation on cuda, send result to cpu and then compute eigenvalues. Or there is the problem in backward pass?

    opened by kimihailv 1
  • eigen decomposition

    eigen decomposition

    Hello, as I am new to your repository, where in the code is the eigendecomposition of a large sparse matrix? and what sparse linear algebra solver did you use?

    opened by elefps 1
  • Does it run in win64?

    Does it run in win64?

    Seems there is a bunch of packages that don't have a win64 release

    ResolvePackageNotFound:

    • gnutls=3.6.13
    • libgomp=9.3.0
    • libstdcxx-ng=9.3.0
    • lame=3.100
    • libgfortran5=11.1.0
    • ncurses=6.2
    • libgfortran-ng=11.1.0
    • readline=8.1
    • nettle=3.6
    • gmp=6.2.1
    • ld_impl_linux-64=2.35.1
    • libgcc-ng=9.3.0
    • _openmp_mutex=4.5
    • openh264=2.1.1

    Thanks!

    opened by utilitydelta 0
Owner
Dima Smirnov
PhD Student @ MIT CSAIL
Dima Smirnov
GitHub
Given a 2D triangle mesh, we could randomly generate cloud points that fill in the triangle mesh

generate_cloud_points Given a 2D triangle mesh, we could randomly generate cloud points that fill in the triangle mesh. Run python disp_mesh.py Or you

Peng Yu 2 Dec 24, 2021
Learning Generative Models of Textured 3D Meshes from Real-World Images, ICCV 2021

Learning Generative Models of Textured 3D Meshes from Real-World Images This is the reference implementation of "Learning Generative Models of Texture

Dario Pavllo 115 Jan 7, 2023
Implementation of the Triangle Multiplicative module, used in Alphafold2 as an efficient way to mix rows or columns of a 2d feature map, as a standalone package for Pytorch

Triangle Multiplicative Module - Pytorch Implementation of the Triangle Multiplicative module, used in Alphafold2 as an efficient way to mix rows or c

Phil Wang 22 Oct 28, 2022
Tools to create pixel-wise object masks, bounding box labels (2D and 3D) and 3D object model (PLY triangle mesh) for object sequences filmed with an RGB-D camera.

Tools to create pixel-wise object masks, bounding box labels (2D and 3D) and 3D object model (PLY triangle mesh) for object sequences filmed with an RGB-D camera. This project prepares training and testing data for various deep learning projects such as 6D object pose estimation projects singleshotpose, as well as object detection and instance segmentation projects.

null 305 Dec 16, 2022
Picasso: A CUDA-based Library for Deep Learning over 3D Meshes

The Picasso Library is intended for complex real-world applications with large-scale surfaces, while it also performs impressively on the small-scale applications over synthetic shape manifolds. We have upgraded the point cloud modules of SPH3D-GCN from homogeneous to heterogeneous representations, and included the upgraded modules into this latest work as well. We are happy to announce that the work is accepted to IEEE CVPR2021.

null 97 Dec 1, 2022
DeepMetaHandles: Learning Deformation Meta-Handles of 3D Meshes with Biharmonic Coordinates

DeepMetaHandles (CVPR2021 Oral) [paper] [animations] DeepMetaHandles is a shape deformation technique. It learns a set of meta-handles for each given

Liu Minghua 73 Dec 15, 2022
Supplementary code for SIGGRAPH 2021 paper: Discovering Diverse Athletic Jumping Strategies

SIGGRAPH 2021: Discovering Diverse Athletic Jumping Strategies project page paper demo video Prerequisites Important Notes We suspect there are bugs i

null 54 Dec 6, 2022
Code for the SIGGRAPH 2021 paper "Consistent Depth of Moving Objects in Video".

Consistent Depth of Moving Objects in Video This repository contains training code for the SIGGRAPH 2021 paper "Consistent Depth of Moving Objects in

Google 203 Jan 5, 2023
Blender Add-On for slicing meshes with planes

MeshSlicer Blender Add-On for slicing meshes with multiple overlapping planes at once. This is a simple Blender addon to slice a silmple mesh with mul

null 52 Dec 12, 2022
The all new way to turn your boring vector meshes into the new fad in town; Voxels!

Voxelator The all new way to turn your boring vector meshes into the new fad in town; Voxels! Notes: I have not tested this on a rotated mesh. With fu

null 6 Feb 3, 2022
CoSMA: Convolutional Semi-Regular Mesh Autoencoder. From Paper "Mesh Convolutional Autoencoder for Semi-Regular Meshes of Different Sizes"

Mesh Convolutional Autoencoder for Semi-Regular Meshes of Different Sizes Implementation of CoSMA: Convolutional Semi-Regular Mesh Autoencoder arXiv p

Fraunhofer SCAI 10 Oct 11, 2022
[SIGGRAPH Asia 2021] DeepVecFont: Synthesizing High-quality Vector Fonts via Dual-modality Learning.

DeepVecFont This is the homepage for "DeepVecFont: Synthesizing High-quality Vector Fonts via Dual-modality Learning". Yizhi Wang and Zhouhui Lian. WI

Yizhi Wang 17 Dec 22, 2022
[SIGGRAPH Asia 2021] DeepVecFont: Synthesizing High-quality Vector Fonts via Dual-modality Learning.

DeepVecFont This is the homepage for "DeepVecFont: Synthesizing High-quality Vector Fonts via Dual-modality Learning". Yizhi Wang and Zhouhui Lian. WI

Yizhi Wang 5 Oct 22, 2021
Implementation for Simple Spectral Graph Convolution in ICLR 2021

Simple Spectral Graph Convolutional Overview This repo contains an example implementation of the Simple Spectral Graph Convolutional (S^2GC) model. Th

allenhaozhu 64 Dec 31, 2022
Data and Code for ACL 2021 Paper "Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning"

Introduction Code and data for ACL 2021 Paper "Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning". We cons

Pan Lu 81 Dec 27, 2022
Towers of Babel: Combining Images, Language, and 3D Geometry for Learning Multimodal Vision. ICCV 2021.

Towers of Babel: Combining Images, Language, and 3D Geometry for Learning Multimodal Vision Download links and PyTorch implementation of "Towers of Ba

Blakey Wu 40 Dec 14, 2022
Spectral Tensor Train Parameterization of Deep Learning Layers

Spectral Tensor Train Parameterization of Deep Learning Layers This repository is the official implementation of our AISTATS 2021 paper titled "Spectr

Anton Obukhov 12 Oct 23, 2022
General Virtual Sketching Framework for Vector Line Art (SIGGRAPH 2021)

General Virtual Sketching Framework for Vector Line Art - SIGGRAPH 2021 Paper | Project Page Outline Dependencies Testing with Trained Weights Trainin

Haoran MO 118 Dec 27, 2022
Implementation for "Seamless Manga Inpainting with Semantics Awareness" (SIGGRAPH 2021 issue)

Seamless Manga Inpainting with Semantics Awareness [SIGGRAPH 2021](To appear) | Project Website | BibTex Introduction: Manga inpainting fills up the d

null 101 Jan 1, 2023