Code Release for the paper "TriBERT: Full-body Human-centric Audio-visual Representation Learning for Visual Sound Separation"

UBC Computer Vision Group

Last update: Aug 31, 2022

Related tags

Deep Learning TriBERT

Overview

TriBERT

This repository contains the code for the NeurIPS 2021 paper titled "TriBERT: Full-body Human-centric Audio-visual Representation Learning for Visual Sound Separation".

Code, pretrained models, and pre-processed data will be available soon.

You might also like...

The code release of paper Low-Light Image Enhancement with Normalizing Flow

[AAAI 2022] Low-Light Image Enhancement with Normalizing Flow Paper | Project Page Low-Light Image Enhancement with Normalizing Flow Yufei Wang, Renji

176 Jan 6, 2023

Code release for NeX: Real-time View Synthesis with Neural Basis Expansion

NeX: Real-time View Synthesis with Neural Basis Expansion Project Page | Video | Paper | COLAB | Shiny Dataset We present NeX, a new approach to novel

536 Dec 20, 2022

Code release for "Transferable Semantic Augmentation for Domain Adaptation" (CVPR 2021)

Transferable Semantic Augmentation for Domain Adaptation Code release for "Transferable Semantic Augmentation for Domain Adaptation" (CVPR 2021) Paper

66 Dec 16, 2022

Code release for "COTR: Correspondence Transformer for Matching Across Images"

COTR: Correspondence Transformer for Matching Across Images This repository contains the inference code for COTR. We plan to release the training code

360 Jan 6, 2023

We will release the code of "ConTNet: Why not use convolution and transformer at the same time?" in this repo

ConTNet Introduction ConTNet (Convlution-Tranformer Network) is proposed mainly in response to the following two issues: (1) ConvNets lack a large rec

93 Nov 8, 2022

This is the dataset and code release of the OpenRooms Dataset.

95 Jan 8, 2023

Code release for DS-NeRF (Depth-supervised Neural Radiance Fields)

Depth-supervised NeRF: Fewer Views and Faster Training for Free Project | Paper | YouTube Pytorch implementation of our method for learning neural rad

524 Jan 8, 2023

Code release for BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Images

BlockGAN Code release for BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Images BlockGAN: Learning 3D Object-aware Scene Rep

41 May 18, 2022

Code Release for Learning to Adapt to Evolving Domains

EAML Code release for "Learning to Adapt to Evolving Domains" (NeurIPS 2020) Prerequisites PyTorch = 0.4.0 (with suitable CUDA and CuDNN version) tor

23 Dec 7, 2022

Comments

Dataset directory structure and datasets

Hi: Thank you very much for your excellent work. Could you please send me the data in the file below to learn the following, I don't know what file is in the file path below, can you tell me the directory structure, thank you very much!

    self.root_path = "/ubc/cs/research/shield/datasets/MUSIC21_dataset/preprocessed_data/music21_bert_features/music_dataset"
    self.frame_root = "/ubc/cs/research/shield/datasets/MUSIC21_dataset/preprocessed_data/music21_all_frames"
    self.audio_root = "/ubc/cs/research/shield/datasets/MUSIC21_dataset/preprocessed_data/music21_bert_features/audio_feat"
    self.pose_root = "/ubc/cs/research/shield/datasets/MUSIC21_dataset/preprocessed_data/music21_bert_features/pose_feat_split_frame"
    self.pose_bbox_path = "/ubc/cs/research/shield/datasets/MUSIC21_dataset/preprocessed_data/music21_bert_features/alphapose_bbox_json"

opened by attutude 0

Owner

UBC Computer Vision Group

University of British Columbia Computer Vision Group

GitHub

Official code release for ICCV 2021 paper SNARF: Differentiable Forward Skinning for Animating Non-rigid Neural Implicit Shapes.

235 Dec 26, 2022

This repo is the code release of EMNLP 2021 conference paper "Connect-the-Dots: Bridging Semantics between Words and Definitions via Aligning Word Sense Inventories".

Connect-the-Dots: Bridging Semantics between Words and Definitions via Aligning Word Sense Inventories This repo is the code release of EMNLP 2021 con

12 Nov 22, 2022

Code Release for the paper "TriBERT: Full-body Human-centric Audio-visual Representation Learning for Visual Sound Separation"

Related tags

Overview

TriBERT

Code, pretrained models, and pre-processed data will be available soon.

You might also like...

The code release of paper Low-Light Image Enhancement with Normalizing Flow

Code release for NeX: Real-time View Synthesis with Neural Basis Expansion

Code release for "Transferable Semantic Augmentation for Domain Adaptation" (CVPR 2021)

Code release for "COTR: Correspondence Transformer for Matching Across Images"

We will release the code of "ConTNet: Why not use convolution and transformer at the same time?" in this repo

This is the dataset and code release of the OpenRooms Dataset.

Code release for DS-NeRF (Depth-supervised Neural Radiance Fields)

Code release for BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Images

Code Release for Learning to Adapt to Evolving Domains

Comments

Dataset directory structure and datasets

Owner

UBC Computer Vision Group

This is the official code release for the paper Shape and Material Capture at Home

Code release for paper: The Boombox: Visual Reconstruction from Acoustic Vibrations

Code release to accompany paper "Geometry-Aware Gradient Algorithms for Neural Architecture Search."

Code release of paper "Deep Multi-View Stereo gone wild"

Code release for our paper, "SimNet: Enabling Robust Unknown Object Manipulation from Pure Synthetic Data via Stereo"

Code release for NeurIPS 2020 paper "Co-Tuning for Transfer Learning"

Code release for the ICML 2021 paper "PixelTransformer: Sample Conditioned Signal Generation".

Code release for ICCV 2021 paper "Anticipative Video Transformer"

Official code release for ICCV 2021 paper SNARF: Differentiable Forward Skinning for Animating Non-rigid Neural Implicit Shapes.

This repo is the code release of EMNLP 2021 conference paper "Connect-the-Dots: Bridging Semantics between Words and Definitions via Aligning Word Sense Inventories".