Hidden-Fold Networks (HFN): Random Recurrent Residuals Using Sparse Supermasks

Ángel López García-Arias

Last update: May 19, 2022

Related tags

Deep Learning hidden-fold-networks

Overview

Hidden-Fold Networks (HFN): Random Recurrent Residuals Using Sparse Supermasks

by Ángel López García-Arias, Masanori Hashimoto, Masato Motomura, and Jaehoon Yu

Accepted at The British Machine Vision Conference (BMVC) 2021.

arXiv link

The code in this repository was originally developed from a fork of hidden-networks.

Requirements

Python 3.6 or higher. CUDA 11.0.
For library requirements see requirements.txt.

Usage

Experiment configurations are defined in yaml files under configs/.
These configurations can be overridden by setting parameters directly through arguments (see args.py).

Example 1: HFN-ResNet50, top-k%=30%, CIFAR100

python3 main.py --config configs/CIFAR100/HFN_ResNet50_3_4.yaml --multigpu 0

Example 2: HFN-ResNet50, top-k%=50%, CIFAR100, 100 epochs

python3 main.py --config configs/CIFAR100/HFN_ResNet50_3_4.yaml --multigpu 0 --top_k=0.5 --epochs 100

Code for the paper "Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks"

ON-LSTM This repository contains the code used for word-level language model and unsupervised parsing experiments in Ordered Neurons: Integrating Tree

572 Nov 21, 2022

Physics-informed convolutional-recurrent neural networks for solving spatiotemporal PDEs

PhyCRNet Physics-informed convolutional-recurrent neural networks for solving spatiotemporal PDEs Paper link: [ArXiv] By: Pu Ren, Chengping Rao, Yang

11 Aug 23, 2022

Discover hidden deepweb pages

DeepWeb Scapper Att: Demo version An simple script to scrappe deepweb to find pages. Will return if any of those exists and will save on a file. You s

77 Oct 2, 2022

Magisk module to enable hidden features on Android 12 Developer Preview 1.

Android 12 Extensions This is a Magisk module that enables hidden features on Android 12 Developer Preview 1. Features Scrolling screenshots Wallpaper

384 Jan 6, 2023

A library for hidden semi-Markov models with explicit durations

hsmmlearn hsmmlearn is a library for unsupervised learning of hidden semi-Markov models with explicit durations. It is a port of the hsmm package for

69 Dec 20, 2022

Learning to Estimate Hidden Motions with Global Motion Aggregation

Learning to Estimate Hidden Motions with Global Motion Aggregation (GMA) This repository contains the source code for our paper: Learning to Estimate

221 Dec 18, 2022

discovering subdomains, hidden paths, extracting unique links

python-website-crawler discovering subdomains, hidden paths, extracting unique links pip install -r requirements.txt discover subdomain: You can give

4 Sep 5, 2022

Code for Quantifying Ignorance in Individual-Level Causal-Effect Estimates under Hidden Confounding

🍐 quince Code for Quantifying Ignorance in Individual-Level Causal-Effect Estimates under Hidden Confounding 🍐 Installation $ git clone [email protected]

19 Jun 23, 2022

Exploit Camera Raw Data for Video Super-Resolution via Hidden Markov Model Inference

RawVSR This repo contains the official codes for our paper: Exploit Camera Raw Data for Video Super-Resolution via Hidden Markov Model Inference Xiaoh

23 Oct 8, 2022

Owner

Ángel López García-Arias

AI Computing Research Unit, Tokyo Institute of Technology

GitHub

Implementation of Bidirectional Recurrent Independent Mechanisms (Learning to Combine Top-Down and Bottom-Up Signals in Recurrent Neural Networks with Attention over Modules)

BRIMs Bidirectional Recurrent Independent Mechanisms Implementation of the paper Learning to Combine Top-Down and Bottom-Up Signals in Recurrent Neura

26 May 26, 2022

Uni-Fold: Training your own deep protein-folding models

Uni-Fold: Training your own deep protein-folding models. This package provides an implementation of a trainable, Transformer-based deep protein foldin

187 Jan 4, 2023

Differentiable Neural Computers, Sparse Access Memory and Sparse Differentiable Neural Computers, for Pytorch

Differentiable Neural Computers and family, for Pytorch Includes: Differentiable Neural Computers (DNC) Sparse Access Memory (SAM) Sparse Differentiab

302 Dec 14, 2022

Learning hidden low dimensional dyanmics using a Generalized Onsager Principle and neural networks

OnsagerNet Learning hidden low dimensional dyanmics using a Generalized Onsager Principle and neural networks This is the original pyTorch implemenati

3 Aug 24, 2022

Official implementation for NIPS'17 paper: PredRNN: Recurrent Neural Networks for Predictive Learning Using Spatiotemporal LSTMs.

PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learning The predictive learning of spatiotemporal sequences aims to generate future

243 Dec 26, 2022

Code and datasets for the paper "Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Prediction" (RA-L, 2021)

Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Prediction This is the code for the paper Combining E

69 Dec 26, 2022

Random-Afg - Afghanistan Random Old Idz Cloner Tools

AFGHANISTAN RANDOM OLD IDZ CLONER TOOLS Install $ apt update $ apt upgrade $ apt

5 Jan 26, 2022

Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"

Easy-To-Hard The official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks". Gett

52 Sep 8, 2022

An implementation of DeepMind's Relational Recurrent Neural Networks in PyTorch.

relational-rnn-pytorch An implementation of DeepMind's Relational Recurrent Neural Networks (Santoro et al. 2018) in PyTorch. Relational Memory Core (

241 Nov 18, 2022

Differentiable architecture search for convolutional and recurrent networks

Differentiable Architecture Search Code accompanying the paper DARTS: Differentiable Architecture Search Hanxiao Liu, Karen Simonyan, Yiming Yang. arX

3.7k Jan 9, 2023

Hidden-Fold Networks (HFN): Random Recurrent Residuals Using Sparse Supermasks

Related tags

Overview

Hidden-Fold Networks (HFN): Random Recurrent Residuals Using Sparse Supermasks

Requirements

Usage

Example 1: HFN-ResNet50, top-k%=30%, CIFAR100

Example 2: HFN-ResNet50, top-k%=50%, CIFAR100, 100 epochs

You might also like...

Code for the paper "Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks"

Physics-informed convolutional-recurrent neural networks for solving spatiotemporal PDEs

Discover hidden deepweb pages

Magisk module to enable hidden features on Android 12 Developer Preview 1.

A library for hidden semi-Markov models with explicit durations

Learning to Estimate Hidden Motions with Global Motion Aggregation

discovering subdomains, hidden paths, extracting unique links

Code for Quantifying Ignorance in Individual-Level Causal-Effect Estimates under Hidden Confounding

Exploit Camera Raw Data for Video Super-Resolution via Hidden Markov Model Inference

Owner

Ángel López García-Arias

Implementation of Bidirectional Recurrent Independent Mechanisms (Learning to Combine Top-Down and Bottom-Up Signals in Recurrent Neural Networks with Attention over Modules)

Uni-Fold: Training your own deep protein-folding models

Differentiable Neural Computers, Sparse Access Memory and Sparse Differentiable Neural Computers, for Pytorch

Learning hidden low dimensional dyanmics using a Generalized Onsager Principle and neural networks

Official implementation for NIPS'17 paper: PredRNN: Recurrent Neural Networks for Predictive Learning Using Spatiotemporal LSTMs.

Code and datasets for the paper "Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Prediction" (RA-L, 2021)

Random-Afg - Afghanistan Random Old Idz Cloner Tools

Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"

An implementation of DeepMind's Relational Recurrent Neural Networks in PyTorch.

Differentiable architecture search for convolutional and recurrent networks