The repo of Feedback Networks, CVPR17

Overview

Feedback Networks http://feedbacknet.stanford.edu/

Paper: Feedback Networks, CVPR 2017.

Amir R. Zamir*,Te-Lin Wu*, Lin Sun, William B. Shen, Bertram E. Shi, Jitendra Malik, Silvio Savarese.

Feedback Networks training in Torch

============================

Requirements

Code adopted and modified from fb.resnet.torch. See the installation instructions for a step-by-step guide.

If you already have Torch installed, update nn, cunn, and cudnn.

Training

The training scripts come with several options, which can be listed with the --help flag.

th main.lua --help

To run the training, see the example run.sh, explanations below:

th main.lua -seqLength [number of feedback iterations] -sequenceOut [true for feedback false for recurrence inference] -nGPU [number of GPU]
-depth [20 to bypass] -batchSize [batch size] -dataset [cifar100] -nEpochs [number of epochs to train]
-netType [the model under models/ directory] -save [checkpoints directory to save the model] -resume [checkpoints directory to restore the model]

Testing

To run the testing, simply assign a directory of where the checkpoints are saved and turn of the testOnly flag and specify the model path as follows:

-testOnly 'true' -resume [checkpoints directory to restore the model]

Using your own criterion

You can write your own criterion and store it under the directory lib/, and require them in the models/init.lua Add another options in the opts.lua to use them while running a script, for example

cmd:option('-coarsefine', 'false', 'If using this criterion or not')
opt.coarsefine = opt.coarsefine ~= 'false'

In the bash script add

-coarsefine 'true'

Writing your own model

You can develop your own model and store in under models/, as an exmaple model of ours, models/feedback_48.lua Modify the code below the following lines within the code block, and set the netType in your running bash script or command to the name of the model you develop:

elseif opt.dataset == 'cifar100' then
   -- Model type specifies number of layers for CIFAR-100 model
You might also like...
Code for the USENIX 2017 paper: kAFL: Hardware-Assisted Feedback Fuzzing for OS Kernels

kAFL: Hardware-Assisted Feedback Fuzzing for OS Kernels Blazing fast x86-64 VM kernel fuzzing framework with performant VM reloads for Linux, MacOS an

a grammar based feedback fuzzer
a grammar based feedback fuzzer

Nautilus NOTE: THIS IS AN OUTDATE REPOSITORY, THE CURRENT RELEASE IS AVAILABLE HERE. THIS REPO ONLY SERVES AS A REFERENCE FOR THE PAPER Nautilus is a

Improving Query Representations for DenseRetrieval with Pseudo Relevance Feedback:A Reproducibility Study.

APR The repo for the paper Improving Query Representations for DenseRetrieval with Pseudo Relevance Feedback:A Reproducibility Study. Environment setu

Flexible-CLmser: Regularized Feedback Connections for Biomedical Image Segmentation

Flexible-CLmser: Regularized Feedback Connections for Biomedical Image Segmentation The skip connections in U-Net pass features from the levels of enc

Nicely is a real-time Feedback and Intervention Program Depression is a prevalent issue across all age groups, socioeconomic classes, and cultural identities.
Nicely is a real-time Feedback and Intervention Program Depression is a prevalent issue across all age groups, socioeconomic classes, and cultural identities.

Nicely is a real-time Feedback and Intervention Program Depression is a prevalent issue across all age groups, socioeconomic classes, and cultural identities.

Kaggle Feedback Prize - Evaluating Student Writing 15th solution

Kaggle Feedback Prize - Evaluating Student Writing 15th solution First of all, I would like to thank the excellent notebooks and discussions from http

This is the solution for 2nd rank in Kaggle competition: Feedback Prize - Evaluating Student Writing.

Feedback Prize - Evaluating Student Writing This is the solution for 2nd rank in Kaggle competition: Feedback Prize - Evaluating Student Writing. The

Repo for "Event-Stream Representation for Human Gaits Identification Using Deep Neural Networks"

Summary This is the code for the paper Event-Stream Representation for Human Gaits Identification Using Deep Neural Networks by Yanxiang Wang, Xian Zh

PyTorch version repo for CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenes

Study-CSRNet-pytorch This is the PyTorch version repo for CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenes

Comments
  • module 'ConvLSTM_bn' not found

    module 'ConvLSTM_bn' not found

    Hi, @amir32002 ,

    I got the following "module 'ConvLSTM_bn" error:

    root@milton-OptiPlex-9010:/data/code/feedback-networks# th main.lua --help
    /root/torch/install/bin/luajit: /root/torch/install/share/lua/5.1/trepl/init.lua:389: /root/torch/install/share/lua/5.1/trepl/init.lua:389: module 'ConvLSTM_bn' not found:No LuaRocks module found for ConvLSTM_bn
    	no field package.preload['ConvLSTM_bn']
    	no file '/root/.luarocks/share/lua/5.1/ConvLSTM_bn.lua'
    	no file '/root/.luarocks/share/lua/5.1/ConvLSTM_bn/init.lua'
    	no file '/root/torch/install/share/lua/5.1/ConvLSTM_bn.lua'
    	no file '/root/torch/install/share/lua/5.1/ConvLSTM_bn/init.lua'
    	no file './ConvLSTM_bn.lua'
    	no file '/root/torch/install/share/luajit-2.1.0-beta1/ConvLSTM_bn.lua'
    	no file '/usr/local/share/lua/5.1/ConvLSTM_bn.lua'
    	no file '/usr/local/share/lua/5.1/ConvLSTM_bn/init.lua'
    	no file '/root/.luarocks/lib/lua/5.1/ConvLSTM_bn.so'
    	no file '/root/torch/install/lib/lua/5.1/ConvLSTM_bn.so'
    	no file '/root/torch/install/lib/ConvLSTM_bn.so'
    	no file './ConvLSTM_bn.so'
    	no file '/usr/local/lib/lua/5.1/ConvLSTM_bn.so'
    	no file '/usr/local/lib/lua/5.1/loadall.so'
    stack traceback:
    	[C]: in function 'error'
    	/root/torch/install/share/lua/5.1/trepl/init.lua:389: in function 'require'
    	main.lua:14: in main chunk
    	[C]: in function 'dofile'
    	/root/torch/install/lib/luarocks/rocks/trepl/scm-1/bin/th:150: in main chunk
    	[C]: at 0x00405e40
    root@milton-OptiPlex-9010:/data/code/feedback-networks# 
    root@milton-OptiPlex-9010:/data/code/feedback-networks# 
    root@milton-OptiPlex-9010:/data/code/feedback-networks# th main.lua --help
    /root/torch/install/bin/luajit: /root/torch/install/share/lua/5.1/trepl/init.lua:389: /root/torch/install/share/lua/5.1/trepl/init.lua:389: module 'ConvLSTM_bn' not found:No LuaRocks module found for ConvLSTM_bn
    	no field package.preload['ConvLSTM_bn']
    	no file '/root/.luarocks/share/lua/5.1/ConvLSTM_bn.lua'
    	no file '/root/.luarocks/share/lua/5.1/ConvLSTM_bn/init.lua'
    	no file '/root/torch/install/share/lua/5.1/ConvLSTM_bn.lua'
    	no file '/root/torch/install/share/lua/5.1/ConvLSTM_bn/init.lua'
    	no file './ConvLSTM_bn.lua'
    	no file '/root/torch/install/share/luajit-2.1.0-beta1/ConvLSTM_bn.lua'
    	no file '/usr/local/share/lua/5.1/ConvLSTM_bn.lua'
    	no file '/usr/local/share/lua/5.1/ConvLSTM_bn/init.lua'
    	no file '/root/.luarocks/lib/lua/5.1/ConvLSTM_bn.so'
    	no file '/root/torch/install/lib/lua/5.1/ConvLSTM_bn.so'
    	no file '/root/torch/install/lib/ConvLSTM_bn.so'
    	no file './ConvLSTM_bn.so'
    	no file '/usr/local/lib/lua/5.1/ConvLSTM_bn.so'
    	no file '/usr/local/lib/lua/5.1/loadall.so'
    stack traceback:
    	[C]: in function 'error'
    	/root/torch/install/share/lua/5.1/trepl/init.lua:389: in function 'require'
    	main.lua:14: in main chunk
    	[C]: in function 'dofile'
    	/root/torch/install/lib/luarocks/rocks/trepl/scm-1/bin/th:150: in main chunk
    	[C]: at 0x00405e40
    
    

    Any suggestion to fix this issue?

    THX!

    opened by amiltonwong 5
  • Pytorch Implementation

    Pytorch Implementation

    @amir32002 Hi, amir, really appreciate for your awesome work. I want to ask that whether you will release the Pytorch implementation version. Thanks very much !!!

    opened by jimmy-dq 1
Owner
Stanford Vision and Learning Lab
Research Codebase
Stanford Vision and Learning Lab
Release of SPLASH: Dataset for semantic parse correction with natural language feedback in the context of text-to-SQL parsing

SPLASH: Semantic Parsing with Language Assistance from Humans SPLASH is dataset for the task of semantic parse correction with natural language feedba

Microsoft Research - Language and Information Technologies (MSR LIT) 35 Oct 31, 2022
Code for "3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop"

PyMAF This repository contains the code for the following paper: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop Hongwe

Hongwen Zhang 450 Dec 28, 2022
A resource for learning about ML, DL, PyTorch and TensorFlow. Feedback always appreciated :)

A resource for learning about ML, DL, PyTorch and TensorFlow. Feedback always appreciated :)

Aladdin Persson 4.7k Jan 8, 2023
The code for two papers: Feedback Transformer and Expire-Span.

transformer-sequential This repo contains the code for two papers: Feedback Transformer Expire-Span The training code is structured for long sequentia

Facebook Research 125 Dec 25, 2022
(SIGIR2020) “Asymmetric Tri-training for Debiasing Missing-Not-At-Random Explicit Feedback’’

Asymmetric Tri-training for Debiasing Missing-Not-At-Random Explicit Feedback About This repository accompanies the real-world experiments conducted i

yuta-saito 19 Dec 1, 2022
FLVIS: Feedback Loop Based Visual Initial SLAM

FLVIS Feedback Loop Based Visual Inertial SLAM 1-Video EuRoC DataSet MH_05 Handheld Test in Lab FlVIS on UAV Platform 2-Relevent Publication: Under Re

UAV Lab - HKPolyU 182 Dec 4, 2022
Official Implementation of CoSMo: Content-Style Modulation for Image Retrieval with Text Feedback

CoSMo.pytorch Official Implementation of CoSMo: Content-Style Modulation for Image Retrieval with Text Feedback, Seungmin Lee*, Dongwan Kim*, Bohyung

Seung Min Lee 54 Dec 8, 2022
Pose Detection and Machine Learning for real-time body posture analysis during exercise to provide audiovisual feedback on improvement of form.

Posture: Pose Tracking and Machine Learning for prescribing corrective suggestions to improve posture and form while exercising. This repository conta

Pratham Mehta 10 Nov 11, 2022
"Reinforcement Learning for Bandit Neural Machine Translation with Simulated Human Feedback"

This is code repo for our EMNLP 2017 paper "Reinforcement Learning for Bandit Neural Machine Translation with Simulated Human Feedback", which implements the A2C algorithm on top of a neural encoder-decoder model and benchmarks the combination under simulated noisy rewards.

Khanh Nguyen 131 Oct 21, 2022
Emulation and Feedback Fuzzing of Firmware with Memory Sanitization

BaseSAFE This repository contains the BaseSAFE Rust APIs, introduced by "BaseSAFE: Baseband SAnitized Fuzzing through Emulation". The example/ directo

Security in Telecommunications 138 Dec 16, 2022