The Incredible PyTorch: a curated list of tutorials, papers, projects, communities and more relating to PyTorch.

Overview


This is a curated list of tutorials, projects, libraries, videos, papers, books and anything related to the incredible PyTorch. Feel free to make a pull request to contribute to this list.

Table Of Contents

Tabular Data

Tutorials

Visualization

Explainability

Object Detection

Long-Tailed / Out-of-Distribution Recognition

Activation Functions

Energy-Based Learning

Missing Data

Architecture Search

Optimization

Quantization

Quantum Machine Learning

Neural Network Compression

Facial, Action and Pose Recognition

Super resolution

Synthetesizing Views

Voice

Medical

3D Segmentation, Classification and Regression

Video Recognition

Recurrent Neural Networks (RNNs)

Convolutional Neural Networks (CNNs)

Segmentation

Geometric Deep Learning: Graph & Irregular Structures

Sorting

Ordinary Differential Equations Networks

Multi-task Learning

GANs, VAEs, and AEs

Unsupervised Learning

Adversarial Attacks

Style Transfer

Image Captioning

Transformers

Similarity Networks and Functions

Reasoning

General NLP

Question and Answering

Speech Generation and Recognition

Document and Text Classification

Text Generation

Translation

Sentiment Analysis

Deep Reinforcement Learning

Deep Bayesian Learning and Probabilistic Programmming

Spiking Neural Networks

Anomaly Detection

Regression Types

Time Series

Synthetic Datasets

Neural Network General Improvements

DNN Applications in Chemistry and Physics

New Thinking on General Neural Network Architecture

Linear Algebra

API Abstraction

Low Level Utilities

PyTorch Utilities

PyTorch Video Tutorials

Datasets

Community

Links to This Repository

To be Classified

Contributions

Do feel free to contribute!

You can raise an issue or submit a pull request, whichever is more convenient for you. The guideline is simple: just follow the format of the previous bullet point.

Issues
  • Image Captioning paper

    Image Captioning paper

    Hello, Thanks for the amazing collection. But I would like to point out one thing - in the image captioning topic there are three mentioned papers which are correct if we see the captioning field but since this collection is about pytorch I was confuse why the 'DenceCap' paper is there because the paper is on lua, lua with torch.

    opened by AnukritiSinghh 6
  • Added Video

    Added Video

    Added link to videos. Now, we have 4 videos but will be updated one or two per week.

    opened by hunkim 3
  • Added Catalyst framework

    Added Catalyst framework

    Catalyst was developed with a focus on reproducibility, fast experimentation and code/ideas reusing. Being able to research/develop something new, rather than write another regular train loop.

    Features

    • Universal train/inference loop.
    • Configuration files for model/data hyperparameters.
    • Reproducibility – all source code and environment variables will be saved.
    • Callbacks – reusable train/inference pipeline parts.
    • Training stages support.
    • Easy customization.
    • PyTorch best practices (SWA, AdamW, 1Cycle, FP16 and more).

    Structure

    • DL – runner for training and inference, all of the classic machine learning and computer vision metrics and a variety of callbacks for training, validation, and inference of neural networks.
    • RL – scalable Reinforcement Learning, on-policy & off-policy algorithms and their improvements with distributed training support.
    • contrib - additional modules contributed by Catalyst users.
    • data - useful tools and scripts for data processing.
    opened by TezRomacH 3
  • #16 mispelling

    #16 mispelling

    You have:

    1. Synthetesizing Views

    It rather should be:

    1. Synthesizing Views
    opened by QuothTheRaven42 3
  • Tabular Data Category : pytorch-tabnet

    Tabular Data Category : pytorch-tabnet

    To my surprise there is no tabular data category in the list, while it’s probably the most common type of data you encounter in Machine Learning.

    I would suggest adding pytorch-tabnet to the newly created « Tabular Data » category. Pytorch-tabnet allows easy training of TabNet model (attention based model for tabular data) for binary/multi-class classification, regression and multi-target regression.

    Hope you’ll like the repo and share the love!

    https://github.com/dreamquark-ai/tabnet

    Thanks!

    opened by Optimox 3
  • new content : Fast Scattering Transform with CuPy/PyTorch

    new content : Fast Scattering Transform with CuPy/PyTorch

    https://github.com/edouardoyallon/pyscatwave May add it to the list

    opened by cj9208 2
  • Unsupervised Learning of Depth and Ego-Motion from Video was not originally implemented in pytorch

    Unsupervised Learning of Depth and Ego-Motion from Video was not originally implemented in pytorch

    Hello, thanks a lot for your nice repo !

    You introduced the paper "Unsupervised Learning of Depth and Ego-Motion from Video" and the implementation I've done (https://github.com/ClementPinard/SfmLearner-Pytorch) as "Papers Originally Implemented with PyTorch" , but the original implementation is in Tensorflow, made by tinghuiz : https://github.com/tinghuiz/SfMLearner

    bug 
    opened by ClementPinard 2
  • Include yunjey pytorch tutorial

    Include yunjey pytorch tutorial

    I think the incredible pytorch would benefit from referencing this well written tutorial on pytorch https://github.com/yunjey/pytorch-tutorial

    opened by obust 2
  • Return the Catalyst framework

    Return the Catalyst framework

    Catalyst was accidentally removed in this commit so I return it.

    As I previously noticed at #85 :

    Catalyst – High-level utils for PyTorch DL & RL research. It was developed with a focus on reproducibility, fast experimentation and code/ideas reusing. Being able to research/develop something new, rather than write another regular train loop.

    Catalyst is used in Kaggle, Weights & Biases and ml-workspace.

    Features

    • Universal train/inference loop.
    • Configuration files for model/data hyperparameters.
    • Reproducibility – all source code and environment variables will be saved.
    • Callbacks – reusable train/inference pipeline parts.
    • Training stages support.
    • Easy customization.
    • PyTorch best practices (SWA, AdamW, OneCycle, Ranger optimizer, FP16 and more).
    opened by TezRomacH 1
  • implementation of DNI

    implementation of DNI

    opened by andrewliao11 1
  • Privacy preserving machine learning category

    Privacy preserving machine learning category

    Let's add a category with papers, tutorials and notebooks on privacy preserving ML leveraging pytorch

    opened by Boluwatifeh 4
  • Books

    Books

    opened by ThejeshKumar 1
  • Explain each category?

    Explain each category?

    This list looks amazing! One thing that I think would be cool for newbies is to explain the category in a paragraph or two.

    For example, what is 'Architecture Search' and what is it useful for.

    enhancement 
    opened by sradu 3
Owner
Ritchie Ng
About: ritchieng.live • Notes: ritchieng.com • Guides: deeplearningwizard.com
Ritchie Ng
A list of multi-task learning papers and projects.

This page contains a list of papers on multi-task learning for computer vision. Please create a pull request if you wish to add anything. If you are interested, consider reading our recent survey paper.

svandenh 170 Nov 22, 2021
A list of multi-task learning papers and projects.

A list of multi-task learning papers and projects.

svandenh 84 Apr 27, 2021
Repository relating to the CVPR21 paper TimeLens: Event-based Video Frame Interpolation

TimeLens: Event-based Video Frame Interpolation This repository is about the High Speed Event and RGB (HS-ERGB) dataset, used in the 2021 CVPR paper T

Robotics and Perception Group 439 Nov 25, 2021
arxiv-sanity, but very lite, simply providing the core value proposition of the ability to tag arxiv papers of interest and have the program recommend similar papers.

arxiv-sanity, but very lite, simply providing the core value proposition of the ability to tag arxiv papers of interest and have the program recommend similar papers.

Andrej 168 Nov 27, 2021
The tl;dr on a few notable transformer/language model papers + other papers (alignment, memorization, etc).

The tl;dr on a few notable transformer/language model papers + other papers (alignment, memorization, etc).

Will Thompson 146 Nov 8, 2021
A curated list of awesome resources related to Semantic Search🔎 and Semantic Similarity tasks.

A curated list of awesome resources related to Semantic Search?? and Semantic Similarity tasks.

null 122 Nov 26, 2021
A curated list of resources for Image and Video Deblurring

A curated list of resources for Image and Video Deblurring

Subeesh Vasu 1.1k Dec 2, 2021
A curated list of neural network pruning resources.

A curated list of neural network pruning and related resources. Inspired by awesome-deep-vision, awesome-adversarial-machine-learning, awesome-deep-learning-papers and Awesome-NAS.

Yang He 1.3k Nov 26, 2021
A curated (most recent) list of resources for Learning with Noisy Labels

A curated (most recent) list of resources for Learning with Noisy Labels

Jiaheng Wei 115 Nov 29, 2021
A curated list of neural rendering resources.

Awesome-of-Neural-Rendering A curated list of neural rendering and related resources. Please feel free to pull requests or open an issue to add papers

Zhiwei ZHANG 32 Nov 12, 2021
A list of papers regarding generalization in (deep) reinforcement learning

A list of papers regarding generalization in (deep) reinforcement learning

Kaixin WANG 13 Apr 26, 2021
A list of papers about point cloud based place recognition, also known as loop closure detection in SLAM (processing)

A list of papers about point cloud based place recognition, also known as loop closure detection in SLAM (processing)

Xin Kong 17 May 16, 2021
Simple tutorials on Pytorch DDP training

pytorch-distributed-training Distribute Dataparallel (DDP) Training on Pytorch Features Easy to study DDP training You can directly copy this code for

Ren Tianhe 117 Nov 22, 2021
Pytorch tutorials for Neural Style transfert

PyTorch Tutorials This tutorial is no longer maintained. Please use the official version: https://pytorch.org/tutorials/advanced/neural_style_tutorial

Alexis David Jacq 133 Nov 21, 2021
Pytorch Geometric Tutorials

Pytorch Geometric Tutorials

Antonio Longa 230 Nov 24, 2021
Useful materials and tutorials for 110-1 NTU DBME5028 (Application of Deep Learning in Medical Imaging)

Useful materials and tutorials for 110-1 NTU DBME5028 (Application of Deep Learning in Medical Imaging)

null 8 Nov 9, 2021
Repository of Jupyter notebook tutorials for teaching the Deep Learning Course at the University of Amsterdam (MSc AI), Fall 2020

Repository of Jupyter notebook tutorials for teaching the Deep Learning Course at the University of Amsterdam (MSc AI), Fall 2020

Phillip Lippe 308 Nov 26, 2021
text_recognition_toolbox: The reimplementation of a series of classical scene text recognition papers with Pytorch in a uniform way.

text recognition toolbox 1. 项目介绍 该项目是基于pytorch深度学习框架,以统一的改写方式实现了以下6篇经典的文字识别论文,论文的详情如下。该项目会持续进行更新,欢迎大家提出问题以及对代码进行贡献。 模型 论文标题 发表年份 模型方法划分 CRNN 《An End-t

null 150 Nov 24, 2021