The 7th edition of NTIRE: New Trends in Image Restoration and Enhancement workshop will be held on June 2022 in conjunction with CVPR 2022.

Overview

NTIRE 2022 - Image Inpainting Challenge

Important dates

  • 2022.02.01: Release of train data (input and output images) and validation data (only input)
  • 2022.02.01: Validation server online
  • 2022.03.13: Final test data release (only input images)
  • 2022.03.20: Test output results submission deadline
  • 2022.03.20: Fact sheets and code/executable submission deadline
  • 2022.03.22: Preliminary test results release to the participants
  • 2022.04.01: Paper submission deadline for entries from the challenge
  • 2022.06.19: Workshop day

Description

The 7th edition of NTIRE: New Trends in Image Restoration and Enhancement workshop will be held on June 2022 in conjunction with CVPR 2022.

Image manipulation is a key computer vision task, aiming at the restoration of degraded image content, the filling in of missing information, or the needed transformation and/or manipulation to achieve the desired target (with respect to perceptual quality, contents, or performance of apps working on such images). Recent years have witnessed an increased interest from the vision and graphics communities in these fundamental topics of research. Not only has there been a constantly growing flow of related papers, but also substantial progress has been achieved.

Recently, there has been a substantial increase in the number of published papers that directly or indirectly address Image Inpainting. Due to a lack of a standardized framework, it is difficult for a new method to perform a comprehensive and fair comparison with respect to existing solutions. This workshop aims to provide an overview of the new trends and advances in those areas. Moreover, it will offer an opportunity for academic and industrial attendees to interact and explore collaborations.

Jointly with the NTIRE workshop, we have an NTIRE challenge on Image Inpainting, that is, the task of predicting the values of missing pixels in an image so that the completed result looks realistic and coherent. This challenge has 3 main objectives:

  1. Direct comparison of recent state-of-the-art Image Inpainting solutions, which will be considered as baselines. See baselines.
  2. To perform a comprehensive analysis on the different types of masks, for instance, strokes, half completion, nearest neighbor upsampling, etc. Thus, highlighting the pros and cons of each method for each type of mask. See Type of masks.
  3. To set a public benchmark on 4 different datasets (FFHQ, Places, ImageNet, and WikiArt) for direct and easy comparison. See data.

This challenge has 2 tracks:

Main Goal

The aim is to obtain a mask agnostic network design/solution capable of producing high-quality results with the best perceptual quality with respect to the ground truth.

Type of Masks

In addition to the typical strokes, with this challenge, we aim at more generalizable solutions.

Thick Strokes Medium Strokes Thin Strokes
Every_N_Lines Completion Expand
Nearest_Neighbor

Data

Following a common practice in Image Inpainting methods, we use three popular datasets for our challenge: FFHQ, Places, and ImageNet. Additionally, to explore a new benchmark, we also use the WikiArt dataset to tackle inpainting towards art creation. See the data for more info about downloading the datasets.

Competition

The top-ranked participants will be awarded and invited to follow the CVPR submission guide for workshops to describe their solutions and to submit to the associated NTIRE workshop at CVPR 2022.

Evaluation

See Evaluation.

Provided Resources

  • Scripts: With the dataset, the organizers will provide scripts to facilitate the reproducibility of the images and performance evaluation results after the validation server is online. More information is provided on the data page.
  • Contact: You can use the forum on the data description page (Track1 and Track 2 - highly recommended!) or directly contact the challenge organizers by email (me [at] afromero.co, a.castillo13 [at] uniandes.edu.co, and Radu.Timofte [at] vision.ee.ethz.ch) if you have doubts or any question.

Issues and questions:

In case of any questions about the challenge or the toolkit, feel free to open an issue on Github.

Organizers

Terms and conditions

The terms and conditions for participating in the challenge are provided here

Shout-outs

Thanks to everyone who makes their code and models available. In particular,

Issues
  • Can not download the pre-trained weights of ArtificiallyInspired in track1

    Can not download the pre-trained weights of ArtificiallyInspired in track1

    When i run the download_models.py in track1, there was error as follow:

    Traceback (most recent call last): File "download_models.py", line 11, in wget.download('https://ntire-inspired.s3.us-west-2.amazonaws.com/test_submit/track1.zip', out=download_path) File "/home/mingqi/.conda/envs/torch18/lib/python3.6/site-packages/wget.py", line 316, in download (tmpfile, headers) = ThrowOnErrorOpener().retrieve(url, tmpfile, callback) File "/home/mingqi/.conda/envs/torch18/lib/python3.6/urllib/request.py", line 1822, in retrieve fp = self.open(url, data) File "/home/mingqi/.conda/envs/torch18/lib/python3.6/urllib/request.py", line 1788, in open return getattr(self, name)(url) File "/home/mingqi/.conda/envs/torch18/lib/python3.6/urllib/request.py", line 1998, in open_https return self._open_generic_http(self._https_connection, url, data) File "/home/mingqi/.conda/envs/torch18/lib/python3.6/urllib/request.py", line 1963, in _open_generic_http response.status, response.reason, response.msg, data) File "/home/mingqi/.conda/envs/torch18/lib/python3.6/urllib/request.py", line 1983, in http_error return self.http_error_default(url, fp, errcode, errmsg, headers) File "/home/mingqi/.conda/envs/torch18/lib/python3.6/site-packages/wget.py", line 287, in http_error_default raise Exception("{0}: {1}".format(errcode, errmsg)) Exception: 404: Not Found

    opened by mingqizhang 6
Owner
Andrés Romero
Postdoctoral Researcher
Andrés Romero
This is the official implementation code repository of Underwater Light Field Retention : Neural Rendering for Underwater Imaging (Accepted by CVPR Workshop2022 NTIRE)

Underwater Light Field Retention : Neural Rendering for Underwater Imaging (UWNR) (Accepted by CVPR Workshop2022 NTIRE) Authors: Tian Ye†, Sixiang Che

jmucsx 8 Jun 23, 2022
Code for Dual Contrastive Learning for Unsupervised Image-to-Image Translation, NTIRE, CVPRW 2021.

arXiv Dual Contrastive Learning Adversarial Generative Networks (DCLGAN) We provide our PyTorch implementation of DCLGAN, which is a simple yet powerf

null 101 Jun 27, 2022
Lowest memory consumption and second shortest runtime in NTIRE 2022 challenge on Efficient Super-Resolution

FMEN Lowest memory consumption and second shortest runtime in NTIRE 2022 on Efficient Super-Resolution. Our paper: Fast and Memory-Efficient Network T

null 21 Jun 28, 2022
Code in conjunction with the publication 'Contrastive Representation Learning for Hand Shape Estimation'

HanCo Dataset & Contrastive Representation Learning for Hand Shape Estimation Code in conjunction with the publication: Contrastive Representation Lea

Computer Vision Group, Albert-Ludwigs-Universität Freiburg 33 May 2, 2022
RANZCR-CLiP 7th Place Solution

RANZCR-CLiP 7th Place Solution This repository is WIP. (18 Mar 2021) Installation git clone https://github.com/analokmaus/kaggle-ranzcr-clip-public.gi

Hiroshechka Y 22 Jan 22, 2022
7th place solution of Human Protein Atlas - Single Cell Classification on Kaggle

kaggle-hpa-2021-7th-place-solution Code for 7th place solution of Human Protein Atlas - Single Cell Classification on Kaggle. A description of the met

null 8 Jul 9, 2021
[CVPR 2022] Back To Reality: Weak-supervised 3D Object Detection with Shape-guided Label Enhancement

Back To Reality: Weak-supervised 3D Object Detection with Shape-guided Label Enhancement Announcement ?? We have not tested the code yet. We will fini

Xiuwei Xu 6 Mar 30, 2022
Implementation for "Exploiting Aliasing for Manga Restoration" (CVPR 2021)

[CVPR Paper](To appear) | [Project Website](To appear) | BibTex Introduction As a popular entertainment art form, manga enriches the line drawings det

null 129 Jun 23, 2022
Official repository for "Restormer: Efficient Transformer for High-Resolution Image Restoration". SOTA for motion deblurring, image deraining, denoising (Gaussian/real data), and defocus deblurring.

Restormer: Efficient Transformer for High-Resolution Image Restoration Syed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat, Fahad Shahbaz Khan,

Syed Waqas Zamir 676 Jul 4, 2022
From Fidelity to Perceptual Quality: A Semi-Supervised Approach for Low-Light Image Enhancement (CVPR'2020)

Under-exposure introduces a series of visual degradation, i.e. decreased visibility, intensive noise, and biased color, etc. To address these problems, we propose a novel semi-supervised learning approach for low-light image enhancement.

Yang Wenhan 103 Jun 20, 2022
MATLAB codes of the book "Digital Image Processing Fourth Edition" converted to Python

Digital Image Processing Python MATLAB codes of the book "Digital Image Processing Fourth Edition" converted to Python TO-DO: Refactor scripts, curren

Merve Noyan 23 Jun 10, 2022
[CVPR 2022] CoTTA Code for our CVPR 2022 paper Continual Test-Time Domain Adaptation

CoTTA Code for our CVPR 2022 paper Continual Test-Time Domain Adaptation Prerequisite Please create and activate the following conda envrionment. To r

Qin Wang 42 Jun 24, 2022
LSTMs (Long Short Term Memory) RNN for prediction of price trends

Price Prediction with Recurrent Neural Networks LSTMs BTC-USD price prediction with deep learning algorithm. Artificial Neural Networks specifically L

null 5 Nov 12, 2021
Image Restoration Toolbox (PyTorch). Training and testing codes for DPIR, USRNet, DnCNN, FFDNet, SRMD, DPSR, BSRGAN, SwinIR

Image Restoration Toolbox (PyTorch). Training and testing codes for DPIR, USRNet, DnCNN, FFDNet, SRMD, DPSR, BSRGAN, SwinIR

Kai Zhang 1.7k Jun 29, 2022
Multi-Stage Progressive Image Restoration

Multi-Stage Progressive Image Restoration Syed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat, Fahad Shahbaz Khan, Ming-Hsuan Yang, and Ling Sh

Syed Waqas Zamir 737 Jun 29, 2022
(under submission) Bayesian Integration of a Generative Prior for Image Restoration

BIGPrior: Towards Decoupling Learned Prior Hallucination and Data Fidelity in Image Restoration Authors: Majed El Helou, and Sabine Süsstrunk {Note: p

Majed El Helou 21 Apr 17, 2022
HINet: Half Instance Normalization Network for Image Restoration

HINet: Half Instance Normalization Network for Image Restoration Liangyu Chen, Xin Lu, Jie Zhang, Xiaojie Chu, Chengpeng Chen Paper: https://arxiv.org

null 267 Jun 17, 2022
This is an implementation for the CVPR2020 paper "Learning Invariant Representation for Unsupervised Image Restoration"

Learning Invariant Representation for Unsupervised Image Restoration (CVPR 2020) Introduction This is an implementation for the paper "Learning Invari

GarField 84 Jun 20, 2022
EDPN: Enhanced Deep Pyramid Network for Blurry Image Restoration

EDPN: Enhanced Deep Pyramid Network for Blurry Image Restoration Ruikang Xu, Zeyu Xiao, Jie Huang, Yueyi Zhang, Zhiwei Xiong. EDPN: Enhanced Deep Pyra

null 66 May 11, 2022