Towards Rolling Shutter Correction and Deblurring in Dynamic Scenes (CVPR2021)

Related tags

Deep Learning RSCD
Overview

RSCD (BS-RSCD & JCD)

Towards Rolling Shutter Correction and Deblurring in Dynamic Scenes (CVPR2021)

by Zhihang Zhong, Yinqiang Zheng, Imari Sato

We contributed the first real-world dataset (BS-RSCD) and end-to-end model (JCD) for joint rolling shutter correction and deblurring task.

We collected the data samples using the proposed beam-splitter acquisition system as below:
image

In the near future, we will add more data samples with larger distortion to the dataset...

Prerequisites

Install the dependent packages:

conda create -n rscd python=3.8
conda activate rscd
sh install.sh

Download lmdb file of BS-RSCD (or Fastec-RS for RSC task).

(PS, for how to create lmdb file, you can refer to ./data/create_rscd_lmdb.ipynb)

Training

Please specify the <path> (e.g. "./dataset/ ") where you put the dataset file or change the default value in " ./para/paramter.py".

Train JCD on BS-RSCD:

python main.py --data_root <path> --model JCD --dataset rscd_lmdb --video

Train JCD on Fastec-RS:

python main.py --data_root <path> --model JCD --dataset fastec_rs_lmdb --video

Testing

Please download checkpoints and unzip it under the main directory.

Run a pre-trained model:

python main.py --test_only --test_checkpoint ./checkpoints/JCD_BS-RSCD.tar --video

Citing

If BS-RSCD and JCD are useful for your research, please consider citing:

@InProceedings{Zhong_2021_Towards,
  title={Towards Rolling Shutter Correction and Deblurring in Dynamic Scenes},
  author={Zhong, Zhihang and Zheng, Yinqiang and Sato, Imari},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
  month = {June},
  year={2021}
}
Comments
  • Dataset unavailable

    Dataset unavailable

    The dataset download address: https://drive.google.com/file/d/1hgzibaez7EipmPSN-3GzQO0_mlyruKGa/view?usp=sharing

    gives the message:

    Sorry, you can't view or download this file at this time.

    Too many users have viewed or downloaded this file recently. Please try accessing the file again later. If the file that you are trying to access is particularly large or is shared with many people, it may take up to 24 hours to be able to view or download the file. If you still can't access a file after 24 hours, contact your domain administrator.

    Please help.

    opened by agnivsen 1
  • Import error: No module named 'forward_warp_package'

    Import error: No module named 'forward_warp_package'

    Hi!

    I am facing the following error while running the training command-

    Traceback (most recent call last): File "main.py", line 7, in trainer.run() File "/home/mayanka/RSCD-main/train/trainer.py", line 40, in run test(self.para, logger) File "/home/mayanka/RSCD-main/train/trainer.py", line 251, in test model = Model(para).model.cuda() File "/home/mayanka/RSCD-main/model/model.py", line 10, in init self.module = import_module('model.{}'.format(model_name)) File "/home/mayanka/anaconda3/envs/rscd/lib/python3.8/importlib/init.py", line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "", line 1014, in _gcd_import File "", line 991, in _find_and_load File "", line 975, in _find_and_load_unlocked File "", line 671, in _load_unlocked File "", line 848, in exec_module File "", line 219, in _call_with_frames_removed File "/home/mayanka/RSCD-main/model/JCD.py", line 4, in from forward_warp_package import ForwardWarp ModuleNotFoundError: No module named 'forward_warp_package'

    It will be very helpful if someone can point me towards where to find the "forward_warp_package" package. I was unable to find it in the official python packages list.

    opened by mayankamedhe 1
  • Installing requirements

    Installing requirements

    Hello, thank you for sharing the code. I could not find meshzoo==0.4.3 version for installation. The oldest pip version is 0.9.11, while a newer version does not support xmin in rectangle.

    image

    opened by Magauiya 0
  • Critical section

    Critical section

    Hi, I want to calculate the computation time of a program and found the AverageMeter on your code. Is it possible to get a critical section problem in your code? Therefore, the time cost will be inaccurate :smiling_face_with_tear:

    image

    Thanks! :smiley:

    opened by DelinQu 0
  • The blankRow of BS-RSCD dataset

    The blankRow of BS-RSCD dataset

    Hi, I'm tring to do an experiment on your dataset but I didn't find readout ratio in dataset dir. Is there a readot or blankRow? Any suggestions would be appreciated! (the box below is the blankRow) image Thank you in advance! :smile:

    opened by DelinQu 2
Owner
Ph.D. Candidate, Department of Computer Science, The University of Tokyo
null
GitHub
This is the repository for CVPR2021 Dynamic Metric Learning: Towards a Scalable Metric Space to Accommodate Multiple Semantic Scales

Intro This is the repository for CVPR2021 Dynamic Metric Learning: Towards a Scalable Metric Space to Accommodate Multiple Semantic Scales Vehicle Sam

null 39 Jul 21, 2022
PyTorch implementation of paper "Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes", CVPR 2021

Neural Scene Flow Fields PyTorch implementation of paper "Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes", CVPR 20

Zhengqi Li 585 Jan 4, 2023
D-NeRF: Neural Radiance Fields for Dynamic Scenes

D-NeRF: Neural Radiance Fields for Dynamic Scenes [Project] [Paper] D-NeRF is a method for synthesizing novel views, at an arbitrary point in time, of

Albert Pumarola 291 Jan 2, 2023
Official PyTorch Implementation of paper "Deep 3D Mask Volume for View Synthesis of Dynamic Scenes", ICCV 2021.

Deep 3D Mask Volume for View Synthesis of Dynamic Scenes Official PyTorch Implementation of paper "Deep 3D Mask Volume for View Synthesis of Dynamic S

Ken Lin 17 Oct 12, 2022
[CVPR2021] The source code for our paper 《Removing the Background by Adding the Background: Towards Background Robust Self-supervised Video Representation Learning》.

TBE The source code for our paper "Removing the Background by Adding the Background: Towards Background Robust Self-supervised Video Representation Le

Jinpeng Wang 150 Dec 28, 2022
Official implementation of "Towards Good Practices for Efficiently Annotating Large-Scale Image Classification Datasets" (CVPR2021)

Towards Good Practices for Efficiently Annotating Large-Scale Image Classification Datasets This is the official implementation of "Towards Good Pract

Sanja Fidler's Lab 52 Nov 22, 2022
The official implementation of the CVPR2021 paper: Decoupled Dynamic Filter Networks

Decoupled Dynamic Filter Networks This repo is the official implementation of CVPR2021 paper: "Decoupled Dynamic Filter Networks". Introduction DDF is

F.S.Fire 180 Dec 30, 2022
DeFMO: Deblurring and Shape Recovery of Fast Moving Objects (CVPR 2021)

Evaluation, Training, Demo, and Inference of DeFMO DeFMO: Deblurring and Shape Recovery of Fast Moving Objects (CVPR 2021) Denys Rozumnyi, Martin R. O

Denys Rozumnyi 139 Dec 26, 2022
SimDeblur is a simple framework for image and video deblurring, implemented by PyTorch

SimDeblur (Simple Deblurring) is an open source framework for image and video deblurring toolbox based on PyTorch, which contains most deep-learning based state-of-the-art deblurring algorithms. It is easy to implement your own image or video deblurring or other restoration algorithms.

null 220 Jan 7, 2023
PyTorch implementation of Graph Convolutional Networks in Feature Space for Image Deblurring and Super-resolution, IJCNN 2021.

GCResNet PyTorch implementation of Graph Convolutional Networks in Feature Space for Image Deblurring and Super-resolution, IJCNN 2021. The code will

null 11 May 19, 2022
A curated list of resources for Image and Video Deblurring

A curated list of resources for Image and Video Deblurring

Subeesh Vasu 1.7k Jan 1, 2023
Cascaded Deep Video Deblurring Using Temporal Sharpness Prior and Non-local Spatial-Temporal Similarity

This repository is the official PyTorch implementation of Cascaded Deep Video Deblurring Using Temporal Sharpness Prior and Non-local Spatial-Temporal Similarity

hippopmonkey 4 Dec 11, 2022
Image Deblurring using Generative Adversarial Networks

DeblurGAN arXiv Paper Version Pytorch implementation of the paper DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networks. Our netwo

Orest Kupyn 2.2k Jan 1, 2023
Exploring Image Deblurring via Blur Kernel Space (CVPR'21)

Exploring Image Deblurring via Encoded Blur Kernel Space About the project We introduce a method to encode the blur operators of an arbitrary dataset

VinAI Research 118 Dec 19, 2022
[CVPR 2021] Official PyTorch Implementation for "Iterative Filter Adaptive Network for Single Image Defocus Deblurring"

IFAN: Iterative Filter Adaptive Network for Single Image Defocus Deblurring Checkout for the demo (GUI/Google Colab)! The GUI version might occasional

Junyong Lee 173 Dec 30, 2022
[ICCV 2021] Official Tensorflow Implementation for "Single Image Defocus Deblurring Using Kernel-Sharing Parallel Atrous Convolutions"

KPAC: Kernel-Sharing Parallel Atrous Convolutional block This repository contains the official Tensorflow implementation of the following paper: Singl

Hyeongseok Son 50 Dec 29, 2022
Dynamic View Synthesis from Dynamic Monocular Video

Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer This repository contains code to compute depth from a

Intelligent Systems Lab Org 2.3k Jan 1, 2023
Dynamic View Synthesis from Dynamic Monocular Video

Dynamic View Synthesis from Dynamic Monocular Video Project Website | Video | Paper Dynamic View Synthesis from Dynamic Monocular Video Chen Gao, Ayus

Chen Gao 139 Dec 28, 2022
Dynamic vae - Dynamic VAE algorithm is used for anomaly detection of battery data

Dynamic VAE frame Automatic feature extraction can be achieved by probability di

null 10 Oct 7, 2022