Official repository of DeMFI (arXiv.)

Related tags

Deep Learning DeMFI
Overview

DeMFI

This is the official repository of DeMFI (Deep Joint Deblurring and Multi-Frame Interpolation).

[ArXiv_ver.]

Coming Soon.

Reference

Jihyong Oh and Munchurl Kim "DeMFI: Deep Joint Deblurring and Multi-Frame Interpolation with Flow-Guided Attentive Correlation and Recursive Boosting", arXiv preprint arXiv: 2111.09985, 2021.

BibTeX

@article{Oh2021DeMFI,
  title={DeMFI: Deep Joint Deblurring and Multi-Frame Interpolation with Flow-Guided Attentive Correlation and Recursive Boosting},
  author={Oh, Jihyong and Kim, Munchurl},
  journal={arXiv preprint arXiv:2111.09985},
  year={2021}
}
Comments
  • How to test custom png sequence?

    How to test custom png sequence?

    I'm getting this error when I attempt to run main.py. "File "C:\Users\importon\Documents\DeMFI-main\utils.py", line 533, in init raise (RuntimeError("Found 0 files in subfolders of: " + self.args.custom_path + "\n")) RuntimeError: Found 0 files in subfolders of: './custom_path'" Capture

    I've put my blurry images in the "scene1" folder. Do I need to put anything in the "sceneN" folder?

    opened by noobtoob4lyfe 9
  • Encountered several problems when running test_custom

    Encountered several problems when running test_custom

    I need to change the type of the parameter multiple_MFI from type=list in the code to type=int.

    Then I encountered the following error.

    Traceback (most recent call last): File "C:\Users\98mxr\Downloads\DeMFI\main.py", line 1198, in main() File "C:\Users\98mxr\Downloads\DeMFI\main.py", line 361, in main test_custom(final_test_loader, model_net,args, device, File "C:\Users\98mxr\Downloads\DeMFI\main.py", line 1137, in test_custom patch_forward_DeFInet_itr(model_net, input_frames, None, t_value, num_update, patch, File "C:\Users\98mxr\Downloads\DeMFI\utils.py", line 1403, in patch_forward_DeFInet_itr Sharps_prime, Sharps_final, flow_predictions, occ0_predictions, two_blurry_inputs = model_net(input_frames[:, :, :, H_low_ind:H_high_ind, W_low_ind:W_high_ind], File "C:\Users\98mxr\AppData\Local\Programs\Python\Python39\lib\site-packages\torch\nn\modules\module.py", line 1102, in _call_impl return forward_call(*input, **kwargs) File "C:\Users\98mxr\Downloads\DeMFI\DeMFInet.py", line 78, in forward Agg1 = self.Refine_Module(Agg1) + torch.cat( File "C:\Users\98mxr\AppData\Local\Programs\Python\Python39\lib\site-packages\torch\nn\modules\module.py", line 1102, in _call_impl return forward_call(*input, **kwargs) File "C:\Users\98mxr\Downloads\DeMFI\DeMFInet.py", line 598, in forward out = torch.cat((out, enc1), dim=1) RuntimeError: Sizes of tensors must match except in dimension 1. Expected size 224 but got size 225 for tensor number 1 in the list.

    I am afraid I cannot solve this problem and submit it to the code owner for processing.

    English is not my native language, please accept my apology if there is anything wrong with the above statement.

    opened by 98mxr 6
  • Pretrained Model Link

    Pretrained Model Link

    Hello, I noticed that the pretrained model weight link points to "https://www.dropbox.com/s/xj2ixvay0e5ldma/XVFInet_X4K1000FPS_exp1_latest.pt" rather than DeMFI-Net , would it be possible to correct the link?

    opened by SpaceLlama2000 2
  • Fail to download Adobe240 dataset

    Fail to download Adobe240 dataset

    I fail to download Adobe240 dataset from the provided dropbox links. Can you give Google Drive or Baidu Netdisk links or can you tell me how to make Adobe240 dataset from the original videos?

    Thanks!

    opened by Zhang-Jing-Xuan 0
  • Questions about the results

    Questions about the results

    May I ask some questions about the test results? Could you explain the meanings of the names: Time, intp_testPSNR_prime, deblur_testPSNR_prime, intp_testPSNR, deblur_testPSNR.

    Does this 'Time' represent the whole time for deblurring and interpolating 8 different images or for 1 image? What is the difference between 'prime' and not prime? Also, why are the results always followed by an (avg)? What is it?

    For example: image

    opened by VongolaWu 7
  • Any way to improve results with parameter changes?

    Any way to improve results with parameter changes?

    The results I'm getting are not of the same quality as the examples shown. Are there any settings or parameters I can tweak to get results closer to the example clips shown?

    https://drive.google.com/file/d/1zVtFCj7h2xa-f7cFMpaYtFr3U7N3Qz9y/view?usp=sharing

    opened by noobtoob4lyfe 2
Owner
Jihyong Oh
KAIST Ph.D. Candidate 3rd yr. Please refer to my personal homepage as below (URL).
Jihyong Oh
GitHub
Listing arxiv - Personalized list of today's articles from ArXiv

Personalized list of today's articles from ArXiv Print and/or send to your gmail

Lilianne Nakazono 5 Jun 17, 2022
Arxiv harvester - Poor man's simple harvester for arXiv resources

Poor man's simple harvester for arXiv resources This modest Python script takes

Patrice Lopez 5 Oct 18, 2022
Official repository with code and data accompanying the NAACL 2021 paper "Hurdles to Progress in Long-form Question Answering" (https://arxiv.org/abs/2103.06332).

Hurdles to Progress in Long-form Question Answering This repository contains the official scripts and datasets accompanying our NAACL 2021 paper, "Hur

Kalpesh Krishna 41 Nov 8, 2022
This repository contains the code used for Predicting Patient Outcomes with Graph Representation Learning (https://arxiv.org/abs/2101.03940).

Predicting Patient Outcomes with Graph Representation Learning This repository contains the code used for Predicting Patient Outcomes with Graph Repre

Emma Rocheteau 76 Dec 22, 2022
The official implementation of NeMo: Neural Mesh Models of Contrastive Features for Robust 3D Pose Estimation [ICLR-2021]. https://arxiv.org/pdf/2101.12378.pdf

NeMo: Neural Mesh Models of Contrastive Features for Robust 3D Pose Estimation [ICLR-2021] Release Notes The offical PyTorch implementation of NeMo, p

Angtian Wang 76 Nov 23, 2022
Official implementation of the paper Image Generators with Conditionally-Independent Pixel Synthesis https://arxiv.org/abs/2011.13775

CIPS -- Official Pytorch Implementation of the paper Image Generators with Conditionally-Independent Pixel Synthesis Requirements pip install -r requi

Multimodal Lab @ Samsung AI Center Moscow 201 Dec 21, 2022
This repo provides the official code for TransBTS: Multimodal Brain Tumor Segmentation Using Transformer (https://arxiv.org/pdf/2103.04430.pdf).

TransBTS: Multimodal Brain Tumor Segmentation Using Transformer This repo is the official implementation for TransBTS: Multimodal Brain Tumor Segmenta

Raymond 247 Dec 28, 2022
[PyTorch] Official implementation of CVPR2021 paper "PointDSC: Robust Point Cloud Registration using Deep Spatial Consistency". https://arxiv.org/abs/2103.05465

PointDSC repository PyTorch implementation of PointDSC for CVPR'2021 paper "PointDSC: Robust Point Cloud Registration using Deep Spatial Consistency",

null 153 Dec 14, 2022
Official Implementation for "ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinement" https://arxiv.org/abs/2104.02699

ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinement Recently, the power of unconditional image synthesis has significantly advanced th

null 967 Jan 4, 2023
This is an official implementation of our CVPR 2021 paper "Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regression" (https://arxiv.org/abs/2104.02300)

Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regression Introduction In this paper, we are interested in the bottom-up paradigm of estima

HRNet 367 Dec 27, 2022
Official PyTorch Implementation of Hypercorrelation Squeeze for Few-Shot Segmentation, arXiv 2021

Hypercorrelation Squeeze for Few-Shot Segmentation This is the implementation of the paper "Hypercorrelation Squeeze for Few-Shot Segmentation" by Juh

Juhong Min 165 Dec 28, 2022
Non-Official Pytorch implementation of "Face Identity Disentanglement via Latent Space Mapping" https://arxiv.org/abs/2005.07728 Using StyleGAN2 instead of StyleGAN

Face Identity Disentanglement via Latent Space Mapping - Implement in pytorch with StyleGAN 2 Description Pytorch implementation of the paper Face Ide

Daniel Roich 58 Dec 24, 2022
Code for our method RePRI for Few-Shot Segmentation. Paper at http://arxiv.org/abs/2012.06166

Region Proportion Regularized Inference (RePRI) for Few-Shot Segmentation In this repo, we provide the code for our paper : "Few-Shot Segmentation Wit

Malik Boudiaf 138 Dec 12, 2022
Neural Magic Eye: Learning to See and Understand the Scene Behind an Autostereogram, arXiv:2012.15692.

Neural Magic Eye Preprint | Project Page | Colab Runtime Official PyTorch implementation of the preprint paper "NeuralMagicEye: Learning to See and Un

Zhengxia Zou 56 Jul 15, 2022
Pytorch implementation of Each Part Matters: Local Patterns Facilitate Cross-view Geo-localization https://arxiv.org/abs/2008.11646

[TCSVT] Each Part Matters: Local Patterns Facilitate Cross-view Geo-localization LPN [Paper] NEWs Prerequisites Python 3.6 GPU Memory >= 8G Numpy > 1.

null 46 Dec 14, 2022
https://arxiv.org/abs/2102.11005

LogME LogME: Practical Assessment of Pre-trained Models for Transfer Learning How to use Just feed the features f and labels y to the function, and yo

THUML: Machine Learning Group @ THSS 149 Dec 19, 2022
Supplementary code for the paper "Meta-Solver for Neural Ordinary Differential Equations" https://arxiv.org/abs/2103.08561

Meta-Solver for Neural Ordinary Differential Equations Towards robust neural ODEs using parametrized solvers. Main idea Each Runge-Kutta (RK) solver w

Julia Gusak 25 Aug 12, 2021
[arXiv] What-If Motion Prediction for Autonomous Driving ❓🚗💨

WIMP - What If Motion Predictor Reference PyTorch Implementation for What If Motion Prediction [PDF] [Dynamic Visualizations] Setup Requirements The W

William Qi 96 Dec 29, 2022
Source Code for DialogBERT: Discourse-Aware Response Generation via Learning to Recover and Rank Utterances (https://arxiv.org/pdf/2012.01775.pdf)

DialogBERT This is a PyTorch implementation of the DialogBERT model described in DialogBERT: Neural Response Generation via Hierarchical BERT with Dis

Xiaodong Gu 67 Jan 6, 2023