Official PyTorch implementation of our AAAI22 paper: TransMEF: A Transformer-Based Multi-Exposure Image Fusion Framework via Self-Supervised Multi-Task Learning. Code will be available soon.

Last update: Dec 27, 2022

Related tags

Overview

Official-PyTorch-Implementation-of-TransMEF

Official PyTorch implementation of our AAAI22 paper: TransMEF: A Transformer-Based Multi-Exposure Image Fusion Framework via Self-Supervised Multi-Task Learning. Code will be available soon.

Comments

Error loading pretrained model
Hi,

While trying to run the following command:

python fusion_gray_TransMEF.py --model_path ./best_model.pth --test_path ./MEFB_dataset_example/grayscale --result_path transMEF_results

with the provided pretrained model, I get a runtime error with lots of missing keys.

Could you please check if the code corresponds to the provided pretrained model?
opened by ash80 4
测试性能

您好,打扰一下.非常感谢能够分享这个工作的代码. 我目前有个小问题,我看到代码页里面说是用MEFB作者提供的工具包进行测试的. MEFB作者提供了各个对比方法的融合结果. 我用MEFB作者提供的融合结果和工具包跑了一下,发现和您论文中结果有些出入,比如MEFNet的PSNR跑的是56.5940 (而TransMEF论文中MEFNet的PSNR是52.9449), 想问一下出现这种情况的原因是什么呢.

opened by CBY-9527 3
关于“fusion_arbitary_size_TransMEF_gray.py”

你好，非常感谢关于上一个issue的解答！再次打扰一下，我在测试中发现以“fusion_arbitary_size_TransMEF_gray.py”融合后的图片和以“fusion_gray_TransMEF.py”融合后的图片不同。其中滑窗融合方法得到图片质量较差。两个方法采用的数据，模型是一致的。

opened by keviner1 2
Code for rgb2ycbcr

Thanks for making the code public. Could you please also provide the inverse of function YCbCr2RGB that you have used to convert the RGB images into YCbCr?

opened by ash80 2
Problems about testing

Thanks for sharing the code. The training can be implemented normally, but there is a problem during the test. I ran the test code and reported an error. The test image should be cropped into 256*256 blocks and combined into the original image size, but the corresponding code was not found. Will the code for generating the original image size be made public?

opened by CBY-9527 2
Question about TransBlock

In your paper, you mentioned "Concretely, we concatenate the two feature maps from the CNN-Module and the Transformer-Module in TransBlock and input ....". But the dim of embeddings z, the number of channels in Transformer-Module and how to deal with different resolutions of input images are not described clearly in your paper, which is very important in pratical applications. Could you please add these details or just simply release the model.py first?

opened by shinianzhihou 2
about evaluation metrics

Thanks for sharing the code. I noticed that you selected 12 objective evaluation metrics in your AAAI paper. however, I don't see them in the code. I would be very grateful if you could share the code about evaluation metrics.

opened by xiang-ao-data 1
about "input images"

Thanks for your significant work! I have read your paper. Do you have the code that uses the sliding window strategy to fuse input images of arbitrary non-256 * 256? Looking forward to your reply. Thanks!

opened by 1900lxl 1

Official PyTorch implementation of our AAAI22 paper: TransMEF: A Transformer-Based Multi-Exposure Image Fusion Framework via Self-Supervised Multi-Task Learning. Code will be available soon.

Related tags

Overview

Official-PyTorch-Implementation-of-TransMEF

Comments

Error loading pretrained model

测试性能

关于“fusion_arbitary_size_TransMEF_gray.py”

Code for rgb2ycbcr

Problems about testing

Question about TransBlock

about evaluation metrics

about "input images"

Owner

We propose a new method for effective shadow removal by regarding it as an exposure fusion problem.

Codes for AAAI22 paper "Learning to Solve Travelling Salesman Problem with Hardness-Adaptive Curriculum"

An official PyTorch implementation of the TKDE paper "Self-Supervised Graph Representation Learning via Topology Transformations".

Official implement of Paper：A deeply supervised image fusion network for change detection in high resolution bi-temporal remote sening images

[AAAI22] Reliable Propagation-Correction Modulation for Video Object Segmentation

Code for our ACL 2021 paper - ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer

Here is the implementation of our paper S2VC: A Framework for Any-to-Any Voice Conversion with Self-Supervised Pretrained Representations.

Self-supervised Multi-modal Hybrid Fusion Network for Brain Tumor Segmentation

Official PyTorch implementation for paper Context Matters: Graph-based Self-supervised Representation Learning for Medical Images

Official code for "EagerMOT: 3D Multi-Object Tracking via Sensor Fusion" [ICRA 2021]

This is the official pytorch implementation for our ICCV 2021 paper "TRAR: Routing the Attention Spans in Transformers for Visual Question Answering" on VQA Task

Patch Rotation: A Self-Supervised Auxiliary Task for Robustness and Accuracy of Supervised Models

Code for the SIGIR 2022 paper "Hybrid Transformer with Multi-level Fusion for Multimodal Knowledge Graph Completion"

PyTorch implementation of our ICCV2021 paper: StructDepth: Leveraging the structural regularities for self-supervised indoor depth estimation

The Self-Supervised Learner can be used to train a classifier with fewer labeled examples needed using self-supervised learning.

[CVPR2021] The source code for our paper 《Removing the Background by Adding the Background: Towards Background Robust Self-supervised Video Representation Learning》.

[BMVC 2021] Official PyTorch Implementation of Self-supervised learning of Image Scale and Orientation Estimation

This is a Pytorch implementation of the paper: Self-Supervised Graph Transformer on Large-Scale Molecular Data.

Fusion-DHL: WiFi, IMU, and Floorplan Fusion for Dense History of Locations in Indoor Environments