DFFNet: An IoT-perceptive Dual Feature Fusion Network for General Real-time Semantic Segmentation

Last update: Sep 23, 2022

Related tags

Deep Learning DFFNet

Overview

DFFNet

Paper

DFFNet: An IoT-perceptive Dual Feature Fusion Network for General Real-time Semantic Segmentation.

Xiangyan Tang, Wenxuan Tu, Keqiu Li, Jieren Cheng.

Information Sciences, 565: 326-343, 2021.

License

The code is released for academic research use only. For commercial use, please contact [[email protected]].

Installation

Clone this repo.

https://github.com/WxTu/DFFNet.git

Windows or Linux
Python3
Pytorch(0.3+)
Numpy
Torchvision
Matplotlib

Preparation

We use Cityscapes, Camvid and Helen datasets. To train a model on these datasets, download datasets from official websites.

Our backbone network is pre-trained on the ImageNet dataset provided by F. Li et al. You can download publically available pre-trained MobileNet v2 from this website.

Code Structure

data/Dataset.py: processes the dataset before passing to the network.
model/DFFNet.py: defines the architecture of the whole model.
model/Backbone.py: defines the encoder.
model/Layers.py: defines the MFFM, LSPM, and others.
utils/Config.py: defines some hyper-parameters.
utils/Process.py: defines the process of data pretreatment.
utils/Utils.py: defines the loss, optimization, metrics, and others.
utils/Visualization.py: defines the data visualization.
Train.py: the entry point for training and validation.
Test.py: the entry point for testing.

Visualization

Contact

[email protected]

Any discussions or concerns are welcomed!

Citation

If you use this code for your research, please cite our papers.

@article{Tang2021DFFNet,
  title={DFFNet: An IoT-perceptive Dual Feature Fusion Network for General Real-time Semantic Segmentation},
  author={Xiangyan Tang and Wenxuan Tu and Keqiu Li and Jieren Cheng},
  journal={Information Sciences},
  volume={565},
  pages={326-343},
  year={2021}
}

Acknowledgement

https://github.com/ansleliu/LightNet

https://github.com/meetshah1995/pytorch-semseg

https://github.com/zijundeng/pytorch-semantic-segmentation

https://github.com/Tramac/awesome-semantic-segmentation-pytorch

FANet - Real-time Semantic Segmentation with Fast Attention

FANet Real-time Semantic Segmentation with Fast Attention Ping Hu, Federico Perazzi, Fabian Caba Heilbron, Oliver Wang, Zhe Lin, Kate Saenko , Stan Sc

42 Nov 30, 2022

Recall Loss for Semantic Segmentation (This repo implements the paper: Recall Loss for Semantic Segmentation)

Recall Loss for Semantic Segmentation (This repo implements the paper: Recall Loss for Semantic Segmentation) Download Synthia dataset The model uses

32 Sep 21, 2022

Code for the CIKM 2019 paper "DSANet: Dual Self-Attention Network for Multivariate Time Series Forecasting".

Dual Self-Attention Network for Multivariate Time Series Forecasting 20.10.26 Update: Due to the difficulty of installation and code maintenance cause

223 Dec 16, 2022

sssegmentation is a general framework for our research on strongly supervised semantic segmentation.

445 Jan 2, 2023

Code for "FPS-Net: A convolutional fusion network for large-scale LiDAR point cloud segmentation".

FPS-Net Code for "FPS-Net: A convolutional fusion network for large-scale LiDAR point cloud segmentation", accepted by ISPRS journal of Photogrammetry

15 Nov 30, 2022

Self-supervised Multi-modal Hybrid Fusion Network for Brain Tumor Segmentation

JBHI-Pytorch This repository contains a reference implementation of the algorithms described in our paper "Self-supervised Multi-modal Hybrid Fusion N

5 Dec 13, 2021

TCNN Temporal convolutional neural network for real-time speech enhancement in the time domain

TCNN Pandey A, Wang D L. TCNN: Temporal convolutional neural network for real-time speech enhancement in the time domain[C]//ICASSP 2019-2019 IEEE Int

16 Dec 30, 2022

This is the official implementation of 3D-CVF: Generating Joint Camera and LiDAR Features Using Cross-View Spatial Feature Fusion for 3D Object Detection, built on SECOND.

3D-CVF This is the official implementation of 3D-CVF: Generating Joint Camera and LiDAR Features Using Cross-View Spatial Feature Fusion for 3D Object

97 Dec 20, 2022

This repo is for Self-Supervised Monocular Depth Estimation with Internal Feature Fusion(arXiv), BMVC2021

DIFFNet This repo is for Self-Supervised Monocular Depth Estimation with Internal Feature Fusion(arXiv), BMVC2021 A new backbone for self-supervised d

3 Oct 22, 2021

DFFNet: An IoT-perceptive Dual Feature Fusion Network for General Real-time Semantic Segmentation

Related tags

Overview

DFFNet

Paper

License

Installation

Preparation

Code Structure

Visualization

Contact

Citation

Acknowledgement

You might also like...

FANet - Real-time Semantic Segmentation with Fast Attention

Recall Loss for Semantic Segmentation (This repo implements the paper: Recall Loss for Semantic Segmentation)

Code for the CIKM 2019 paper "DSANet: Dual Self-Attention Network for Multivariate Time Series Forecasting".

sssegmentation is a general framework for our research on strongly supervised semantic segmentation.

Code for "FPS-Net: A convolutional fusion network for large-scale LiDAR point cloud segmentation".

Self-supervised Multi-modal Hybrid Fusion Network for Brain Tumor Segmentation

TCNN Temporal convolutional neural network for real-time speech enhancement in the time domain

This is the official implementation of 3D-CVF: Generating Joint Camera and LiDAR Features Using Cross-View Spatial Feature Fusion for 3D Object Detection, built on SECOND.

This repo is for Self-Supervised Monocular Depth Estimation with Internal Feature Fusion(arXiv), BMVC2021

Owner

This is the unofficial code of Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenes. which achieve state-of-the-art trade-off between accuracy and speed on cityscapes and camvid, without using inference acceleration and extra data

Semantic Segmentation for Real Point Cloud Scenes via Bilateral Augmentation and Adaptive Fusion (CVPR 2021)

Official pytorch implementation of "DSPoint: Dual-scale Point Cloud Recognition with High-frequency Fusion"

Official implementation of "DSP: Dual Soft-Paste for Unsupervised Domain Adaptive Semantic Segmentation"

Implementation of CVPR 2020 Dual Super-Resolution Learning for Semantic Segmentation

Fusion-DHL: WiFi, IMU, and Floorplan Fusion for Dense History of Locations in Indoor Environments

PyTorch implementation of "A Full-Band and Sub-Band Fusion Model for Real-Time Single-Channel Speech Enhancement."

The implementation of "Optimizing Shoulder to Shoulder: A Coordinated Sub-Band Fusion Model for Real-Time Full-Band Speech Enhancement"

Real-Time-Student-Attendence-System - Real Time Student Attendence System

HyperSeg: Patch-wise Hypernetwork for Real-time Semantic Segmentation Official PyTorch Implementation