Instance Semantic Segmentation List

This repository contains lists of state-or-art instance semantic segmentation works. Papers and resources are listed below according to method types.

Paper list
- detection based
- segmentation based

Brief introduction

Instance semantic segmentation is a area closely related to detection and semantic segmentation. In particular, it could be seen as detection plus foreground mask. But mostly it is not able to segment non-object pixels such as sky, land etc(which considered as a scene parsing task under semantic segmentation). For quick review related topics, see these survey papers:

Speed/accuracy trade-offs for modern convolutional object detectors, CVPR 2017

Survey of recent progress in semantic image segmentation with CNNs, until 201706

Dataset and benchmark here

Dataset	Train	Val	Link	Note
Pascal VOC 12 Aug	10582	1449	SegVOC12	origin train 1464+SDB
Pascal VOC SDB val	5623	5732	SDB	similar to VOC12 Main
COCO	115k	5k	COCO	coco_2014_minival
CityScapes	5000	/	CityScapes	evaluation server

Note: Pascal VOC could refer to different split of dataset. Original VOC12 segmentation task consists of train/val/test 1464/1449/1456 images respectively without instance information. It is designed for semantic segmentation. SDB provides instance-aware annotations for images from Pascal VOC12. And their split(8k/3k) differ from VOC, so another split from them Pasval VOC SDB val is provided, which is similar to Pascal VOC Main split(5717/5823).

1.Detection-based methods

PAnet:Path Aggregation Network for Instance Segmentation, CVPR 2018
MaskLab: Instance Segmentation by Refining Object Detection with Semantic and Direction Features, CVPR 2018
Mask R-CNN, ICCV 2017 [Detectron][Code(TF)][Code(MXNET)]
BlitzNet: A Real-Time Deep Network for Scene Understanding, ICCV 2017 [web][code]
FCIS: Fully Convolutional Instance-Aware Semantic Segmentation, CVPR 2017 [code]
FastMask: Segment Multi-scale Object Candidates in One Shot, CVPR 2017 [code]
instance sensitive fully convolutional networks, ECCV 2016
MNC: Instance-aware Semantic Segmentation via Multi-task Network Cascades, CVPR 2016 [code]
SharpMask: Learning to Refine Object Segments, ECCV 2016
DeepMask: Learning to Segment Object Candidates, NIPS 2015 [code]

2.Segmentation-based methods

SGN: Sequential Grouping Networks for Instance Segmentation, ICCV 2017
InstanceCut: from Edges to Instances with MultiCut,CVPR 2017
Pixelwise Instance Segmentation with a Dynamically Instantiated Network, CVPR 2017
Deep Watershed Transform for Instance Segmentation, CVPR 2017 [code]
Multi-scale Patch Aggregation (MPA) for Simultaneous Detection and Segmentation, CVPR 2016

3.Others

End-to-End Instance Segmentation with Recurrent Attention, CVPR 2017
Recurrent Instance Segmentation, ECCV 2016 [web]
SDS:Simultaneous Detection and Segmentation, ECCV 2014 [web] [code]
Hypercolumns for Object Segmentation and Fine-grained Localization , CVPR 2015

YolactEdge: Real-time Instance Segmentation on the Edge

YolactEdge, the first competitive instance segmentation approach that runs on small edge devices at real-time speeds. Specifically, YolactEdge runs at up to 30.8 FPS on a Jetson AGX Xavier (and 172.7 FPS on an RTX 2080 Ti) with a ResNet-101 backbone on 550x550 resolution images.

1.1k Jan 6, 2023

the code used for the preprint Embedding-based Instance Segmentation of Microscopy Images.

EmbedSeg Introduction This repository hosts the version of the code used for the preprint Embedding-based Instance Segmentation of Microscopy Images.

88 Dec 25, 2022

Learning RGB-D Feature Embeddings for Unseen Object Instance Segmentation

Unseen Object Clustering: Learning RGB-D Feature Embeddings for Unseen Object Instance Segmentation Introduction In this work, we propose a new method

132 Dec 13, 2022

[CVPR2021 Oral] End-to-End Video Instance Segmentation with Transformers

VisTR: End-to-End Video Instance Segmentation with Transformers This is the official implementation of the VisTR paper: Installation We provide instru

687 Jan 7, 2023

Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayers [CVPR 2021]

Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayers [BCNet, CVPR 2021] This is the official pytorch implementation of BCNet built on

434 Dec 1, 2022

git《USD-Seg:Learning Universal Shape Dictionary for Realtime Instance Segmentation》(2020) GitHub: [fig2]

USD-Seg This project is an implement of paper USD-Seg:Learning Universal Shape Dictionary for Realtime Instance Segmentation, based on FCOS detector f

80 Nov 28, 2022

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" on Object Detection and Instance Segmentation.

Swin Transformer for Object Detection This repo contains the supported code and configuration files to reproduce object detection results of Swin Tran

1.4k Dec 30, 2022

Implementation of DropLoss for Long-Tail Instance Segmentation in Pytorch

[AAAI 2021]DropLoss for Long-Tail Instance Segmentation [AAAI 2021] DropLoss for Long-Tail Instance Segmentation Ting-I Hsieh*, Esther Robb*, Hwann-Tz

37 Dec 2, 2022

Fast, modular reference implementation of Instance Segmentation and Object Detection algorithms in PyTorch.

Faster R-CNN and Mask R-CNN in PyTorch 1.0 maskrcnn-benchmark has been deprecated. Please see detectron2, which includes implementations for all model

9k Jan 4, 2023

still for updates?

It is a good list for introducing the instance segmentation tech. First thanks for your sharing with the doc, do you have any plan still for maintaining the repo?

opened by chenguanfu511 0
question about voc aug set

Pascal VOC 12 Aug | 10582 | 1449 | SegVOC12 | origin train 1464+SDB

what is this mean? 1464+sbd 8498? or 1464 + sbd 5k? but still can not be 10582,anyone know something?

opened by oujieww 0

Instance Semantic Segmentation List

Related tags

Overview

Instance Semantic Segmentation List

Brief introduction

1.Detection-based methods

2.Segmentation-based methods

3.Others

You might also like...

YolactEdge: Real-time Instance Segmentation on the Edge

the code used for the preprint Embedding-based Instance Segmentation of Microscopy Images.

Learning RGB-D Feature Embeddings for Unseen Object Instance Segmentation

[CVPR2021 Oral] End-to-End Video Instance Segmentation with Transformers

Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayers [CVPR 2021]

git《USD-Seg:Learning Universal Shape Dictionary for Realtime Instance Segmentation》(2020) GitHub: [fig2]

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" on Object Detection and Instance Segmentation.

Implementation of DropLoss for Long-Tail Instance Segmentation in Pytorch

Fast, modular reference implementation of Instance Segmentation and Object Detection algorithms in PyTorch.

Comments

still for updates?

question about voc aug set

Owner

bighead

Recall Loss for Semantic Segmentation (This repo implements the paper: Recall Loss for Semantic Segmentation)

A curated list of awesome resources related to Semantic Search🔎 and Semantic Similarity tasks.

Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networks

DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision

The PyTorch implementation of DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision.

[ArXiv 2021] Data-Efficient Instance Generation from Instance Discrimination

Learning Pixel-level Semantic Affinity with Image-level Supervision for Weakly Supervised Semantic Segmentation, CVPR 2018

Segmentation in Style: Unsupervised Semantic Image Segmentation with Stylegan and CLIP

Mae segmentation - Reproduction of semantic segmentation using masked autoencoder (mae)

Implementation of CVPR'21: RfD-Net: Point Scene Understanding by Semantic Instance Reconstruction