benjamesbabala/video-object-segmentation-paper-list

Semi-Supervised Video Object Segmentation

---

Benchmark Results

Paper List

2019

Method	Title	Authors	Affiliation	Pub.	Links
AGSS-VOS	AGSS-VOS: Attention Guided Single-Shot Video Object Segmentation	Huaijia Lin,Xiaojuan Qi,Jiaya Jia	CUHK,University of Oxford,YoutTu Lab	ICCV 2019	paper
DMM-Net	Differentiable Mask-Matching Network for Video Object Segmentation	Xiaohui Zeng,Renjie Liao,Li Gu,Yuwen Xiong,Sanja Fidler,Raquel Urtasun	University of Toronto,NVIDIA	ICCV 2019	paper pytorch
RANet	RANet: Ranking Attention Network for Fast Video Object Segmentation	Ziqin Wang, Jun Xu, Li Liu, Fan Zhu,Ling Shao	The University of Sydney, IIAI, Xi’an Jiaotong University, Nankai University	ICCV2019	paper github
CapsuleVOS	CapsuleVOS:Semi-Supervised Video Object Segmentation Using Capsule Routing	Kevin Duarte,Yogesh S Rawat,Mubarak Shah	University of Central Florida	ICCV 2019	paper TensorFlow
OSVOS-VL	In defense of OSVOS	Yu Liu, Yutong Dai, Anh-Dzung Doan, Lingqiao Liu, Ian Reid	The University of Adelaide	arXiv 8.20	paper
MTN	Fast Video Object Segmentation via Mask Transfer Network	Tao Zhuo, Zhiyong Cheng, Mohan Kankanhalli	NUS, Shandong AI Institute	arXiv 8.28	paper
PTSNet	Proposal, Tracking and Segmentation (PTS): A Cascaded Network for Video Object Segmentation	Qiang Zhou, Zilong Huang, Lichao Huang, Yongchao Gong, Han Shen, Chang Huang, Wenyu Liu, Xinggang Wang	HUST, Horizon Robotics	arXiv 7.4	paper pytorch
DOS	Discriminative Online Learning for Fast Video Object Segmentation	Andreas Robinson, Felix Jaremo Lawin, Martin Danelljan, Fahad Shahbaz Khan, Michael Felsberg	Linkoping University, ETH Zurich, Switzerland	arXiv 4.18	paper
BoLTVOS***	BoLTVOS: Box-Level Tracking for Video Object Segmentation	Paul Voigtlaender, Jonathon Luiten, Bastian Leibe	RWTH Aachen	arXiv 2019.4.9	paper
Patchwork	Patchwork: A Patch-wise Attention Network for Efficient Object Detection and Segmentation in Video Streams	Yuning Chai	Google Inc	ICCV 2019	paper
STM**	Video Object Segmentation using Space-Time Memory Networks	Seoung Wug Oh, Joon-Young Lee, Ning Xu, Seon Joo Kim	Yonsei University	ICCV 2019	paper pytorch
MLDVW	Meta Learning Deep Visual Words for Fast Video Object Segmentation	Harkirat Singh Behl, Mohammad Najafi, Philip H.S. Torr	University of Oxford	arXiv 2018.12	paper
ST GANs***	Fast video object segmentation with Spatio-Temporal GANs	S. Caelles, A. Pumarola, F. Moreno-Noguer, A. Sanfeliu, L. Van Gool	ETH Zurich	arXiv 2019.3.28	paper
GAM*	A Generative Appearance Model for End-to-end Video Object Segmentation	Joakim Johnander, Emil Brissman, Martin Danelljan, Fahad Shahbaz Khan, Michael Felsberg	Linkoping University	CVPR 2019	paper github
BubbleNets	BubbleNets: Learning to Select the Guidance Frame in Video Object Segmentation by Deep Sorting Frames	Brent A. Griffin, Jason J. Corso	University of Michigan	CVPR 2019	paper github
MHP-VOS***	MHP-VOS: Multiple Hypotheses Propagation for Video Object Segmentation	Shuangjie Xu, Daizong Liu, Linchao Bao, Wei Liu, Pan Zhou	Hust, Tencent AI Lab	CVPR 2019	paper
FEELVOS	FEELVOS: Fast End-to-End Embedding Learning for Video Object Segmentation	Paul Voigtlaender, Yuning Chai, Florian Schroff, Hartwig Adam, Bastian Leibe, Liang-Chieh Chen	RWTH Aachen, Google Inc	CVPR 2019	paper github blog
RVOS	RVOS: End-to-End Recurrent Network for Video Object Segmentation	Carles Ventura, Miriam Bellver, Andreu Girbau, Amaia Salvador, Ferran Marques, Xavier Giro-i-Nieto	UOC, UPC, Barcelona Supercomputing Center	CVPR 2019	paper github
STCNN**	Spatiotemporal CNN for Video Object Segmentation	Kai Xu, Longyin Wen, Guorong Li, Liefeng Bo, Qingming Huang	CAS	CVPR 2019	paper github
SiamMask	Fast Online Object Tracking and Segmentation: A Unifying Approach	Qiang Wang, Li Zhang, Luca Bertinetto	CASIA, University of Oxford	CVPR 2019	paper github
MOTS	MOTS: Multi-Object Tracking and Segmentation	Paul Voigtlaender, Michael Krause, Aljosa O ˘ sep, Jonathon Luiten, Berin Balachandar Gnana Sekar, Andreas Geiger, Bastian Leibe	RWTH Aachen University, MPI	CVPR_2019	paper github
TIS	Tukey-Inspired Video Object Segmentation	Brent A. Griffin, Jason J. Corso	University of Michigan	WACV 2019	paper github

2018

Method	Title	Authors	Affiliation	Pub.	Links
MVOS-OL	Online Meta Adaptation for Fast Video Object Segmentation	Huaxin Xiao, Bingyi Kang, Yu Liu, Maojun Zhang, Jiashi Feng	NUDT, NUS	TPAMI 2018	paper github
DyeNet	video Object Segmentation with Joint Re-identification and Attention-Aware Mask Propagation	Xiaoxiao Li, Chen Change Loy	CUHK, NTU	ECCV 2018	project page
VideoMatch	VideoMatch: Matching based Video Object Segmentation	Yuan-Ting Hu, Jia-Bin Huang, Alexander G. Schwing	UIUC	ECCV 2018	paper
VOSLSE	Video Object Segmentation by Learning Location-Sensitive Embeddings	Hai Ci, Chunyu Wang, Yizhou Wang	Peking University, MSRA	ECCV 2018	paper
GRFP	Semantic Video Segmentation by Gated Recurrent Flow Propagation	David Nilsson, Cristian Sminchisescu	Lund University	CVPR 2018	paper github
DVSN	Dynamic Video Segmentation Network	Yu-Syuan Xu, Tsu-Jui Fu, Hsuan-Kung Yang, Chun-Yi Lee	National Tsing Hua Uiversity	CVPR 2018	paper github
Low-Latency	Low-Latency Video Semantic Segmentation	Yule Li, Jianping Shi, Dahua Lin	CAS, SenseTime, CUHK	CVPR 2018	paper
CNN in MRF	CNN in MRF: Video Object Segmentation via Inference in A CNN-Based Higher-Order Spatio-Temporal MRF	Linchao Bao, Baoyuan Wu, Wei Liu	Tencent AI Lab	CVPR 2018	paper
GCRF	Deep Spatio-Temporal Random Fields for Efficient Video Segmentation	Siddhartha Chandra, Camille Couprie, Iasonas Kokkinos	INRIA GALEN, Facebook	CVPR 2018	paper
RGMP	Fast Video Object Segmentation by Reference-Guided Mask Propagation	Seoung Wug Oh, Joon-Young Lee, Kalyan Sunkavalli, Seon Joo Kim	Yonsei University	CVPR 2018	github
MoNet	MoNet: Deep Motion Exploitation for Video Object Segmentation	Huaxin Xiao, Jiashi Feng, Guosheng Lin, Yu Liu, Maojun Zhang	NUDT, NTU	CVPR 2018	paper
Motion-Guided-CRN	Motion-Guided Cascaded Refinement Network for Video Object Segmentation	Ping Hu, Gang Wang, Xiangfei Kong , Jason Kuen, Yap-Peng Tan	NTU, Alibaba	CVPR 2018	github
FAVOS	Fast and Accurate Online Video Object Segmentation via Tracking Parts	Jingchun Cheng, Yi-Hsuan Tsai, Wei-Chih Hung, Shengjin Wang, Ming-Hsuan Yang	Tsinghua University, UC Merced	CVPR 2018	github
OSMN	Efficient Video Object Segmentation via Network Modulation	Linjie Yang, Yanran Wang, Xuehan Xiong, Jianchao Yang, Aggelos K. Katsaggelos	Snap, Google	CVPR 2018	github
PML	Blazingly Fast Video Object Segmentation with Pixel-Wise Metric Learning	Yuhua Chen, Jordi Pont-Tuset, Alberto Montes, Luc Van Gool	ETH Zurich	CVPR 2018	github pytorch
Actor Action	Actor and Action Video Segmentation from a Sentence	Kirill Gavrilyuk, Amir Ghodrati, Zhenyang Li, Cees G. M. Snoek	University of Amsterdam	CVPR 2018	project page

2017

Method	Title	Authors	Affiliation	Pub.	Links
LucidDream	Lucid Data Dreaming for Video Object Segmentation	Anna Khoreva, Rodrigo Benenson, Eddy Ilg, Thomas Brox, Bernt Schiele	MPI, Google	IJCV 2019	paper github
FGFA	Flow-guided feature aggregation for video object detection	Xizhou Zhu, Yujie Wang, Jifeng Dai, Lu Yuan, Yichen Wei	USTC, MSRA	ICCV 2017	paper github
MaskRNN	MaskRNN: Instance Level Video ObjectSegmentation	Yuan-Ting Hu, Jia-Bin Huang, Alexander G. Schwing	UIUC	NIPS 2017	project page
SegFlow	SegFlow: Joint Learning for Video Object Segmentation and Optical Flow	Jingchun Cheng, Yi-Hsuan Tsai, Shengjin Wang, Ming-Hsuan Yang	Tsinghua University, UC Merced	ICCV 2017	github
PLM	Pixel-Level Matching for Video Object Segmentation using Convolutional Neural Networks	Jae Shin Yoon, Francois Rameau, Junsik Kim, Seokju Lee, Seunghak Shin, In So Kweon	UMN, KAIST	ICCV 2017	project page
VMNet	Learning Video Object Segmentation with Visual Memory	Pavel Tokmakov, Karteek Alahari, Cordelia Schmid	Inria	ICCV 2017	paper
OSVOS*	One-Shot Video Object Segmentation	Sergi Caelles, Kevis-Kokitsi Maninis, Jordi Pont-Tuset, Laura Leal-Taixé, Daniel Cremers, Luc Van Gool	ETH Zurich	CVPR 2017	project page
MaskTrack	Learning Video Object Segmentation from Static Images	Anna Khoreva, Federico Perazzi, Rodrigo Benenson, Bernt Schiele, Alexander Sorkine-Hornung	Disney Research, ETH Zurich, MPI	CVPR 2017	project page code
MPNet	Learning Motion Patterns in Videos	Pavel Tokmakov, Karteek Alahari, Cordelia Schmid	Inria	CVPR 2017	project page
FusionSeg	FusionSeg: Learning to combine motion and appearance for fully automatic segmentation of generic objects in videos	Suyog Dutt Jain, Bo Xiong, Kristen Grauman	University of Texas at Austin	CVPR 2017	project page
VPN	Video Propagation Networks	Varun Jampani, Raghudeep Gadde, Peter V. Gehler	MPI	CVPR 2017	project page

2016

Method	Title	Authors	Affiliation	Pub.	Links
VSOF	Video Segmentation via Object Flow	Yi-Hsuan Tsai, Ming-Hsuan Yang, Michael J. Black	UC Merced	CVPR 2016	github
BVS	Bilateral Space Video Segmentation	Nicolas Marki, Federico Perazzi, Oliver Wang, Alexander Sorkine-Hornung	ETH Zurich, Disney Research	CVPR 2016	project page

Unsupervised Video Object Segmentation

---

paper List

Method	Title	Authors	Affiliation	Pub.	Links
AGS	Learning Unsupervised Video Object Segmentation through Visual Attention	Wenguan Wang, Hongmei Song, Shuyang Zhao, Jianbing Shen, Sanyuan Zhao, Steven Hoi, Haibin Ling	BIT, IIAI, SMU, Temple University	CVPR 2019	paper github
unVOSMSGSTP	Unsupervised Video Object Segmentation using Motion Saliency-Guided Spatio-Temporal Propagation	Yuan-Ting Hu, Jia-Bin Huang, Alexander G. Schwing	UC Merced	ECCV 2018	paper
unVOSMBN	Unsupervised Video Object Segmentation with Motion-based Bilateral Networks	Vik Goel, Jameson Weng, Pascal Poupart	UCLA, Google	ECCV 2018	paper
IETunVOS	Instance Embedding Transfer to Unsupervised Video Object Segmentation	Siyang Li, Bryan Seybold, Alexey Vorobyov, Alireza Fathi, Qin Huang, C.-C. Jay Kuo	USC, Google	CVPR 2018	paper

Video Instance Segmentation

---

paper List

Method	Title	Authors	Affiliation	Pub.	Links
MaskTrackRCNN	Video Instance Segmentation	Linjie Yang,Yuchen Fan,Ning Xu	ByteDance AI Lab,UIUC,Adobe Research	ICCV 2019	paper pytorch