MOT-papers.md

MOT Papers

arXiv 2022

• BoT-SORT: Robust Associations Multi-Pedestrian Tracking (arXiv 2022-07)
  Nir Aharon, Roy Orfaig, Ben-Zion Bobrovsky
  [paper] [code]

• Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Tracking (arXiv 2022-03)
  Jinkun Cao, Xinshuo Weng, Rawal Khirodkar, Jiangmiao Pang, Kris Kitani
  [paper] [code]

• TR-MOT: Multi-Object Tracking by Reference (arXiv 2022-03)
  Mingfei Chen, Yue Liao, Si Liu, Fei Wang, Jenq-Neng Hwang
  [paper] [code]

ECCV 2022

• ByteTrack: Multi-Object Tracking by Associating Every Detection Box (arXiv 2021-10)
  Yifu Zhang, Peize Sun, Yi Jiang, Dongdong Yu, Zehuan Yuan, Ping Luo, Wenyu Liu, Xinggang Wang
  [paper] [code]

  Notes

  

  • Key points:
    • Low score detection boxes are also associated based on their similarities (IoU) with tracklets to recover true objects and filter out background detections.
    • SOTA performance. MOTA 80.3 HOTA 63.1 on MOT17 and MOTA 77.8 HOTA 61.3 on MOT20.

CVPR 2022

• Adiabatic Quantum Computing for Multi Object Tracking. CVPR 2022
  Jan-Nico Zaech, Alexander Liniger, Martin Danelljan, Dengxin Dai, Luc Van Gool
  [paper]

• DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motion. CVPR 2022
  Peize Sun, Jinkun Cao, Yi Jiang, Zehuan Yuan, Song Bai, Kris Kitani, Ping Luo
  [paper] [code]

  Notes

  

  • Key points:
    • Proposing a large-scale dataset for multi-human tracking, where humans have similar appearance, diverse motion and extreme articulation.
    • Benchmarking several state-of-the-art trackers on the proposed dataset.

• Global Tracking Transformers. CVPR 2022
  Xingyi Zhou, Tianwei Yin, Vladlen Koltun, Phillip Krahenbuhl
  [paper] [code]

• MeMOT: Multi-Object Tracking with Memory. CVPR 2022
  Jiarui Cai, Mingze Xu, Wei Li, Yuanjun Xiong, Wei Xia, Zhuowen Tu, Stefano Soatto
  [paper][code]

• LMGP: Lifted Multicut Meets Geometry Projections for Multi-Camera Multi-Object Tracking. CVPR 2022
  Duy M. H. Nguyen, Roberto Henschel, Bodo Rosenhahn, Daniel Sonntag, Paul Swoboda
  [paper][code]

• Multi-Object Tracking Meets Moving UAV. CVPR 2022
  Shuai Liu, Xin Li, Huchuan Lu, You He
  [paper][code]

• Learning of Global Objective for Network Flow in Multi-Object Tracking. CVPR 2022
  Shuai Li, Yu Kong, Hamid Rezatofighi
  [paper][code]

• Towards Discriminative Representation: Multi-View Trajectory Contrastive Learning for Online Multi-Object Tracking. CVPR 2022
  En Yu, Zhuoling Li, Shoudong Han
  [paper] [code]

• TrackFormer: Multi-Object Tracking with Transformers. CVPR 2022
  Tim Meinhardt, Alexander Kirillov, Laura Leal-Taixe, Christoph Feichtenhofer.
  [paper] [code]

• PoseTrack21: A Dataset for Person Search, Multi-Object Tracking and Multi-Person Pose Tracking. CVPR 2022
  Andreas Döring, Di Chen, Shanshan Zhang, Bernt Schiele, Jürgen Gall
  [paper] [code]

• Opening up Open-World Tracking. CVPR 2022
  Yang Liu, Idil Esen Zulfikar, Jonathon Luiten, Achal Dave, Aljoša Ošep, Deva Ramanan, Bastian Leibe, Laura Leal-Taixé
  [paper] [code]

arXiv 2021

• One More Check: Making "Fake Background" Be Tracked Again. (arXiv 2021-4)
  Chao Liang, Zhipeng Zhang, Xue Zhou, Bing Li, Yi Lu, Weiming Hu
  [paper] [code]

• DEFT: Detection Embeddings for Tracking. (arXiv 2021-2)
  Mohamed Chaabane, Peter Zhang, J. Ross Beveridge, Stephen O'Hara
  [paper] [code]

• MOTR: End-to-End Multiple-Object Tracking with TRansformer. (arXiv 2021-5-7)
  Fangao Zeng*, Bin Dong*, Tiancai Wang*, Cheng Chen, Xiangyu Zhang, Yichen Wei.
  [paper] [code]

• TrackMPNN: A Message Passing Graph Neural Architecture for Multi-Object Tracking. (arXiv 2021-1)
  Akshay Rangesh, Pranav Maheshwari, Mez Gebre, Siddhesh Mhatre, Vahid Ramezani, Mohan M. Trivedi.
  [paper] [code]

• Global Correlation Network: End-to-End Joint Multi-Object Detection and Tracking. (arXiv 2021-3)
  Xuewu Lin, Yu-ang Guo, Jianqiang Wang.
  [paper]

• RelationTrack: Relation-aware Multiple Object Tracking with Decoupled Representation. (arXiv 2021-5)
  En Yu, Zhuoling Li, Shoudong Han, Hongwei Wang
  [paper]

• TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Tracking. (arXiv 2021-4-1)
  Peng Chu, Jiang Wang, Quanzeng You, Haibin Ling, Zicheng Liu.
  [paper]

• TransCenter: Transformers with Dense Queries for Multiple-Object Tracking. (arXiv 2021-3)
  Yihong Xu, Yutong Ban, Guillaume Delorme, Chuang Gan, Daniela Rus, Xavier Alameda-Pineda.
  [paper]

NeurIPS 2021

• Prototypical Cross-Attention Networks for Multiple Object Tracking and Segmentation. (NeurIPS 2021)
  Pavel Tokmakov, Jie Li, Wolfram Burgard, Adrien Gaidon.
  [paper] [code]

• Self-Supervised Multi-Object Tracking with Cross-input Consistency. (NeurIPS 2021)
  Favyen Bastani, Songtao He, Samuel Madden.
  [paper] [code]

• Do Different Tracking Tasks Require Different Appearance Models? (NeurIPS 2021)
  Zhongdao Wang, Hengshuang Zhao, Ya-Li Li, Shengjin Wang, Philip Torr, Luca Bertinetto.
  [paper] [code]

ICCV 2021

• Learning to Track with Object Permanence (ICCV 2021)
  Pavel Tokmakov, Jie Li, Wolfram Burgard, Adrien Gaidon
  [paper] [code]

• Assignment-Space-Based Multi-Object Tracking and Segmentation. (ICCV 2021)
  Anwesa Choudhuri, Girish Chowdhary, Alexander G. Schwing
  [paper]

• A General Recurrent Tracking Framework Without Real Data. (ICCV 2021)
  Shuai Wang, Hao Sheng, Yang Zhang, Yubin Wu, Zhang Xiong
  [paper]

• Exploring Simple 3D Multi-Object Tracking for Autonomous Driving. (ICCV 2021)
  Chenxu Luo, Xiaodong Yang, Alan Yuille
  [paper] [code]

• Track Without Appearance: Learn Box and Tracklet Embedding With Local and Global Motion Patterns for Vehicle Tracking. (ICCV 2021)
  Gaoang Wang, Renshu Gu, Zuozhu Liu, Weijie Hu, Mingli Song, Jenq-Neng Hwang
  [paper] [code]

• Continuous Copy-Paste for One-Stage Multi-Object Tracking and Segmentation. (ICCV 2021)
  Zhenbo Xu, Ajin Meng, Zhenbo Shi, Wei Yang, Zhi Chen, Liusheng Huang
  [paper] [code]

• MOTSynth: How Can Synthetic Data Help Pedestrian Detection and Tracking?. (ICCV 2021)
  Zhenbo Xu, Ajin Meng, Zhenbo Shi, Wei Yang, Zhi Chen, Liusheng Huang
  [paper]

CVPR 2021

• Discriminative Appearance Modeling With Multi-Track Pooling for Real-Time Multi-Object Tracking. (CVPR 2021)
  Chanho Kim, Li Fuxin, Mazen Alotaibi, James M. Rehg.
  [paper] [code]

• DyGLIP: A Dynamic Graph Model With Link Prediction for Accurate Multi-Camera Multiple Object Tracking. (CVPR 2021)
  Kha Gia Quach, Pha Nguyen, Huu Le, Thanh-Dat Truong, Chi Nhan Duong, Minh-Triet Tran, Khoa Luu.
  [paper] [code]

• GMOT-40: A Benchmark for Generic Multiple Object Tracking. (CVPR 2021)
  Hexin Bai, Wensheng Cheng, Peng Chu, Juehuan Liu, Kai Zhang, Haibin Ling.
  [paper] [code]

• Learning a Proposal Classifier for Multiple Object Tracking. (CVPR 2021)
  Peng Dai, Renliang Weng, Wongun Choi, Changshui Zhang, Zhangping He, Wei Ding.
  [paper] [code]

• Learnable Graph Matching: Incorporating Graph Partitioning with Deep Feature Learning for Multiple Object Tracking. (CVPR 2021)
  Jiawei He, Zehao Huang, Naiyan Wang, Zhaoxiang Zhang.
  [paper]

• Multiple Object Tracking with Correlation Learning. (CVPR 2021)
  Qiang Wang, Yun Zheng, Pan Pan, Yinghui Xu.
  [paper]

• Online Multiple Object Tracking with Cross-Task Synergy. (CVPR 2021)
  Song Guo, Jingya Wang, Xinchao Wang, Dacheng Tao.
  [paper] [code]

• Probabilistic Tracklet Scoring and Inpainting for Multiple Object Tracking. (CVPR 2021)
  Fatemeh Saleh, Sadegh Aliakbarian, Hamid Rezatofighi, Mathieu Salzmann, Stephen Gould.
  [paper]

• Quasi-Dense Similarity Learning for Multiple Object Tracking. (CVPR 2021)
  Jiangmiao Pang, Linlu Qiu, Xia Li, Haofeng Chen, Qi Li, Trevor Darrell, Fisher Yu.
  [paper] [code]

• SiamMOT: Siamese Multi-Object Tracking. (CVPR 2021)
  Bing Shuai, Andrew Berneshawi, Xinyu Li, Davide Modolo, Joseph Tighe.
  [paper]

• There is More than Meets the Eye: Self-Supervised Multi-Object Detection and Tracking with Sound by Distilling Multimodal Knowledge. (CVPR 2021)
  Francisco Rivera Valverde, Juana Valeria Hurtado, Abhinav Valada.
  [paper] [code]

• Track to Detect and Segment: An Online Multi-Object Tracker. (CVPR 2021)
  Jialian Wu, Jiale Cao, Liangchen Song, Yu Wang, Ming Yang, Junsong Yuan.
  [paper][code]

• Track, Check, Repeat: An EM Approach to Unsupervised Tracking. (CVPR 2021)
  Adam W. Harley, Yiming Zuo, Jing Wen, Ayush Mangal, Shubhankar Potdar, Ritwick Chaudhry, Katerina Fragkiadaki.
  [paper]

• Improving Multiple Pedestrian Tracking by Track Management and Occlusion Handling. (CVPR 2021)
  Daniel Stadler, Jurgen Beyerer
  [paper]

• Improving Multiple Object Tracking With Single Object Tracking
  Linyu Zheng, Ming Tang, Yingying Chen, Guibo Zhu, Jinqiao Wang, Hanqing Lu
  [paper]

• Polygonal Point Set Tracking
  Gunhee Nam, Miran Heo, Seoung Wug Oh, Joon-Young Lee, Seon Joo Kim
  [paper]

• Seeing Behind Objects for 3D Multi-Object Tracking in RGB-D Sequences
  Norman Muller, Yu-Shiang Wong, Niloy J. Mitra, Angela Dai, Matthias Niessner
  [paper]

• Detection, Tracking, and Counting Meets Drones in Crowds: A Benchmark
  Longyin Wen, Dawei Du, Pengfei Zhu, Qinghua Hu, Qilong Wang, Liefeng Bo, Siwei Lyu
  [paper]

ECCV 2020

• Towards Real-Time Multi-Object Tracking. (ECCV 2020)
  Zhongdao Wang, Liang Zheng, Yixuan Liu, Yali Li, Shengjin Wang.
  [paper] [code]

• CenterNet Tracking objects as points. (ECCV 2020)
  Xingyi Zhou, Vladlen Koltun, Philipp Krähenbühl.
  [paper] [code]

• Chained-tracker chaining paired attentive regression results for end-to-end joint multiple-object detection and tracking. (ECCV 2020)
  Jinlong Peng, Changan Wang, Fangbin Wan, Yang Wu, Yabiao Wang, Ying Tai, Chengjie Wang, Jilin Li, Feiyue Huang, Yanwei Fu.
  [paper] [code]

• Simultaneous detection and tracking with motion modelling for multiple object tracking. (ECCV 2020)
  ShiJie Sun, Naveed Akhtar, XiangYu Song, HuanSheng Song, Ajmal Mian, Mubarak Shah.
  [paper]

CVPR 2020

• Learning a Neural Solver for Multiple Object Tracking. (CVPR 2020)
  Guillem Brasó, Laura Leal-Taixé.
  [paper] [code]

• A Unified Object Motion and Affinity Model for Online Multi-Object Tracking. (CVPR 2020)
  Junbo Yin, Wenguan Wang, Qinghao Meng, Ruigang Yang, Jianbing Shen.
  [paper] [code]

• RetinaTrack: Online Single Stage Joint Detection and Tracking. (CVPR 2020)
  Zhichao Lu, Vivek Rathod, Ronny Votel, Jonathan Huang.
  [paper]

• GNN3DMOT: Graph Neural Network for 3D Multi-Object Tracking With 2D-3D Multi-Feature Learning
  Xinshuo Weng, Yongxin Wang, Yunze Man, Kris M. Kitani
  [paper]

• Learning Multi-Object Tracking and Segmentation From Automatic Annotations
  Lorenzo Porzi, Markus Hofinger, Idoia Ruiz, Joan Serrat, Samuel Rota Bulo, Peter Kontschieder
  [paper]

• SQE: a Self Quality Evaluation Metric for Parameters Optimization in Multi-Object Tracking
  Yanru Huang, Feiyu Zhu, Zheni Zeng, Xi Qiu, Yuan Shen, Jianan Wu
  [paper]

AAAI 2020

• Dasot: A unified framework integrating data association and single object tracking for online multi-object tracking. Qi Chu,Wanli Ouyang, Bin Liu, Feng Zhu, and Nenghai Yu. [paper]

arXiv 2020

• FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Tracking. (arXiv 2020-9)
  Yifu Zhang, Chunyu Wang, Xinggang Wang, Wenjun Zeng, Wenyu Liu.
  [paper] [code]

• Rethinking the competition between detection and ReID in Multi-Object Tracking. (arXiv 2020-10)
  Chao Liang, Zhipeng Zhang, Yi Lu, Xue Zhou, Bing Li, Xiyong Ye, Jianxiao Zou.
  [paper] [code]

• TransTrack: Multiple-Object Tracking with Transformer. (arXiv 2020-12-31)
  Peize Sun, Jinkun Cao, Yi Jiang, Rufeng Zhang, Enze Xie, Zehuan Yuan, Changhu Wang, Ping Luo.
  [paper] [code]

• MAT: Motion-Aware Multi-Object Tracking. (arXiv 2020-9)
  Shoudong Han, Piao Huang, Hongwei Wang, En Yu, Donghaisheng Liu, Xiaofeng Pan, Jun Zhao.
  [paper]

ICCV 2019

• Tracking Without Bells and Whistles
  Philipp Bergmann, Tim Meinhardt, Laura Leal-Taixe
  [paper] [code]

• Robust Multi-Modality Multi-Object Tracking
  Wenwei Zhang, Hui Zhou, Shuyang Sun, Zhe Wang, Jianping Shi, Chen Change Loy
  [paper] [code]

• Spatial-Temporal Relation Networks for Multi-Object Tracking
  Jiarui Xu, Yue Cao, Zheng Zhang, Han Hu
  [paper] [code]

• Bridging the Gap Between Detection and Tracking: A Unified Approach
  Lianghua Huang, Xin Zhao, Kaiqi Huang
  [paper] [code]

• Physical Adversarial Textures That Fool Visual Object Tracking
  Rey Reza Wiyatno, Anqi Xu
  [paper] [code]

• FAMNet: Joint Learning of Feature, Affinity and Multi-Dimensional Assignment for Online Multiple Object Tracking
  Peng Chu, Haibin Ling
  [paper] [code]

CVPR 2019

• Tracking by Animation: Unsupervised Learning of Multi-Object Attentive Trackers.
  Zhen He, Jian Li, Daxue Liu, Hangen He, David Barber
  [paper] [code]

• Eliminating Exposure Bias and Metric Mismatch in Multiple Object Tracking.
  Andrii Maksai, Pascal Fua
  [paper] [code]

• MOTS: Multi-Object Tracking and Segmentation.
  Paul Voigtlaender, Michael Krause, Aljosa Osep, Jonathon Luiten, Berin Balachandar Gnana Sekar, Andreas Geiger, Bastian Leibe
  [paper] [code]

• Cross-Classification Clustering: An Efficient Multi-Object Tracking Technique for 3-D Instance Segmentation in Connectomics.
  Yaron Meirovitch, Lu Mi, Hayk Saribekyan, Alexander Matveev, David Rolnick, Nir Shavit
  [paper] [code]

• CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identification
  Zheng Tang, Milind Naphade, Ming-Yu Liu, Xiaodong Yang, Stan Birchfield, Shuo Wang, Ratnesh Kumar, David Anastasiu, Jenq-Neng Hwang
  [paper] [code]

CVPR 2018

• Towards Dense Object Tracking in a 2D Honeybee Hive.
  Katarzyna Bozek, Laetitia Hebert, Alexander S. Mikheyev, Greg J. Stephens
  [paper] [code]

• Rolling Shutter and Radial Distortion Are Features for High Frame Rate Multi-Camera Tracking.
  Akash Bapat, True Price, Jan-Michael Frahm
  [paper] [code]

• Fusing Crowd Density Maps and Visual Object Trackers for People Tracking in Crowd Scenes.
  Weihong Ren, Di Kang, Yandong Tang, Antoni B. Chan
  [paper] [code]

• Features for Multi-Target Multi-Camera Tracking and Re-Identification.
  Ergys Ristani, Carlo Tomasi
  [paper] [code]

• Tracking Multiple Objects Outside the Line of Sight Using Speckle Imaging.
  Brandon M. Smith, Matthew O'Toole, Mohit Gupta
  [paper] [code]

ICCV 2017

• Tracking the Untrackable: Learning to Track Multiple Cues With Long-Term Dependencies.
  Amir Sadeghian, Alexandre Alahi, Silvio Savarese
  [paper] [code]

• Non-Markovian Globally Consistent Multi-Object Tracking.
  Andrii Maksai, Xinchao Wang, Francois Fleuret, Pascal Fua
  [paper] [code]

• Online Multi-Object Tracking Using CNN-Based Single Object Tracker With Spatial-Temporal Attention Mechanism.
  Qi Chu, Wanli Ouyang, Hongsheng Li, Xiaogang Wang, Bin Liu, Nenghai Yu
  [paper] [code]

CVPR 2017

• Multiple People Tracking by Lifted Multicut and Person Re-Identification.
  Siyu Tang, Mykhaylo Andriluka, Bjoern Andres, Bernt Schiele
  [paper] [code]

• Multi-Object Tracking With Quadruplet Convolutional Neural Networks.
  Jeany Son, Mooyeol Baek, Minsu Cho, Bohyung Han
  [paper] [code]

• Deep Network Flow for Multi-Object Tracking.
  Samuel Schulter, Paul Vernaza, Wongun Choi, Manmohan Chandraker
  [paper] [code]

Datasets

• VisDrone: "Vision Meets Drones: Past, Present and Future". arXiv 2020.
  Pengfei Zhu, Longyin Wen, Dawei Du, Xiao Bian, Qinghua Hu, Haibin Ling
  [paper] [project]

• TAO: A Large-Scale Benchmark for Tracking Any Object. (ECCV 2020)
  Achal Dave, Tarasha Khurana, Pavel Tokmakov, Cordelia Schmid, Deva Ramanan.
  [paper] [project] [code]

• PANDA: A Gigapixel-level Human-centric Video Dataset. (CVPR 2020)
  Xueyang Wang, Xiya Zhang, Yinheng Zhu, Yuchen Guo, Xiaoyun Yuan, Liuyu Xiang, Zerun Wang, Guiguang Ding, David J Brady, Qionghai Dai, Lu Fang
  [paper][project]

• 3D-ZeF: A 3D Zebrafish Tracking Benchmark Dataset. (CVPR 2020)
  Malte Pedersen, Joakim Bruslund Haurum, Stefan Hein Bengtson, Thomas B. Moeslund. [paper] [project]

• CTMC: Cell Tracking with Mitosis Detection Dataset Challenge. (CVPRW 2020)
  Samreen Anjum, Danna Gurari
  [paper] [project]

• UA-DETRAC: A new benchmark and protocol for multi-object tracking. (CVIU 2020)
  Longyin Wen, Dawei Du, Zhaowei Cai, Zhen Lei, Ming-Ching Chang, Honggang Qi, Jongwoo Lim, Ming-Hsuan Yang, Siwei Lyu.
  [paper] [project]

• HOTA: A Higher Order Metric for Evaluating Multi-Object Tracking. (IJCV 2020)
  Jonathon Luiten, Aljosa Osep, Patrick Dendorfer, Philip Torr, Andreas Geiger, Laura Leal-Taixe, Bastian Leibe.
  [paper] [code]

• MOT20: A benchmark for multi object tracking in crowded scenes. (arXiv 2020)
  Patrick Dendorfer, Hamid Rezatofighi, Anton Milan, Javen Shi, Daniel Cremers, Ian Reid, Stefan Roth, Konrad Schindler, Laura Leal-Taixé
  [paper] [project]

• MOTS: Multi-Object Tracking and Segmentation. (CVPR 2019)
  Paul Voigtlaender, Michael Krause, Aljosa Osep, Jonathon Luiten, Berin Balachandar Gnana Sekar, Andreas Geiger, Bastian Leibe
  [paper] [code]

• Performance Measures and a Data Set for Multi-Target, Multi-Camera Tracking. (ECCVW 2016)
  Ergys Ristani, Francesco Solera, Roger S. Zou, Rita Cucchiara, Carlo Tomasi
  [paper]

• MOT16: A Benchmark for Multi-Object Tracking. (arXiv 2016)
  Anton Milan, Laura Leal-Taixe, Ian Reid, Stefan Roth, Konrad Schindler.
  [paper] [project]

• MOTChallenge 2015: Towards a Benchmark for Multi-Target Tracking. (arXiv 2015)
  Laura Leal-Taixé, Anton Milan, Ian Reid, Stefan Roth, Konrad Schindler
  [paper] [project]