The First Visual Object Tracking Segmentation VOTS2023 Challenge Results

Matej Kristan; Jiří Matas; Martin Danelljan; Michael Felsberg; Hyung Jin Chang; Luka Čehovin Zajc; Alan Lukežič; Ondrej Drbohlav; Zhongqun Zhang; Khanh Tung Tran; Xuan Son Vu; Johanna Björklund; Christoph Mayer; Yushan Zhang; Lei Ke; Jie Zhao; Gustavo Fernández; Noor Al-Shakarji; Dong An; Michael Arens; Stefan Becker; Goutam Bhat; Sebastian Bullinger; Antoni B. Chan; Shijie Chang; Hanyuan Chen; Xin Chen; Yan Chen; Zhenyu Chen; Yangming Cheng; Yutao Cui; Chunyuan Deng; Jiahua Dong; Matteo Dunnhofer; Wei Feng; Jianlong Fu; Jie Gao; Ruize Han; Zeqi Hao; Jun Yan He; Keji He; Zhenyu He; Xiantao Hu; Kaer Huang; Yuqing Huang; Yi Jiang; Ben Kang; Jin Peng Lan; Hyungjun Lee; Chenyang Li; Jiahao Li; Ning Li; Wangkai Li; Xiaodi Li; Xin Li; Pengyu Liu; Yue Liu; Huchuan Lu; Bin Luo; Ping Luo; Yinchao Ma; Deshui Miao; Christian Micheloni; Kannappan Palaniappan; Hancheol Park; Matthieu Paul; Hou Wen Peng; Zekun Qian; Gani Rahmon; Norbert Scherer-Negenborn; Pengcheng Shao; Wooksu Shin; Elham Soltani Kazemi; Tianhui Song; Rainer Stiefelhagen; Rui Sun; Chuanming Tang; Zhangyong Tang; Imad Eddine Toubal; Jack Valmadre; Joost Van De Weijer; Luc Van Gool; Jash Vira; Stèphane Vujasinović; Cheng Wan; Jia Wan; Dong Wang; Fei Wang; Feifan Wang; He Wang; Limin Wang; Song Wang; Yaowei Wang; Zhepeng Wang; Gangshan Wu; Jiannan Wu; Qiangqiang Wu; Xiaojun Wu; Anqi Xiao; Jinxia Xie; Chenlong Xu; Min Xu; Tianyang Xu; Yuanyou Xu; Bin Yan; Dawei Yang; Ming Hsuan Yang; Tianyu Yang; Yi Yang; Zongxin Yang; Xuanwu Yin; Fisher Yu; Hongyuan Yu; Qianjin Yu; Weichen Yu; Yong Sheng Yuan; Zehuan Yuan; Jianlin Zhang; Lu Zhang; Tianzhu Zhang; Guodongfang Zhao; Shaochuan Zhao; Yaozong Zheng; Bineng Zhong; Jiawen Zhu; Xuefeng Zhu; Yueting Zhuang; Cheng Ao Zong; Kunlong Zuo

doi:10.1109/ICCVW60793.2023.00195

The First Visual Object Tracking Segmentation VOTS2023 Challenge Results

Matej Kristan^*
, Jiří Matas
, Martin Danelljan
, Michael Felsberg
, Hyung Jin Chang
, Luka Čehovin Zajc
, Alan Lukežič
, Ondrej Drbohlav
, Zhongqun Zhang
, Khanh Tung Tran
, Xuan Son Vu
, Johanna Björklund
, Christoph Mayer
, Yushan Zhang
, Lei Ke
, Jie Zhao
, Gustavo Fernández
, Noor Al-Shakarji
, Dong An
, Michael Arens

Stefan Becker, Goutam Bhat, Sebastian Bullinger, Antoni B. Chan, Shijie Chang, Hanyuan Chen, Xin Chen, Yan Chen, Zhenyu Chen, Yangming Cheng, Yutao Cui, Chunyuan Deng, Jiahua Dong, Matteo Dunnhofer, Wei Feng, Jianlong Fu, Jie Gao, Ruize Han, Zeqi Hao, Jun Yan He, Keji He, Zhenyu He, Xiantao Hu, Kaer Huang, Yuqing Huang, Yi Jiang, Ben Kang, Jin Peng Lan, Hyungjun Lee, Chenyang Li, Jiahao Li, Ning Li, Wangkai Li, Xiaodi Li, Xin Li, Pengyu Liu, Yue Liu, Huchuan Lu, Bin Luo, Ping Luo, Yinchao Ma, Deshui Miao, Christian Micheloni, Kannappan Palaniappan, Hancheol Park, Matthieu Paul, Hou Wen Peng, Zekun Qian, Gani Rahmon, Norbert Scherer-Negenborn, Pengcheng Shao, Wooksu Shin, Elham Soltani Kazemi, Tianhui Song, Rainer Stiefelhagen, Rui Sun, Chuanming Tang, Zhangyong Tang, Imad Eddine Toubal, Jack Valmadre, Joost Van De Weijer, Luc Van Gool, Jash Vira, Stèphane Vujasinović, Cheng Wan, Jia Wan, Dong Wang, Fei Wang, Feifan Wang, He Wang, Limin Wang, Song Wang, Yaowei Wang, Zhepeng Wang, Gangshan Wu, Jiannan Wu, Qiangqiang Wu, Xiaojun Wu, Anqi Xiao, Jinxia Xie, Chenlong Xu, Min Xu, Tianyang Xu, Yuanyou Xu, Bin Yan, Dawei Yang, Ming Hsuan Yang, Tianyu Yang, Yi Yang, Zongxin Yang, Xuanwu Yin, Fisher Yu, Hongyuan Yu, Qianjin Yu, Weichen Yu, Yong Sheng Yuan, Zehuan Yuan, Jianlin Zhang, Lu Zhang, Tianzhu Zhang, Guodongfang Zhao, Shaochuan Zhao, Yaozong Zheng, Bineng Zhong, Jiawen Zhu, Xuefeng Zhu, Yueting Zhuang, Cheng Ao Zong, Kunlong Zuo

^*Corresponding author for this work

University of Ljubljana
Czech Technical University in Prague
ETH Zurich
Linköping University
University of Birmingham
Umeå University
Dalian University of Technology
Austrian Institute of Technology
University of Missouri
Institute of Automation
Fraunhofer Institute of Optronics, System Technologies and Image Exploitation
City University of Hong Kong
DAMO Academy
Huaqiao University
Zhejiang University
Nanjing University
Georgia Institute of Technology
CAS - Shenyang Institute of Automation
University of Udine
Tianjin University
Microsoft USA
Harbin Institute of Technology Shenzhen
Guangxi Normal University
Lenovo Research
ByteDance Ltd.
Nota AI
University of Science and Technology of China
Peng Cheng Laboratory
Jiangnan University
The University of Hong Kong
Karlsruhe Institute of Technology
University of Chinese Academy of Sciences
Adelaide University
Computer Vision Centre
Boston College
University of South Carolina
Carnegie Mellon University
University of California Merced
International Digital Economy Academy
Xiaomi
CAS - Institute of Computing Technology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

28 Scopus citations

Abstract

The Visual Object Tracking Segmentation VOTS2023 challenge is the eleventh annual tracker benchmarking activity of the VOT initiative. This challenge is the first to merge short-term and long-term as well as single-target and multiple-target tracking with segmentation masks as the only target location specification. A new dataset was created; the ground truth has been withheld to prevent overfitting. New performance measures and evaluation protocols have been created along with a new toolkit and an evaluation server. Results of the presented 47 trackers indicate that modern tracking frameworks are well-suited to deal with convergence of short-term and long-term tracking and that multiple and single target tracking can be considered a single problem.

Original language	English
Title of host publication	Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	1788-1810
Number of pages	23
ISBN (Electronic)	9798350307443
DOIs	https://doi.org/10.1109/ICCVW60793.2023.00195
State	Published - 2023
Externally published	Yes
Event	19th IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023 - Paris, France Duration: 2 Oct 2023 → 6 Oct 2023

Publication series

Name	Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023

Conference

Conference	19th IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023
Country/Territory	France
City	Paris
Period	2/10/23 → 6/10/23

Access to Document

10.1109/ICCVW60793.2023.00195

Cite this

Kristan, M., Matas, J., Danelljan, M., Felsberg, M., Chang, H. J., Zajc, L. Č., Lukežič, A., Drbohlav, O., Zhang, Z., Tran, K. T., Vu, X. S., Björklund, J., Mayer, C., Zhang, Y., Ke, L., Zhao, J., Fernández, G., Al-Shakarji, N., An, D., ... Zuo, K. (2023). The First Visual Object Tracking Segmentation VOTS2023 Challenge Results. In Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023 (pp. 1788-1810). (Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCVW60793.2023.00195

Kristan, Matej ; Matas, Jiří ; Danelljan, Martin et al. / The First Visual Object Tracking Segmentation VOTS2023 Challenge Results. Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023. Institute of Electrical and Electronics Engineers Inc., 2023. pp. 1788-1810 (Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023).

@inproceedings{8c66fc8e1894499bb910849a5942e27b,

title = "The First Visual Object Tracking Segmentation VOTS2023 Challenge Results",

abstract = "The Visual Object Tracking Segmentation VOTS2023 challenge is the eleventh annual tracker benchmarking activity of the VOT initiative. This challenge is the first to merge short-term and long-term as well as single-target and multiple-target tracking with segmentation masks as the only target location specification. A new dataset was created; the ground truth has been withheld to prevent overfitting. New performance measures and evaluation protocols have been created along with a new toolkit and an evaluation server. Results of the presented 47 trackers indicate that modern tracking frameworks are well-suited to deal with convergence of short-term and long-term tracking and that multiple and single target tracking can be considered a single problem.",

author = "Matej Kristan and Ji{\v r}{\'i} Matas and Martin Danelljan and Michael Felsberg and Chang, \{Hyung Jin\} and Zajc, \{Luka {\v C}ehovin\} and Alan Luke{\v z}i{\v c} and Ondrej Drbohlav and Zhongqun Zhang and Tran, \{Khanh Tung\} and Vu, \{Xuan Son\} and Johanna Bj{\"o}rklund and Christoph Mayer and Yushan Zhang and Lei Ke and Jie Zhao and Gustavo Fern{\'a}ndez and Noor Al-Shakarji and Dong An and Michael Arens and Stefan Becker and Goutam Bhat and Sebastian Bullinger and Chan, \{Antoni B.\} and Shijie Chang and Hanyuan Chen and Xin Chen and Yan Chen and Zhenyu Chen and Yangming Cheng and Yutao Cui and Chunyuan Deng and Jiahua Dong and Matteo Dunnhofer and Wei Feng and Jianlong Fu and Jie Gao and Ruize Han and Zeqi Hao and He, \{Jun Yan\} and Keji He and Zhenyu He and Xiantao Hu and Kaer Huang and Yuqing Huang and Yi Jiang and Ben Kang and Lan, \{Jin Peng\} and Hyungjun Lee and Chenyang Li and Jiahao Li and Ning Li and Wangkai Li and Xiaodi Li and Xin Li and Pengyu Liu and Yue Liu and Huchuan Lu and Bin Luo and Ping Luo and Yinchao Ma and Deshui Miao and Christian Micheloni and Kannappan Palaniappan and Hancheol Park and Matthieu Paul and Peng, \{Hou Wen\} and Zekun Qian and Gani Rahmon and Norbert Scherer-Negenborn and Pengcheng Shao and Wooksu Shin and Kazemi, \{Elham Soltani\} and Tianhui Song and Rainer Stiefelhagen and Rui Sun and Chuanming Tang and Zhangyong Tang and Toubal, \{Imad Eddine\} and Jack Valmadre and \{Van De Weijer\}, Joost and \{Van Gool\}, Luc and Jash Vira and St{\`e}phane Vujasinovi{\'c} and Cheng Wan and Jia Wan and Dong Wang and Fei Wang and Feifan Wang and He Wang and Limin Wang and Song Wang and Yaowei Wang and Zhepeng Wang and Gangshan Wu and Jiannan Wu and Qiangqiang Wu and Xiaojun Wu and Anqi Xiao and Jinxia Xie and Chenlong Xu and Min Xu and Tianyang Xu and Yuanyou Xu and Bin Yan and Dawei Yang and Yang, \{Ming Hsuan\} and Tianyu Yang and Yi Yang and Zongxin Yang and Xuanwu Yin and Fisher Yu and Hongyuan Yu and Qianjin Yu and Weichen Yu and Yuan, \{Yong Sheng\} and Zehuan Yuan and Jianlin Zhang and Lu Zhang and Tianzhu Zhang and Guodongfang Zhao and Shaochuan Zhao and Yaozong Zheng and Bineng Zhong and Jiawen Zhu and Xuefeng Zhu and Yueting Zhuang and Zong, \{Cheng Ao\} and Kunlong Zuo",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 19th IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023 ; Conference date: 02-10-2023 Through 06-10-2023",

year = "2023",

doi = "10.1109/ICCVW60793.2023.00195",

language = "英语",

series = "Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "1788--1810",

booktitle = "Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023",

address = "美国",

}

Kristan, M, Matas, J, Danelljan, M, Felsberg, M, Chang, HJ, Zajc, LČ, Lukežič, A, Drbohlav, O, Zhang, Z, Tran, KT, Vu, XS, Björklund, J, Mayer, C, Zhang, Y, Ke, L, Zhao, J, Fernández, G, Al-Shakarji, N, An, D, Arens, M, Becker, S, Bhat, G, Bullinger, S, Chan, AB, Chang, S, Chen, H, Chen, X, Chen, Y, Chen, Z, Cheng, Y, Cui, Y, Deng, C, Dong, J, Dunnhofer, M, Feng, W, Fu, J, Gao, J, Han, R, Hao, Z, He, JY, He, K, He, Z, Hu, X, Huang, K, Huang, Y, Jiang, Y, Kang, B, Lan, JP, Lee, H, Li, C, Li, J, Li, N, Li, W, Li, X, Li, X, Liu, P, Liu, Y, Lu, H, Luo, B, Luo, P, Ma, Y, Miao, D, Micheloni, C, Palaniappan, K, Park, H, Paul, M, Peng, HW, Qian, Z, Rahmon, G, Scherer-Negenborn, N, Shao, P, Shin, W, Kazemi, ES, Song, T, Stiefelhagen, R, Sun, R, Tang, C, Tang, Z, Toubal, IE, Valmadre, J, Van De Weijer, J, Van Gool, L, Vira, J, Vujasinović, S, Wan, C, Wan, J, Wang, D, Wang, F, Wang, F, Wang, H, Wang, L, Wang, S, Wang, Y, Wang, Z, Wu, G, Wu, J, Wu, Q, Wu, X, Xiao, A, Xie, J, Xu, C, Xu, M, Xu, T, Xu, Y, Yan, B, Yang, D, Yang, MH, Yang, T, Yang, Y, Yang, Z, Yin, X, Yu, F, Yu, H, Yu, Q, Yu, W, Yuan, YS, Yuan, Z, Zhang, J, Zhang, L, Zhang, T, Zhao, G, Zhao, S, Zheng, Y, Zhong, B, Zhu, J, Zhu, X, Zhuang, Y, Zong, CA & Zuo, K 2023, The First Visual Object Tracking Segmentation VOTS2023 Challenge Results. in Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023. Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023, Institute of Electrical and Electronics Engineers Inc., pp. 1788-1810, 19th IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023, Paris, France, 2/10/23. https://doi.org/10.1109/ICCVW60793.2023.00195

The First Visual Object Tracking Segmentation VOTS2023 Challenge Results. / Kristan, Matej; Matas, Jiří; Danelljan, Martin et al.
Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023. Institute of Electrical and Electronics Engineers Inc., 2023. p. 1788-1810 (Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - The First Visual Object Tracking Segmentation VOTS2023 Challenge Results

AU - Kristan, Matej

AU - Matas, Jiří

AU - Danelljan, Martin

AU - Felsberg, Michael

AU - Chang, Hyung Jin

AU - Zajc, Luka Čehovin

AU - Lukežič, Alan

AU - Drbohlav, Ondrej

AU - Zhang, Zhongqun

AU - Tran, Khanh Tung

AU - Vu, Xuan Son

AU - Björklund, Johanna

AU - Mayer, Christoph

AU - Zhang, Yushan

AU - Ke, Lei

AU - Zhao, Jie

AU - Fernández, Gustavo

AU - Al-Shakarji, Noor

AU - An, Dong

AU - Arens, Michael

AU - Becker, Stefan

AU - Bhat, Goutam

AU - Bullinger, Sebastian

AU - Chan, Antoni B.

AU - Chang, Shijie

AU - Chen, Hanyuan

AU - Chen, Xin

AU - Chen, Yan

AU - Chen, Zhenyu

AU - Cheng, Yangming

AU - Cui, Yutao

AU - Deng, Chunyuan

AU - Dong, Jiahua

AU - Dunnhofer, Matteo

AU - Feng, Wei

AU - Fu, Jianlong

AU - Gao, Jie

AU - Han, Ruize

AU - Hao, Zeqi

AU - He, Jun Yan

AU - He, Keji

AU - He, Zhenyu

AU - Hu, Xiantao

AU - Huang, Kaer

AU - Huang, Yuqing

AU - Jiang, Yi

AU - Kang, Ben

AU - Lan, Jin Peng

AU - Lee, Hyungjun

AU - Li, Chenyang

AU - Li, Jiahao

AU - Li, Ning

AU - Li, Wangkai

AU - Li, Xiaodi

AU - Li, Xin

AU - Liu, Pengyu

AU - Liu, Yue

AU - Lu, Huchuan

AU - Luo, Bin

AU - Luo, Ping

AU - Ma, Yinchao

AU - Miao, Deshui

AU - Micheloni, Christian

AU - Palaniappan, Kannappan

AU - Park, Hancheol

AU - Paul, Matthieu

AU - Peng, Hou Wen

AU - Qian, Zekun

AU - Rahmon, Gani

AU - Scherer-Negenborn, Norbert

AU - Shao, Pengcheng

AU - Shin, Wooksu

AU - Kazemi, Elham Soltani

AU - Song, Tianhui

AU - Stiefelhagen, Rainer

AU - Sun, Rui

AU - Tang, Chuanming

AU - Tang, Zhangyong

AU - Toubal, Imad Eddine

AU - Valmadre, Jack

AU - Van De Weijer, Joost

AU - Van Gool, Luc

AU - Vira, Jash

AU - Vujasinović, Stèphane

AU - Wan, Cheng

AU - Wan, Jia

AU - Wang, Dong

AU - Wang, Fei

AU - Wang, Feifan

AU - Wang, He

AU - Wang, Limin

AU - Wang, Song

AU - Wang, Yaowei

AU - Wang, Zhepeng

AU - Wu, Gangshan

AU - Wu, Jiannan

AU - Wu, Qiangqiang

AU - Wu, Xiaojun

AU - Xiao, Anqi

AU - Xie, Jinxia

AU - Xu, Chenlong

AU - Xu, Min

AU - Xu, Tianyang

AU - Xu, Yuanyou

AU - Yan, Bin

AU - Yang, Dawei

AU - Yang, Ming Hsuan

AU - Yang, Tianyu

AU - Yang, Yi

AU - Yang, Zongxin

AU - Yin, Xuanwu

AU - Yu, Fisher

AU - Yu, Hongyuan

AU - Yu, Qianjin

AU - Yu, Weichen

AU - Yuan, Yong Sheng

AU - Yuan, Zehuan

AU - Zhang, Jianlin

AU - Zhang, Lu

AU - Zhang, Tianzhu

AU - Zhao, Guodongfang

AU - Zhao, Shaochuan

AU - Zheng, Yaozong

AU - Zhong, Bineng

AU - Zhu, Jiawen

AU - Zhu, Xuefeng

AU - Zhuang, Yueting

AU - Zong, Cheng Ao

AU - Zuo, Kunlong

PY - 2023

Y1 - 2023

N2 - The Visual Object Tracking Segmentation VOTS2023 challenge is the eleventh annual tracker benchmarking activity of the VOT initiative. This challenge is the first to merge short-term and long-term as well as single-target and multiple-target tracking with segmentation masks as the only target location specification. A new dataset was created; the ground truth has been withheld to prevent overfitting. New performance measures and evaluation protocols have been created along with a new toolkit and an evaluation server. Results of the presented 47 trackers indicate that modern tracking frameworks are well-suited to deal with convergence of short-term and long-term tracking and that multiple and single target tracking can be considered a single problem.

AB - The Visual Object Tracking Segmentation VOTS2023 challenge is the eleventh annual tracker benchmarking activity of the VOT initiative. This challenge is the first to merge short-term and long-term as well as single-target and multiple-target tracking with segmentation masks as the only target location specification. A new dataset was created; the ground truth has been withheld to prevent overfitting. New performance measures and evaluation protocols have been created along with a new toolkit and an evaluation server. Results of the presented 47 trackers indicate that modern tracking frameworks are well-suited to deal with convergence of short-term and long-term tracking and that multiple and single target tracking can be considered a single problem.

UR - https://www.scopus.com/pages/publications/85175967599

U2 - 10.1109/ICCVW60793.2023.00195

DO - 10.1109/ICCVW60793.2023.00195

M3 - 会议稿件

AN - SCOPUS:85175967599

T3 - Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023

SP - 1788

EP - 1810

BT - Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 19th IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023

Y2 - 2 October 2023 through 6 October 2023

ER -

Kristan M, Matas J, Danelljan M, Felsberg M, Chang HJ, Zajc LČ et al. The First Visual Object Tracking Segmentation VOTS2023 Challenge Results. In Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023. Institute of Electrical and Electronics Engineers Inc. 2023. p. 1788-1810. (Proceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023). doi: 10.1109/ICCVW60793.2023.00195

The First Visual Object Tracking Segmentation VOTS2023 Challenge Results

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this