Skip to main navigation Skip to search Skip to main content

Perceptual Quality Assessment of Virtual Reality Videos in the Wild

  • Wen Wen
  • , Mu Li*
  • , Yiru Yao
  • , Xiangjie Sui
  • , Yabin Zhang
  • , Long Lan
  • , Yuming Fang
  • , Kede Ma
  • *Corresponding author for this work
  • City University of Hong Kong
  • School of Computer Science and Technology, Harbin Institute of Technology
  • Jiangxi University of Finance and Economics
  • ByteDance Ltd.
  • National University of Defense Technology

Research output: Contribution to journalArticlepeer-review

Abstract

Investigating how people perceive virtual reality (VR) videos in the wild (i.e., those captured by everyday users) is a crucial and challenging task in VR-related applications due to complex authentic distortions localized in space and time. Existing panoramic video databases only consider synthetic distortions, assume fixed viewing conditions, and are limited in size. To overcome these shortcomings, we construct the VR Video Quality in the Wild (VRVQW) database, containing 502 user-generated videos with diverse content and distortion characteristics. Based on VRVQW, we conduct a formal psychophysical experiment to record the scanpaths and perceived quality scores from 139 participants under two different viewing conditions. We provide a thorough statistical analysis of the recorded data, observing significant impact of viewing conditions on both human scanpaths and perceived quality. Moreover, we develop an objective quality assessment model for VR videos based on pseudocylindrical representation and convolution. Results on the proposed VRVQW show that our method is superior to existing video quality assessment models. We have made the database and code available at https://github.com/limuhit/VR-Video-Quality-in-the-Wild.

Original languageEnglish
Pages (from-to)8368-8381
Number of pages14
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume34
Issue number9
DOIs
StatePublished - 2024
Externally publishedYes

Keywords

  • Virtual reality
  • panoramic videos
  • psychophysics
  • video quality assessment

Fingerprint

Dive into the research topics of 'Perceptual Quality Assessment of Virtual Reality Videos in the Wild'. Together they form a unique fingerprint.

Cite this