Foveated Spatial Compression for Remote Rendered Virtual Reality

Teemu Kämäräinen, Matti Siekkinen

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

1 Citation (Scopus)
26 Downloads (Pure)

Abstract

In remote rendered virtual reality (VR), the rendering of the application is moved to the cloud enabling high quality real-time content to be consumed on low-powered standalone head mounted displays (HMDs). The rendered frames are encoded to a video stream and streamed to a thin client which relays user's input to the server and decodes and displays the incoming video. Latency and high bandwidth requirements are key challenges for remote rendered graphics. Foveation can be used to optimize the quality of the transmitted frames to be in line with the human visual system (HVS). In this paper we evaluate multiple different strategies on how to apply foveation to spatially compress video frames, i.e., reduce their resolution, before transmission. We also show how the foveation methods can be used together with super resolution to alleviate the bandwidth usage of real-time remote rendered VR and optimize the perceived image quality.

Original languageEnglish
Title of host publicationMetaSys 2023 - Proceedings of the 1st Workshop on Metaverse Systems and Applications, Part of MobiSys 2023
PublisherACM
Pages7-13
Number of pages7
ISBN (Electronic)979-8-4007-0213-6
DOIs
Publication statusPublished - 18 Jun 2023
MoE publication typeA4 Conference publication
EventWorkshop on Metaverse Systems and Applications - Helsinki, Finland
Duration: 18 Jun 202322 Jun 2023
Conference number: 1

Workshop

WorkshopWorkshop on Metaverse Systems and Applications
Abbreviated titleMetaSys
Country/TerritoryFinland
CityHelsinki
Period18/06/202322/06/2023

Keywords

  • foveation
  • super resolution
  • virtual reality

Fingerprint

Dive into the research topics of 'Foveated Spatial Compression for Remote Rendered Virtual Reality'. Together they form a unique fingerprint.

Cite this