Abstract

Remote rendering systems comprise powerful servers that render graphics on behalf of low-end client devices and stream the graphics as compressed video, enabling high end gaming and Virtual Reality on those devices. One key challenge with them is the amount of bandwidth required for streaming high quality video. Humans have spatially non-uniform visual acuity: We have sharp central vision but our ability to discern details rapidly decreases with angular distance from the point of gaze. This phenomenon called foveation can be taken advantage of to reduce the need for bandwidth. In this paper, we study three different methods to produce a foveated video stream of real-Time rendered graphics in a remote rendered system: 1) foveated shading as part of the rendering pipeline, 2) foveation as post processing step after rendering and before video encoding, 3) foveated video encoding. We report results from a number of experiments with these methods. They suggest that foveated rendering alone does not help save bandwidth. Instead, the two other methods decrease the resulting video bitrate significantly but they also have different quality per bit and latency profiles, which makes them desirable solutions in slightly different situations.

Original languageEnglish
Title of host publicationMMSys 2021 - Proceedings of the 2021 Multimedia Systems Conference
PublisherACM
Pages215-226
Number of pages12
ISBN (Electronic)9781450384346
DOIs
Publication statusPublished - 15 Jul 2021
MoE publication typeA4 Article in a conference publication
EventACM Multimedia Systems Conference - Virtual, Online, Turkey
Duration: 28 Sep 20211 Oct 2021
Conference number: 12

Conference

ConferenceACM Multimedia Systems Conference
Abbreviated titleMMSys
Country/TerritoryTurkey
CityVirtual, Online
Period28/09/202101/10/2021

Keywords

  • cloud rendering
  • foveated rendering
  • foveated streaming
  • virtual reality

Fingerprint

Dive into the research topics of 'Foveated streaming of real-Time graphics'. Together they form a unique fingerprint.

Cite this