On the Interplay of Foveated Rendering and Video Encoding

Gazi Gazi Karam Illahi; Matti Siekkinen; Teemu Kämäräinen; Antti Ylä-Jääski

doi:10.1145/3385956.3422126

On the Interplay of Foveated Rendering and Video Encoding

Gazi Gazi Karam Illahi, Matti Siekkinen, Teemu Kämäräinen, Antti Ylä-Jääski

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

3 Citations (Scopus)

221 Downloads (Pure)

Abstract

Humans have sharp central vision but low peripheral visual acuity. Prior work has taken advantage of this phenomenon in two ways: foveated rendering (FR) reduces the computational workload of rendering by producing lower visual quality for peripheral regions and foveated video encoding (FVE) reduces the bitrate of streamed video through heavier compression of peripheral regions. Remote rendering systems require both rendering and video encoding and the two techniques can be combined to reduce both computing and bandwidth consumption. We report early results from such a combination with remote VR rendering. The results highlight that FR causes large bitrate overhead when combined with normal video encoding but combining it with FVE can mitigate it.

Original language	English
Title of host publication	Proceedings - VRST 2020
Subtitle of host publication	ACM Symposium on Virtual Reality Software and Technology
Editors	Stephen N. Spencer
Publisher	ACM
Number of pages	3
ISBN (Electronic)	978-1-4503-7619-8
DOIs	https://doi.org/10.1145/3385956.3422126
Publication status	Published - 1 Nov 2020
MoE publication type	A4 Conference publication
Event	ACM Symposium on Virtual Reality Software and Technology - Virtual, Online Duration: 1 Nov 2020 → 4 Nov 2020 Conference number: 26 https://vrst.acm.org/vrst2020/

Conference

Conference	ACM Symposium on Virtual Reality Software and Technology
Abbreviated title	VRST
City	Virtual, Online
Period	01/11/2020 → 04/11/2020
Internet address	https://vrst.acm.org/vrst2020/

Access to Document

10.1145/3385956.3422126

On_The_Interplay.3385956.3422126-1Final published version, 1.76 MB

Cite this

@inproceedings{e7a837a92cba4ef8aee43b3891612441,

title = "On the Interplay of Foveated Rendering and Video Encoding",

abstract = "Humans have sharp central vision but low peripheral visual acuity. Prior work has taken advantage of this phenomenon in two ways: foveated rendering (FR) reduces the computational workload of rendering by producing lower visual quality for peripheral regions and foveated video encoding (FVE) reduces the bitrate of streamed video through heavier compression of peripheral regions. Remote rendering systems require both rendering and video encoding and the two techniques can be combined to reduce both computing and bandwidth consumption. We report early results from such a combination with remote VR rendering. The results highlight that FR causes large bitrate overhead when combined with normal video encoding but combining it with FVE can mitigate it.",

author = "{Gazi Karam Illahi}, Gazi and Matti Siekkinen and Teemu K{\"a}m{\"a}r{\"a}inen and Antti Yl{\"a}-J{\"a}{\"a}ski",

year = "2020",

month = nov,

day = "1",

doi = "10.1145/3385956.3422126",

language = "English",

editor = "Spencer, {Stephen N.}",

booktitle = "Proceedings - VRST 2020",

publisher = "ACM",

address = "United States",

note = "ACM Symposium on Virtual Reality Software and Technology, VRST ; Conference date: 01-11-2020 Through 04-11-2020",

url = "https://vrst.acm.org/vrst2020/",

}

Gazi Karam Illahi, G, Siekkinen, M, Kämäräinen, T & Ylä-Jääski, A 2020, On the Interplay of Foveated Rendering and Video Encoding. in SN Spencer (ed.), Proceedings - VRST 2020: ACM Symposium on Virtual Reality Software and Technology., 66, ACM, ACM Symposium on Virtual Reality Software and Technology, Virtual, Online, 01/11/2020. https://doi.org/10.1145/3385956.3422126

On the Interplay of Foveated Rendering and Video Encoding. / Gazi Karam Illahi, Gazi; Siekkinen, Matti; Kämäräinen, Teemu et al.
Proceedings - VRST 2020: ACM Symposium on Virtual Reality Software and Technology. ed. / Stephen N. Spencer. ACM, 2020. 66.

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

TY - GEN

T1 - On the Interplay of Foveated Rendering and Video Encoding

AU - Gazi Karam Illahi, Gazi

AU - Siekkinen, Matti

AU - Kämäräinen, Teemu

AU - Ylä-Jääski, Antti

N1 - Conference code: 26

PY - 2020/11/1

Y1 - 2020/11/1

N2 - Humans have sharp central vision but low peripheral visual acuity. Prior work has taken advantage of this phenomenon in two ways: foveated rendering (FR) reduces the computational workload of rendering by producing lower visual quality for peripheral regions and foveated video encoding (FVE) reduces the bitrate of streamed video through heavier compression of peripheral regions. Remote rendering systems require both rendering and video encoding and the two techniques can be combined to reduce both computing and bandwidth consumption. We report early results from such a combination with remote VR rendering. The results highlight that FR causes large bitrate overhead when combined with normal video encoding but combining it with FVE can mitigate it.

AB - Humans have sharp central vision but low peripheral visual acuity. Prior work has taken advantage of this phenomenon in two ways: foveated rendering (FR) reduces the computational workload of rendering by producing lower visual quality for peripheral regions and foveated video encoding (FVE) reduces the bitrate of streamed video through heavier compression of peripheral regions. Remote rendering systems require both rendering and video encoding and the two techniques can be combined to reduce both computing and bandwidth consumption. We report early results from such a combination with remote VR rendering. The results highlight that FR causes large bitrate overhead when combined with normal video encoding but combining it with FVE can mitigate it.

UR - http://www.scopus.com/inward/record.url?scp=85095842532&partnerID=8YFLogxK

U2 - 10.1145/3385956.3422126

DO - 10.1145/3385956.3422126

M3 - Conference article in proceedings

BT - Proceedings - VRST 2020

A2 - Spencer, Stephen N.

PB - ACM

T2 - ACM Symposium on Virtual Reality Software and Technology

Y2 - 1 November 2020 through 4 November 2020

ER -

On the Interplay of Foveated Rendering and Video Encoding

Abstract

Conference

Access to Document

Other files and links

Fingerprint

Cite this