Computational Representations for Graphical User Interfaces

Yue Jiang*

*Corresponding author for this work

Research output: Contribution to conferenceAbstractScientificpeer-review

3 Citations (Scopus)

Abstract

Graphical User Interfaces (GUIs) have been widely used in daily life. To enhance GUI design and interaction experience on GUIs, it is important to understand GUIs and understand how individuals interact with them. Consequently, my thesis focuses on applying computational approaches to improve our understanding of GUIs and user interactions. First, I introduce novel GUI representations to capture the visual, spatial, and semantic factors of GUIs and improve the performance of downstream GUI tasks. Second, I simulate how users visually engage with GUIs to understand user interactions to help inform the design of GUI representations. Third, based on the understanding of GUIs and interactions on GUIs, I develop language language representations aimed at assisting users in understanding and more effectively interacting with GUIs.

Original languageEnglish
Number of pages6
DOIs
Publication statusPublished - 11 May 2024
MoE publication typeNot Eligible
EventACM SIGCHI Annual Conference on Human Factors in Computing Systems - Honolulu, USA, Honolulu, United States
Duration: 11 May 202416 May 2024
https://chi2024.acm.org/

Conference

ConferenceACM SIGCHI Annual Conference on Human Factors in Computing Systems
Abbreviated titleACM CHI
Country/TerritoryUnited States
CityHonolulu
Period11/05/202416/05/2024
Internet address

Fingerprint

Dive into the research topics of 'Computational Representations for Graphical User Interfaces'. Together they form a unique fingerprint.

Cite this