Combinatorial Optimization of Graphical User Interface Designs

Antti Oulasvirta, N. R. Dayama, M. Shiripour, M. John, A. Karrenbauer

Research output: Contribution to journalArticleScientificpeer-review

2 Citations (Scopus)
83 Downloads (Pure)

Abstract

The graphical user interface (GUI) has become the prime means for interacting with computing systems. It leverages human perceptual and motor capabilities for elementary tasks such as command exploration and invocation, information search, and multitasking. For designing a GUI, numerous interconnected decisions must be made such that the outcome strikes a balance between human factors and technical objectives. Normally, design choices are specified manually and coded within the software by professional designers and developers. This article surveys combinatorial optimization as a flexible and powerful tool for computational generation and adaptation of GUIs. As recently as 15 years ago, applications were limited to keyboards and widget layouts. The obstacle has been the mathematical definition of design tasks, on the one hand, and the lack of objective functions that capture essential aspects of human behavior, on the other. This article presents definitions of layout design problems as integer programming tasks, a coherent formalism that permits identification of problem types, analysis of their complexity, and exploitation of known algorithmic solutions. It then surveys advances in formulating evaluative functions for common design-goal foci such as user performance and experience. The convergence of these two advances has expanded the range of solvable problems. Approaches to practical deployment are outlined with a wide spectrum of applications. This article concludes by discussing the position of this application area within optimization and human-computer interaction research and outlines challenges for future work.
Original languageEnglish
Article number9000519
Pages (from-to)434-464
Number of pages31
JournalProceedings of the IEEE
Volume108
Issue number3
Early online date17 Feb 2020
DOIs
Publication statusPublished - Mar 2020
MoE publication typeA1 Journal article-refereed

Keywords

  • Combinatorial optimization
  • computational design
  • graphical user interfaces (GUIs)
  • human-computer interaction (HCI)
  • integer programming
  • interactive optimization
  • meta-heuristic optimization.

Fingerprint Dive into the research topics of 'Combinatorial Optimization of Graphical User Interface Designs'. Together they form a unique fingerprint.

  • Projects

    Human Automata: Simulator-based Methods for Collaborative AI

    Oulasvirta, A., Kylmälä, H. & Santala, S.

    01/01/202031/12/2022

    Project: Academy of Finland: Other research funding

    COMPUTED: Computational User Interface Design

    Oulasvirta, A., Kim, S., Dayama, N., Shiripour, M., Todi, K., Liao, Y., Koch, J., Nioche, A., Feit, A., Bruckner, L. & Leiva, L.

    27/03/201531/08/2020

    Project: EU: ERC grants

    Cite this