Projects per year
Abstract
Topic modeling of user interfaces (UIs), also known as layout design categorization, contributes to a better understanding of the UI functionality. Starting from Rico, a large dataset of mobile UIs, we revised a random sample of 10k UIs and concluded to Enrico (shorthand of Enhanced Rico), a human-supervised high-quality dataset comprising 1460 UIs and 20 design topics. As a validation example, we train a deep learning model for three different UI representations (screenshots, wireframes, and embeddings). The screenshot representation provides the highest discriminative power (95% AUC) and a competitive accuracy of 75% (a random classifier achieves 5% accuracy in the same task). We discuss several applications that can be developed with this new public resource, including e.g. semantic UI captioning and tagging, explainable UI designs, smart tutorials, and improved design search capabilities.
Original language | English |
---|---|
DOIs | |
Publication status | Published - 10 May 2020 |
MoE publication type | Not Eligible |
Event | International Conference on Human-Computer Interaction with Mobile Devices and Services - Oldenburg, Germany Duration: 5 Oct 2020 → 9 Oct 2020 Conference number: 22 |
Conference
Conference | International Conference on Human-Computer Interaction with Mobile Devices and Services |
---|---|
Abbreviated title | MobileHCI |
Country/Territory | Germany |
City | Oldenburg |
Period | 05/10/2020 → 09/10/2020 |
Keywords
- Layout classification
- Machine learning
- Neural networks
- User interface design
Fingerprint
Dive into the research topics of 'Enrico: A Dataset for Topic Modeling of Mobile UI Designs'. Together they form a unique fingerprint.Projects
- 1 Active
-
Bayesian Artefact Design
Oulasvirta, A., Dayama, N., Shin, J., Leiva, L., Hegemann, L., Todi, K., Nioche, A., Liao, Y., Peng, Z., Halasinamara Chandramouli, S., Hassinen, H., Laine, M., Putkonen, A., Zong, X. & Zhu, Y.
01/09/2018 → 31/08/2023
Project: Academy of Finland: Other research funding