Stakeholder-dependent views on biases of human- and machine-based judging systems

Elena Mazurova*, Esko Penttinen, Antti Salovaara

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

10 Downloads (Pure)

Abstract

Motivated by recent controversy over biases associated with algorithmic decision-making, we embarked on studying various stakeholders’ perceptions related to potential biases in verdicts from human-based and algorithm-based judging. In an empirical study conducted in the domain of gymnastics judging, we found that, while our informants viewed both human- and AI-based judging systems as being subject to biases (of different types), they were quite welcoming of a shift from human-based judging to machine-based judging. Our findings show that the athletes trusted strongly in unknown, “magic” capabilities of AI, thought to be more objective and impartial. This, in turn, encouraged potential acceptance of new technology. While the gymnasts saw AI-based systems in a positive light, judges demonstrated less favorable perceptions overall and less acceptance of AI technology, expressing concern about possible challenges of AI.
Original languageEnglish
Title of host publicationProceedings of the 54th Hawaii International Conference on System Sciences
Pages6327-6336
Number of pages10
ISBN (Electronic)978-0-9981331-4-0
Publication statusPublished - 2021
MoE publication typeA4 Article in a conference publication
EventAnnual Hawaii International Conference on System Sciences - Maui, United States
Duration: 7 Jan 202010 Jan 2020
Conference number: 53

Conference

ConferenceAnnual Hawaii International Conference on System Sciences
Abbreviated titleHICSS
CountryUnited States
CityMaui
Period07/01/202010/01/2020

Keywords

  • bias
  • case study
  • gymnastics
  • human-based judging
  • machine learning

Fingerprint Dive into the research topics of 'Stakeholder-dependent views on biases of human- and machine-based judging systems'. Together they form a unique fingerprint.

Cite this