The Effects of Group Discussion and Role-playing Training on Self-efficacy, Support-seeking, and Reporting Phishing Emails: Evidence from a Mixed-design Experiment

Xiaowei Chen; Margault Sacre; Gabriele Lenzini; Samuel Greiff; Verena Distler; Anastasia Sergeeva

doi:10.1145/3613904.3641943

The Effects of Group Discussion and Role-playing Training on Self-efficacy, Support-seeking, and Reporting Phishing Emails: Evidence from a Mixed-design Experiment

Xiaowei Chen, Margault Sacre, Gabriele Lenzini, Samuel Greiff, Verena Distler, Anastasia Sergeeva

Not published at Aalto University

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

3 Citations (Scopus)

Abstract

Organizations rely on phishing interventions to enhance employees' vigilance and safe responses to phishing emails that bypass technical solutions. While various resources are available to counteract phishing, studies emphasize the need for interactive and practical training approaches. To investigate the effectiveness of such an approach, we developed and delivered two anti-phishing trainings, group discussion and role-playing, at a European university. We conducted a pre-registered¹ experiment (N = 105), incorporating repeated measures at three time points, a control group, and three in-situ phishing tests. Both trainings enhanced employees' antiphishing self-efficacy and support-seeking intention in within-group analyses. Only the role-playing training significantly improved support-seeking intention when compared to the control group.

Original language	English
Title of host publication	CHI 2024 - Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems
Publisher	ACM
ISBN (Electronic)	9798400703300
DOIs	https://doi.org/10.1145/3613904.3641943
Publication status	Published - 2024
MoE publication type	A4 Conference publication
Event	ACM SIGCHI Annual Conference on Human Factors in Computing Systems - Honolulu, USA, Honolulu, United States Duration: 11 May 2024 → 16 May 2024 https://chi2024.acm.org/

Conference

Conference	ACM SIGCHI Annual Conference on Human Factors in Computing Systems
Abbreviated title	ACM CHI
Country/Territory	United States
City	Honolulu
Period	11/05/2024 → 16/05/2024
Internet address	https://chi2024.acm.org/

Keywords

Anti-phishing training
Group discussion
Mixed-design experiment
Phishing intervention
Report phishing emails
Role-playing training
Self-efficacy
Support-seeking

Access to Document

10.1145/3613904.3641943Licence: CC BY-NC

Cite this

Chen, X., Sacre, M., Lenzini, G., Greiff, S., Distler, V., & Sergeeva, A. (2024). The Effects of Group Discussion and Role-playing Training on Self-efficacy, Support-seeking, and Reporting Phishing Emails: Evidence from a Mixed-design Experiment. In CHI 2024 - Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems Article 829 ACM. https://doi.org/10.1145/3613904.3641943

@inproceedings{026f715e39454843bd69e16f967bbf67,

title = "The Effects of Group Discussion and Role-playing Training on Self-efficacy, Support-seeking, and Reporting Phishing Emails: Evidence from a Mixed-design Experiment",

abstract = "Organizations rely on phishing interventions to enhance employees' vigilance and safe responses to phishing emails that bypass technical solutions. While various resources are available to counteract phishing, studies emphasize the need for interactive and practical training approaches. To investigate the effectiveness of such an approach, we developed and delivered two anti-phishing trainings, group discussion and role-playing, at a European university. We conducted a pre-registered1 experiment (N = 105), incorporating repeated measures at three time points, a control group, and three in-situ phishing tests. Both trainings enhanced employees' antiphishing self-efficacy and support-seeking intention in within-group analyses. Only the role-playing training significantly improved support-seeking intention when compared to the control group.",

keywords = "Anti-phishing training, Group discussion, Mixed-design experiment, Phishing intervention, Report phishing emails, Role-playing training, Self-efficacy, Support-seeking",

author = "Xiaowei Chen and Margault Sacre and Gabriele Lenzini and Samuel Greiff and Verena Distler and Anastasia Sergeeva",

note = "Publisher Copyright: {\textcopyright} 2024 Copyright held by the owner/author(s); ACM SIGCHI Annual Conference on Human Factors in Computing Systems, ACM CHI ; Conference date: 11-05-2024 Through 16-05-2024",

year = "2024",

doi = "10.1145/3613904.3641943",

language = "English",

booktitle = "CHI 2024 - Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems",

publisher = "ACM",

address = "United States",

url = "https://chi2024.acm.org/",

}

Chen, X, Sacre, M, Lenzini, G, Greiff, S, Distler, V & Sergeeva, A 2024, The Effects of Group Discussion and Role-playing Training on Self-efficacy, Support-seeking, and Reporting Phishing Emails: Evidence from a Mixed-design Experiment. in CHI 2024 - Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems., 829, ACM, ACM SIGCHI Annual Conference on Human Factors in Computing Systems, Honolulu, Hawaii, United States, 11/05/2024. https://doi.org/10.1145/3613904.3641943

The Effects of Group Discussion and Role-playing Training on Self-efficacy, Support-seeking, and Reporting Phishing Emails: Evidence from a Mixed-design Experiment. / Chen, Xiaowei; Sacre, Margault; Lenzini, Gabriele et al.
CHI 2024 - Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems. ACM, 2024. 829.

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

TY - GEN

T1 - The Effects of Group Discussion and Role-playing Training on Self-efficacy, Support-seeking, and Reporting Phishing Emails

T2 - ACM SIGCHI Annual Conference on Human Factors in Computing Systems

AU - Chen, Xiaowei

AU - Sacre, Margault

AU - Lenzini, Gabriele

AU - Greiff, Samuel

AU - Distler, Verena

AU - Sergeeva, Anastasia

PY - 2024

Y1 - 2024

N2 - Organizations rely on phishing interventions to enhance employees' vigilance and safe responses to phishing emails that bypass technical solutions. While various resources are available to counteract phishing, studies emphasize the need for interactive and practical training approaches. To investigate the effectiveness of such an approach, we developed and delivered two anti-phishing trainings, group discussion and role-playing, at a European university. We conducted a pre-registered1 experiment (N = 105), incorporating repeated measures at three time points, a control group, and three in-situ phishing tests. Both trainings enhanced employees' antiphishing self-efficacy and support-seeking intention in within-group analyses. Only the role-playing training significantly improved support-seeking intention when compared to the control group.

AB - Organizations rely on phishing interventions to enhance employees' vigilance and safe responses to phishing emails that bypass technical solutions. While various resources are available to counteract phishing, studies emphasize the need for interactive and practical training approaches. To investigate the effectiveness of such an approach, we developed and delivered two anti-phishing trainings, group discussion and role-playing, at a European university. We conducted a pre-registered1 experiment (N = 105), incorporating repeated measures at three time points, a control group, and three in-situ phishing tests. Both trainings enhanced employees' antiphishing self-efficacy and support-seeking intention in within-group analyses. Only the role-playing training significantly improved support-seeking intention when compared to the control group.

KW - Anti-phishing training

KW - Group discussion

KW - Mixed-design experiment

KW - Phishing intervention

KW - Report phishing emails

KW - Role-playing training

KW - Self-efficacy

KW - Support-seeking

U2 - 10.1145/3613904.3641943

DO - 10.1145/3613904.3641943

M3 - Conference article in proceedings

AN - SCOPUS:85194819053

BT - CHI 2024 - Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

PB - ACM

Y2 - 11 May 2024 through 16 May 2024

ER -

The Effects of Group Discussion and Role-playing Training on Self-efficacy, Support-seeking, and Reporting Phishing Emails: Evidence from a Mixed-design Experiment

Abstract

Conference

Keywords

Access to Document

Fingerprint

Cite this