Experiences from Using Code Explanations Generated by Large Language Models in a Web Software Development E-Book

Stephen Macneil, Andrew Tran, Arto Hellas, Joanne Kim, Sami Sarsa, Paul Denny, Seth Bernstein, Juho Leinonen

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference article in proceedingsScientificvertaisarvioitu

53 Sitaatiot (Scopus)
27 Lataukset (Pure)

Abstrakti

Advances in natural language processing have resulted in large language models (LLMs) that can generate code and code explanations. In this paper, we report on our experiences generating multiple code explanation types using LLMs and integrating them into an interactive e-book on web software development. Three different types of explanations - a line-by-line explanation, a list of important concepts, and a high-level summary of the code - were created. Students could view explanations by clicking a button next to code snippets, which showed the explanation and asked about its utility. Our results show that all explanation types were viewed by students and that the majority of students perceived the code explanations as helpful to them. However, student engagement varied by code snippet complexity, explanation type, and code snippet length. Drawing on our experiences, we discuss future directions for integrating explanations generated by LLMs into CS classrooms.

AlkuperäiskieliEnglanti
OtsikkoSIGCSE 2023 - Proceedings of the 54th ACM Technical Symposium on Computer Science Education
KustantajaACM
Sivut931-937
Sivumäärä7
ISBN (elektroninen)978-1-4503-9431-4
DOI - pysyväislinkit
TilaJulkaistu - 2 maalisk. 2023
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisussa
TapahtumaACM Technical Symposium on Computer Science Education - Toronto, Kanada
Kesto: 15 maalisk. 202318 maalisk. 2023
Konferenssinumero: 54

Conference

ConferenceACM Technical Symposium on Computer Science Education
LyhennettäSIGCSE
Maa/AlueKanada
KaupunkiToronto
Ajanjakso15/03/202318/03/2023

Sormenjälki

Sukella tutkimusaiheisiin 'Experiences from Using Code Explanations Generated by Large Language Models in a Web Software Development E-Book'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä