Computer Science - Computing education research and educational technology (CER) - Research area

Research output

Research output per year 2005 2022 2023 2024 2025

• 115 Conference article in proceedings
• 23 Article
• 9 Chapter
• 8 Abstract
• 15 More
  • 3 Poster
  • 3 Editorial
  • 3 Review Article
  • 1 Commissioned report
  • 1 Foreword / postscript
  • 1 Paper
  • 1 Meeting Abstract
  • 1 Doctoral Thesis
  • 1 Master's thesis

Research output per year

Research output per year

Search results

• 2025

  Clustering students’ text form feedback data: comparison of eight vector space models

  Hämäläinen, W., Rybicki, J.-M., Malmi, L., Jung, A. & Pollari-Malmi, K., 24 Jan 2025, ICBDE '24: Proceedings of the 2024 7th International Conference on Big Data and Education. New York: ACM, p. 57-64 8 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Space Vector 100%
  • Text Clustering 50%
  • Word2vec 25%
  • Presentation Space 25%
  • Stronger Effect 20%
  11 Downloads (Pure)

• Evaluating Language Models for Generating and Judging Programming Feedback

  Koutcheme, C., Dainese, N., Sarsa, S., Hellas, A., Leinonen, J., Ashraf, S. & Denny, P., 18 Feb 2025, SIGCSE TS 2025 - Proceedings of the 56th ACM Technical Symposium on Computer Science Education. ACM, Vol. 1. p. 624-630 7 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Language Modeling 100%
  • Large Language Model 100%
  • Open Source 28%
  1 Downloads (Pure)

• Models of Mastery Learning for Computing Education

  Szabo, C., Parker, M. C., Friend, M., Jeuring, J., Kohn, T., Malmi, L. & Sheard, J., 18 Feb 2025, SIGCSE TS 2025 - Proceedings of the 56th ACM Technical Symposium on Computer Science Education. ACM, Vol. 1. p. 1092-1098 7 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Mastery Learning 100%
  • Learning Model 100%
  • Advanced Course 100%
  • introductory programming course 20%
  3 Downloads (Pure)

• Student Perceptions of Group Formation in Software Engineering Courses

  Fagerholm, F., Chren, S. & Haaranen, L., 2025, (Accepted/In press) Proceedings of the IEEE/ACM 37th International Conference on Software Engineering Education and Training (CSEE&T).

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Group Formation 100%
  • software engineering course 100%
  • Strategy Formation 37%
  • Prior experience 25%
  • Administered Survey 25%
  33 Downloads (Pure)

• The Potential of Serverless Edge-powered Islands for Web Development

  Vepsäläinen, J., Vuorimaa, P. & Hellas, A., 10 Mar 2025, In: Journal of Web Engineering. 24, 1, p. 1-38 38 p., 1.

  Research output: Contribution to journal › Article › Scientific › peer-review

  • Development Work 100%
  • Web Service 100%
  • Distributed Network 100%
  • Content Delivery Network 100%
  • Edge Computing 100%

• Two Approaches for Programming Education in the Domain of Graphics : An Experiment

  Chiodini, L., Sorva, J., Hellas, A., Seppälä, O. & Hauswirth, M., 2025, In: Art, Science, and Engineering of Programming. 10, 1, p. 1-48 48 p., 14.

  Research output: Contribution to journal › Article › Scientific › peer-review

  Open Access

  File

  • Facilitate Transfer 100%
  • Standard Library 100%
  • Power Analysis 100%
  • Conceptual Knowledge 100%
  12 Downloads (Pure)
• 2024

  A comparative analysis of master’s theses in STEM-related disciplines published in Türkiye and Finland

  Oktay, O., Reisoglu, I., Gul, S., Teke, D., Sozbilir, M., Gunes, I., Yildiz, R., Atila, G., Yazar, A., Malmi, L., Kinnunen, P., Lampiselkä, J. & Kaasinen, A., 30 May 2024, (E-pub ahead of print) In: Scandinavian Journal of Educational Research.

  Research output: Contribution to journal › Article › Scientific › peer-review

  Open Access

  • Science, Technology, Engineering and Mathematics 100%
  • Comparative Analysis 100%
  • Finland 100%
  • Scientific Methods 66%
  • Educational Environment 33%

• Advantages of virtual reality childbirth education

  Siivola, M., Leinonen, T. & Malmi, L., 29 Feb 2024, In: Computers & Education: X Reality. 4, 10 p., 100058.

  Research output: Contribution to journal › Article › Scientific › peer-review

  Open Access

  File

  • Virtual Reality 100%
  • Birth 100%
  • Learning Experiences 25%
  • Semistructured Interview 25%
  1 Citation (Scopus)

  23 Downloads (Pure)

• Analyzing Students’ Preferences for LLM-Generated Analogies

  Bernstein, S., Denny, P., Leinonen, J., Littlefield, M., Hellas, A. & MacNeil, S., 8 Jul 2024, p. 812. 1 p.

  Research output: Contribution to conference › Poster › Scientific › peer-review

  • Large Language Model 100%
  • Computer Science 66%
  • Conceptual Understanding 33%
  • ChatGPT 33%
  1 Citation (Scopus)

• Computing Education in the Era of Generative AI

  Denny, P., Prather, J., Becker, B. A., Finnie-Ansley, J., Hellas, A., Leinonen, J., Luxton-Reilly, A., Reeves, B. N., Santos, E. A. & Sarsa, S., 25 Jan 2024, In: Communications of the ACM. 67, 2, p. 56-67 12 p.

  Research output: Contribution to journal › Article › Scientific › peer-review

  Open Access

  File

  • Computing 100%
  • Generative Artificial Intelligence 100%
  • Natural Languages 50%
  • Source Codes 50%
  • Large Language Model 50%
  76 Citations (Scopus)

  101 Downloads (Pure)

• Decades of Striving for Pedagogical and Technological Alignment

  Haaranen, L., Ahrenberg, L. & Hellas, A., 6 Feb 2024, Proceedings of 23rd International Conference on Computing Education Research, Koli Calling 2023. ACM, 3631809

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Computing 100%
  • Algorithms 33%
  • Interoperability 33%
  • Best Practice 33%
  • Learning Management System 33%
  19 Downloads (Pure)

• Decoding Logic Errors: A Comparative Study on Bug Detection by Students and Large Language Models

  MacNeil, S., Denny, P., Tran, A., Leinonen, J., Bernstein, S., Hellas, A., Sarsa, S. & Kim, J., 29 Jan 2024, ACE 2024 - Proceedings of the 26th Australasian Computing Education Conference, Held in conjunction with: Australasian Computer Science Week. ACM, p. 11-18 8 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Detection 100%
  • Large Language Model 100%
  • Computing 37%
  • Identification 12%
  • Compiler 12%
  11 Citations (Scopus)

  28 Downloads (Pure)

• Domain-Specific Theories of Teaching Computing: Do they Inform Practice?

  Malmi, L., Sheard, J., Sinclair, J., Kinnunen, P. & Simon, 6 Feb 2024, Koli Calling '23: Proceedings of the 23rd Koli Calling International Conference on Computing Education Research. ACM, 17

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Paper 100%
  • Education Research 100%
  • Computing 100%
  • Theory 85%
  • Attention 50%
  1 Citation (Scopus)

  27 Downloads (Pure)

• Empirical Evaluation of a Differentiated Assessment of Data Structures: The Role of Prerequisite Skills

  Begum, M., Haglund, P., Korhonen, A., Lonati, V., Monga, M., Strömbäck, F. & Tilanterä, A., 15 Mar 2024, In: Informatics in Education. 23, 1, p. 57–99 43 p.

  Research output: Contribution to journal › Article › Scientific › peer-review

  Open Access

  File

  • Structure 100%
  • Evaluation Study 100%
  • Occupational Qualification 100%
  • Devices 100%
  • Empirical 100%
  23 Downloads (Pure)

• Evaluating Contextually Personalized Programming Exercises Created with Generative AI

  Logacheva, E., Hellas, A., Prather, J., Sarsa, S. & Leinonen, J., 12 Aug 2024, ICER '24: Proceedings of the 2024 ACM Conference on International Computing Education Research. Denny, P., Porter, L., Hamilton, M. & Morrison, B. (eds.). New York, NY, United States: ACM, Vol. 1. p. 95-113 19 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Artificial Intelligence 100%
  • Generative Pre-Trained Transformer 4 100%
  • Computer Science 50%
  • Consumers 50%
  • Educational Psychology 50%
  3 Citations (Scopus)

  45 Downloads (Pure)

• Experiences from Integrating Large Language Model Chatbots into the Classroom

  Hellas, A., Leinonen, J. & Leppänen, L., 5 Dec 2024, SIGCSE Virtual 2024: Proceedings of the 2024 on ACM Virtual Global Computing Education Conference V. 1. New York, NY, USA: ACM, Vol. 1. p. 46–52 (SIGCSE Virtual 2024).

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Chatbot 100%
  • Large Language Model 100%
  • Generative Pre-Trained Transformer 4 18%
  • Use Case 9%
  • Software Engineering 9%
  12 Downloads (Pure)

• Flipping Childbirth Education

  Siivola, M. & Malmi, L., 1 Jul 2024, In: Journal of Perinatal Education. 33, 3, p. 127-147 21 p.

  Research output: Contribution to journal › Article › Scientific › peer-review

  • Electronic Learning 100%
  • Pilot Study 100%
  • Thematic Analysis 100%
  • Time Management 100%
  • Informal Learning 100%

• From Sparse to Smart: Leveraging AI for Effective Online Judge Problem Classification in Programming Education

  Pereira, F. D., Moraes, M., Henklain, M., Hellas, A., Oliveira, E., Gasevic, D., Barreto, R. & Mello, R., 2024, Technology Enhanced Learning for Inclusive and Equitable Quality Education - 19th European Conference on Technology Enhanced Learning, EC-TEL 2024, Proceedings. Ferreira Mello, R., Rummel, N., Jivet, I., Pishtari, G. & Ruipérez Valiente, J. A. (eds.). Springer, p. 359-374 16 p. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); vol. 15159 LNCS).

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  • Annotation 100%
  • Active Learning 100%
  • Classification Problem 100%
  • Artificial Intelligence 100%
  • Deep Learning Method 100%

• Instructor Perceptions of AI Code Generation Tools - A Multi-Institutional Interview Study

  Sheard, J., Denny, P., Hellas, A., Leinonen, J., Malmi, L. & Simon, 7 Mar 2024, SIGCSE 2024 - Proceedings of the 55th ACM Technical Symposium on Computer Science Education. ACM, p. 1223-1229 7 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Artificial Intelligence 100%
  • Interview Study 100%
  • Code Generation 100%
  • Instructor 100%
  • Computing 33%
  14 Citations (Scopus)

  25 Downloads (Pure)

• Let's Ask AI About Their Programs : Exploring ChatGPT's Answers To Program Comprehension Questions

  Lehtinen, T., Koutcheme, C. & Hellas, A., 24 May 2024, Proceedings of the 46th International Conference on Software Engineering: Software Engineering Education and Training. ACM, p. 221-232 12 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Programs 100%
  • Artificial Intelligence 100%
  • Program Comprehension 100%
  • ChatGPT 100%
  • Large Language Model 100%
  1 Citation (Scopus)

  30 Downloads (Pure)

• "Like a Nesting Doll" : Analyzing Recursion Analogies Generated by CS Students Using Large Language Models

  Bernstein, S., Denny, P., Leinonen, J., Kan, L., Hellas, A., Littlefield, M., Sarsa, S. & Macneil, S., 3 Jul 2024, ITiCSE 2024 - Proceedings of the 2024 Conference Innovation and Technology in Computer Science Education. ACM, p. 122-128 7 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Large Language Model 100%
  • Grasping 100%
  • ChatGPT 66%
  3 Citations (Scopus)

  27 Downloads (Pure)

• Midwives’ account of virtual reality childbirth education

  Siivola, M. & Malmi, L., 14 Oct 2024, In: Finnish Journal of eHealth and eWelfare . 16, 3, p. 362-376 15 p.

  Research output: Contribution to journal › Article › Scientific › peer-review

  Open Access

  File

  • Virtual Reality 100%
  • Health Care Personnel 20%
  • Hospital 10%
  • Content Analysis 10%
  • Ward 10%
  34 Downloads (Pure)

• Open Source Language Models Can Provide Feedback : Evaluating LLMs' Ability to Help Students Using GPT-4-As-A-Judge

  Koutcheme, C., Dainese, N., Sarsa, S., Hellas, A., Leinonen, J. & Denny, P., 3 Jul 2024, ITiCSE 2024 - Proceedings of the 2024 Conference Innovation and Technology in Computer Science Education. ACM, p. 52-58 7 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Language Modeling 100%
  • Open Source 100%
  • Source Language 100%
  • Large Language Model 100%
  • Generative Pre-Trained Transformer 4 100%
  7 Citations (Scopus)

  45 Downloads (Pure)

• Propagating Large Language Models Programming Feedback

  Koutcheme, C. & Hellas, A., 9 Jul 2024, L@S 2024 - Proceedings of the 11th ACM Conference on Learning @ Scale. ACM, p. 366-370 5 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Feedback Mechanism 100%
  • Presenting Problem 100%
  • Financial Concern 100%
  1 Citation (Scopus)

  14 Downloads (Pure)

• Solving Proof Block Problems Using Large Language Models

  Poulsen, S., Sarsa, S., Prather, J., Leinonen, J., Becker, B. A., Hellas, A., Denny, P. & Reeves, B. N., 7 Mar 2024, SIGCSE 2024 - Proceedings of the 55th ACM Technical Symposium on Computer Science Education. ACM, p. 1063-1069 7 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Mathematical Proof 100%
  • Large Language Model 100%
  • Algorithm 50%
  • Open Question 50%
  • Current Model 50%
  7 Citations (Scopus)

  24 Downloads (Pure)

• Students Struggle with Concepts in Dijkstra's Algorithm

  Tilanterä, A., Sorva, J., Seppälä, O. & Korhonen, A., 13 Aug 2024, ICER '24: Proceedings of the 2024 ACM Conference on International Computing Education Research - Volume 1. ACM, p. 154-165 12 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Dynamic Programming 100%
  • Related Concept 50%
  • Identify Usability Issue 50%
  2 Citations (Scopus)

  51 Downloads (Pure)

• Synthetic Students : A Comparative Study of Bug Distribution Between Large Language Models and Computing Students

  MacNeil, S., Rogalska, M., Leinonen, J., Denny, P., Hellas, A. & Crosland, X., 5 Dec 2024, SIGCSE Virtual 2024: Proceedings of the 2024 on ACM Virtual Global Computing Education Conference V. 1. New York, NY, USA: ACM, p. 137–143

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Comparative Study 100%
  • Large Language Model 100%
  • Student Behavior 16%
  • Research Paper 16%
  • User Data 16%
  6 Downloads (Pure)

• Trends in STEM Education Research in Europe in 2005-2019

  Lampiselkä, J., Kaasinen, A., Kinnunen, P. & Malmi, L., 12 Nov 2024, 13th Panhellenic Conference on Teaching of Natural Sciences and New Technologies in Education: 13ο Πανελλήνιο Συνέδριο Διδακτικής των Φυσικών Επιστημών και Νέων Τεχνολογιών στην Εκπαίδευση: ΠΡΑΚΤΙΚΑ . ePublishing, p. xxiv-xxxiii (Panhellenic conference on didactics in science and new technology in education).

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific

  Open Access

  • STEM Education 100%
  • Teachers' Characteristics 50%
  • Understanding of Science 50%

• Understanding Pathways to Computing Education Research (CER)

  Sanders, K., Hellas, A. & Malmi, L., 6 Feb 2024. 2 p.

  Research output: Contribution to conference › Poster › Scientific › peer-review

  • Students 100%
  • Understanding 100%
  • Education Research 100%
  • Computing 100%
  • Research 33%

• Using Program Repair as a Proxy for Language Models’ Feedback Ability in Programming Education

  Koutcheme, C., Dainese, N. & Hellas, A., Jun 2024, Proceedings of the 19th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2024). Kochmar, E., Bexte, M., Burstein, J., Horbach, A., Laarmann-Quante, R., Tack, A., Yaneva, V. & Yuang, Z. (eds.). Association for Computational Linguistics, p. 165–181

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Language Modeling 100%
  • Large Language Model 100%
  • Benchmarking 16%
  • Open Source 16%
  30 Downloads (Pure)

• Why students fail to revise? Analysis of written metalinguistic feedback and cognitive effort on revision success

  Rybicki, J. M., Hämäläinen, W., Pitkänen, K. K. & Malmi, L., Dec 2024, In: Ampersand. 13, p. 1-12 12 p., 100211.

  Research output: Contribution to journal › Article › Scientific › peer-review

  Open Access

  File

  • Cognitive Effort 100%
  • Metalinguistic 100%
  • Academic Learning 100%
  • Engineering Student 50%
  26 Downloads (Pure)

• You can learn well regardless of your motivation type – Evidence from a virtual learning environment

  Pesonen, H., Leikas, S. & Malmi, L., Nov 2024, In: Learning and Motivation. 88, p. 1-15 15 p., 102069.

  Research output: Contribution to journal › Article › Scientific › peer-review

  Open Access

  File

  • Virtual Learning Environment 100%
  • Self-Determination Theory 100%
  • Academic Performance 75%
  • Intrinsic Motivation 50%
  • Autonomous Motivation 50%
  1 Citation (Scopus)

  39 Downloads (Pure)
• 2023

  Arguments for and Approaches to Computing Education in Undergraduate Computer Science Programmes

  Cutts, Q., Kallia, M., Anderson, R., Crick, T., Devlin, M., Farghally, M., Mirolo, C., Runde, R. K., Seppälä, O., Urquiza-Fuentes, J. & Vahrenhold, J., 22 Dec 2023, ITiCSE-WGR 2023 - Proceedings of the 2023 Working Group Reports on Innovation and Technology in Computer Science Education. ACM, p. 160-195 36 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  • Education 100%
  • Computer Science 100%
  • Undergraduates 100%
  • Computing 100%
  • Under-graduate 100%
  1 Citation (Scopus)

• A Selective Review of Computing Education Research

  Malmi, L. & Johri, A., 2023, International Handbook of Engineering Education Research . Johri, A. (ed.). Routledge, p. 573-593 21 p.

  Research output: Chapter in Book/Report/Conference proceeding › Chapter › Scientific › peer-review

  Open Access

  File

  • Education 100%
  • Research 100%
  • Computing 100%
  • Engineering Education 33%
  • Area 20%
  46 Downloads (Pure)

• Automated Program Repair Using Generative Models for Code Infilling

  Koutcheme, C., Sarsa, S., Leinonen, J., Hellas, A. & Denny, P., 2023, Artificial Intelligence in Education : 24th International Conference, AIED 2023, Tokyo, Japan, July 3–7, 2023, Proceedings. Wang, N., Rebolledo-Mendez, G., Matsuda, N., Santos, O. C. & Dimitrova, V. (eds.). Springer, p. 798–803 (Lecture Notes in Computer Science ; vol. 13916).

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Programs 100%
  • Generative Model 100%
  • Language Modeling 50%
  • Education 25%
  • Models 25%
  9 Citations (Scopus)

  24 Downloads (Pure)

• Automated Questionnaires About Students’ JavaScript Programs: Towards Gauging Novice Programming Processes

  Lehtinen, T., Haaranen, L. & Leinonen, J., 30 Jan 2023, Proceedings of the 25th Australasian Computing Education Conference. Denny, P. & Herbert, N. (eds.). ACM, p. 49-58 10 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Students 100%
  • Process 100%
  • Questionnaires 100%
  • Programming 100%
  • Novice 100%
  12 Citations (Scopus)

  100 Downloads (Pure)

• Automated Questions about Learners' Own Code Help to Detect Fragile Prerequisite Knowledge

  Lehtinen, T., Seppälä, O. & Korhonen, A., 29 Jun 2023, ITiCSE 2023 - Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education. ACM, p. 505-511 7 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • programming course 100%
  • Logic Programming 50%
  4 Citations (Scopus)

  46 Downloads (Pure)

• Comparing Code Explanations Created by Students and Large Language Models

  Leinonen, J., Denny, P., Macneil, S., Sarsa, S., Bernstein, S., Kim, J., Tran, A. & Hellas, A., 29 Jun 2023, ITiCSE 2023 - Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education. ACM, p. 124-130 7 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Large Language Model 100%
  • Education 40%
  • Computing 20%
  • Models 20%
  • Emergence 20%
  79 Citations (Scopus)

  49 Downloads (Pure)

• Computing Education Research in Finland

  Malmi, L., Hellas, A., Ihantola, P., Isomöttönen, V., Jormanainen, I., Kilamo, T., Knutas, A., Korhonen, A., Laakso, M.-J., López-Pernas, S., Poranen, T., Salakoski, T. & Suhonen, J., 2023, Past, Present and Future of Computing Education Research : A Global Perspective. Apiola, M., López-Pernas, S. & Saqr, M. (eds.). Cham: Springer, p. 335-372 38 p.

  Research output: Chapter in Book/Report/Conference proceeding › Chapter › Scientific › peer-review

  Open Access

  File

  • Education 100%
  • Computing 100%
  • Development 100%
  • Running 100%
  • Roles 16%
  53 Downloads (Pure)

• Considering Computing Education in Undergraduate Computer Science Programmes

  Cutts, Q., Kallia, M., Anderson, R., Crick, T., Devlin, M., Farghally, M., Mirolo, C., Runde, R. K., Seppälä, O., Urquiza-Fuentes, J. & Vahrenhold, J., 29 Jun 2023, ITiCSE 2023 - Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education. ACM, p. 567-568 2 p. (Annual Conference on Innovation and Technology in Computer Science Education, ITiCSE; vol. 2).

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific

  • Education 100%
  • Computer Science 100%
  • Undergraduates 100%
  • Adoption 66%
  • Administrative Structure 33%
  4 Citations (Scopus)

• Development and Use of Domain-Specific Learning Theories, Models and Instruments in Computing Education

  Malmi, L., Sheard, J., Kinnunen, P., Simon & Sinclair, J., 2023, In: ACM Transactions on Computing Education. 23, 1, 47 p., 6.

  Research output: Contribution to journal › Article › Scientific › peer-review

  Open Access

  File

  • Education 100%
  • Computing 100%
  • Models 100%
  • Domains 100%
  • Theoretical Construct 100%
  16 Citations (Scopus)

  103 Downloads (Pure)

• Editorial for the Second Special Issue on “Conceptualizing and Using Theory in Computing Education Research”

  Malmi, L. & Tenenberg, J., 2023, In: ACM Transactions on Computing Education. 23, 1, 4 p., 1.

  Research output: Contribution to journal › Editorial › Scientific

  Open Access

  • Theory 100%
  • Education 100%
  • Computing 100%
  • Education Research 100%
  • Paper 33%
  1 Citation (Scopus)

• Evaluating Distance Measures for Program Repair

  Koutcheme, C., Sarsa, S., Leinonen, J., Haaranen, L. & Hellas, A., 10 Sept 2023, ICER '23: Proceedings of the 2023 ACM Conference on International Computing Education Research - Volume 1. ACM, p. 495–507

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Programs 100%
  • Distance Measure 100%
  • Evaluation 71%
  • Natural Language Processing 71%
  • Education 42%
  1 Citation (Scopus)

  39 Downloads (Pure)

• Evaluating the Performance of Code Generation Models for Solving Parsons Problems with Small Prompt Variations

  Reeves, B., Sarsa, S., Prather, J., Denny, P., Becker, B. A., Hellas, A., Kimmel, B., Powell, G. & Leinonen, J., 29 Jun 2023, ITiCSE 2023 - Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education. ACM, p. 299-305 7 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Models 100%
  • Code Generation 100%
  • Generation Model 100%
  • Education 66%
  • Computing 66%
  39 Citations (Scopus)

  54 Downloads (Pure)

• Experiences from Learnersourcing SQL Exercises: Do They Cover Course Topics and Do Students Use Them?

  Pirttinen, N., Hellas, A. & Leinonen, J., 30 Jan 2023, ACE 2023 - Proceedings of the 25th Australasian Computing Education Conference, Held in conjunction with Australasian Computer Science Week. ACM, p. 123-131 9 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Students 100%
  • Experience 100%
  • Structured Query Language 100%
  • Content 50%
  • Teaching 33%
  2 Citations (Scopus)

  33 Downloads (Pure)

• Experiences from Using Code Explanations Generated by Large Language Models in a Web Software Development E-Book

  Macneil, S., Tran, A., Hellas, A., Kim, J., Sarsa, S., Denny, P., Bernstein, S. & Leinonen, J., 2 Mar 2023, SIGCSE 2023 - Proceedings of the 54th ACM Technical Symposium on Computer Science Education. ACM, p. 931-937 7 p.

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Software Development 100%
  • Large Language Model 100%
  • Utilities 25%
  • Complexity 25%
  • Student Engagement 25%
  119 Citations (Scopus)

  31 Downloads (Pure)

• Exploring the Interplay of Achievement Goals, Self-Efficacy, Prior Experience and Course Achievement

  Pesonen, H., Leinonen, J., Haaranen, L. & Hellas, A., 25 Sept 2023, UKICER '23: Proceedings of the 2023 Conference on United Kingdom & Ireland Computing Education Research. Astarte, T., Moller, F., Quille, K. & Russell, S. (eds.). ACM, 1 p. 9

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Achievement 100%
  • Goals 100%
  • Self-Efficacy 100%
  • Goal Orientation 28%
  3 Citations (Scopus)

  32 Downloads (Pure)

• Exploring the Past, Present and Future of Computing Education Research: An Introduction

  Apiola, M., López-Pernas, S., Saqr, M., Malmi, L. & Daniels, M., 5 Jan 2023, Past, Present and Future of Computing Education Research : A Global Perspective. Apiola, M., López-Pernas, S. & Saqr, M. (eds.). Cham: Springer, p. 1-7 7 p.

  Research output: Chapter in Book/Report/Conference proceeding › Foreword / postscript

  Open Access

  File

  • Education 100%
  • Computing 100%
  • Case Study 25%
  • Current-State 25%
  • Global Perspective 25%
  5 Downloads (Pure)

• Exploring the Responses of Large Language Models to Beginner Programmers’ Help Requests

  Hellas, A., Leinonen, J., Sarsa, S., Koutcheme, C., Kujanpää, L. & Sorva, J., 10 Sept 2023, ICER '23: Proceedings of the 2023 ACM Conference on International Computing Education Research - Volume 1. ACM, p. 93–105

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Language 100%
  • Model 100%
  • beginners 100%
  • Requests 100%
  • Language Modeling 100%
  59 Citations (Scopus)

  72 Downloads (Pure)

• Factors Affecting Compilable State at Each Keystroke in CS1

  Scott, S., Hellas, A., Leinonen, J. & Edwards, J., 2023, 2023 IEEE/ACM 45th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET), 14-20 May 2023Engineering Education And Training, Icse-seet. IEEE, p. 314-323 10 p. (IEEE/ACM International Conference on Software Engineering: Software Engineering Education and Training).

  Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

  Open Access

  File

  • Program Outcome 100%
  • introductory programming course 100%
  • Academic Outcome 100%
  43 Downloads (Pure)