Jask: Generation of Questions About Learners' Code in Java

André Santos, Tiago Soares, Nuno Garrido, Teemu Lehtinen

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

5 Citations (Scopus)
143 Downloads (Pure)

Abstract

We present Jask, a system capable of generating questions about a learner's code written in Java. Given Java code as input, Jask provides a set of meaningful questions formulated in terms of the actual code (using its constructs and identifiers) and the corresponding correct answers. We integrated Jask in a web-based system where students submit their code (e.g., from lab exercises), answer questions about it, and obtain immediate formative feedback with the correct answers. An initial study involving 123 distinct introductory programming students providing 2274 answers revealed that questions pertaining to program dynamics tend to register low scores, possibly evidencing fragile comprehension of programming constructs. Participants were surveyed, revealing a positive view towards the usefulness of Jask, especially with respect to consolidating terminology.
Original languageEnglish
Title of host publicationITiCSE '22: Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 1
PublisherACM
Pages117-123
Number of pages7
Volume1
ISBN (Electronic)978-1-4503-9201-3
ISBN (Print)978-1-4503-9201-3
DOIs
Publication statusPublished - 7 Jul 2022
MoE publication typeA4 Conference publication
EventAnnual Conference on Innovation and Technology in Computer Science Education - University College Dublin, Dublin, Ireland
Duration: 8 Jul 202213 Jul 2022
Conference number: 27
https://iticse.acm.org/2022/

Conference

ConferenceAnnual Conference on Innovation and Technology in Computer Science Education
Abbreviated titleITiCSE
Country/TerritoryIreland
CityDublin
Period08/07/202213/07/2022
Internet address

Keywords

  • automatic assessment
  • program comprehension
  • question generation
  • self-explanation

Fingerprint

Dive into the research topics of 'Jask: Generation of Questions About Learners' Code in Java'. Together they form a unique fingerprint.

Cite this