Random vs. Structure-Based Testing of Answer-Set Programs: An Experimental Comparison

Tomi Janhunen; Ilkka Niemelä; Johannes Oetsch; Joerg Puehrer; Hans Tompits

doi:10.1007/978-3-642-20895-9_26

Random vs. Structure-Based Testing of Answer-Set Programs: An Experimental Comparison

Tomi Janhunen^*, Ilkka Niemelä, Johannes Oetsch, Joerg Puehrer, Hans Tompits

^*Tämän työn vastaava kirjoittaja

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussa › Conference contribution › Scientific › vertaisarvioitu

10 Sitaatiot (Scopus)

Abstrakti

Answer-set programming (ASP) is an established paradigm for declarative problem solving, yet comparably little work on testing of answer-set programs has been done so far. In a recent paper, foundations for structure-based testing of answer-set programs building on a number of coverage notions have been proposed. In this paper, we develop a framework for testing answer-set programs based on this work and study how good the structure-based approach to test input generation is compared to random test input generation. The results indicate that random testing is quite ineffective for some benchmarks, while structure-based techniques catch faults with a high rate more consistently also in these cases.

Alkuperäiskieli	Englanti
Otsikko	International Conference on Logic Programming and Nonmonotonic Reasoning, LPNMR 2011
Toimittajat	James Delgrande, Wolfgang Faber
Kustantaja	Springer
Sivut	242-247
Sivumäärä	6
ISBN (elektroninen)	978-3-642-20895-9
ISBN (painettu)	978-3-642-20894-2
DOI - pysyväislinkit	https://doi.org/10.1007/978-3-642-20895-9_26
Tila	Julkaistu - 2011
OKM-julkaisutyyppi	A4 Artikkeli konferenssijulkaisuussa
Tapahtuma	International Conference on Logic Programming and Nonmonotonic Reasoning - Vancouver, Kanada Kesto: 16 toukok. 2011 → 19 toukok. 2011 Konferenssinumero: 11

Julkaisusarja

Nimi	Lecture Notes in Computer Science
Kustantaja	SPRINGER-VERLAG BERLIN
Vuosikerta	6645
ISSN (painettu)	0302-9743

Conference

Conference	International Conference on Logic Programming and Nonmonotonic Reasoning
Lyhennettä	LPNMR
Maa/Alue	Kanada
Kaupunki	Vancouver
Ajanjakso	16/05/2011 → 19/05/2011

Pääsy asiakirjaan

10.1007/978-3-642-20895-9_26

OpenUrl-saatavuus

Koko teksti

Muut tiedostot ja linkit

http://link.springer.com/chapter/10.1007/978-3-642-20895-9_26

Siteeraa tätä

Janhunen, T., Niemelä, I., Oetsch, J., Puehrer, J., & Tompits, H. (2011). Random vs. Structure-Based Testing of Answer-Set Programs: An Experimental Comparison. teoksessa J. Delgrande, & W. Faber (Toimittajat), International Conference on Logic Programming and Nonmonotonic Reasoning, LPNMR 2011 (Sivut 242-247). (Lecture Notes in Computer Science; Vuosikerta 6645). Springer. https://doi.org/10.1007/978-3-642-20895-9_26

@inproceedings{716b1ba609af48188790491b288e7f65,

title = "Random vs. Structure-Based Testing of Answer-Set Programs: An Experimental Comparison",

abstract = "Answer-set programming (ASP) is an established paradigm for declarative problem solving, yet comparably little work on testing of answer-set programs has been done so far. In a recent paper, foundations for structure-based testing of answer-set programs building on a number of coverage notions have been proposed. In this paper, we develop a framework for testing answer-set programs based on this work and study how good the structure-based approach to test input generation is compared to random test input generation. The results indicate that random testing is quite ineffective for some benchmarks, while structure-based techniques catch faults with a high rate more consistently also in these cases.",

keywords = "answer-set programming, structure-based testing, random testing, GROUNDER, GRINGO",

author = "Tomi Janhunen and Ilkka Niemel{\"a} and Johannes Oetsch and Joerg Puehrer and Hans Tompits",

note = "VK: mcm hiit; International Conference on Logic Programming and Nonmonotonic Reasoning, LPNMR ; Conference date: 16-05-2011 Through 19-05-2011",

year = "2011",

doi = "10.1007/978-3-642-20895-9_26",

language = "English",

isbn = "978-3-642-20894-2",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "242--247",

editor = "James Delgrande and Wolfgang Faber",

booktitle = "International Conference on Logic Programming and Nonmonotonic Reasoning, LPNMR 2011",

address = "Germany",

}

Janhunen, T , Niemelä, I, Oetsch, J, Puehrer, J & Tompits, H 2011, Random vs. Structure-Based Testing of Answer-Set Programs: An Experimental Comparison. julkaisussa J Delgrande & W Faber (toim), International Conference on Logic Programming and Nonmonotonic Reasoning, LPNMR 2011. Lecture Notes in Computer Science, Vuosikerta 6645, Springer, Sivut 242-247, International Conference on Logic Programming and Nonmonotonic Reasoning, Vancouver, Kanada, 16/05/2011. https://doi.org/10.1007/978-3-642-20895-9_26

Random vs. Structure-Based Testing of Answer-Set Programs: An Experimental Comparison. / Janhunen, Tomi ; Niemelä, Ilkka; Oetsch, Johannes et al.
International Conference on Logic Programming and Nonmonotonic Reasoning, LPNMR 2011. toim. / James Delgrande; Wolfgang Faber. Springer, 2011. s. 242-247 (Lecture Notes in Computer Science; Vuosikerta 6645).

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussa › Conference contribution › Scientific › vertaisarvioitu

TY - GEN

T1 - Random vs. Structure-Based Testing of Answer-Set Programs

T2 - International Conference on Logic Programming and Nonmonotonic Reasoning

AU - Janhunen, Tomi

AU - Niemelä, Ilkka

AU - Oetsch, Johannes

AU - Puehrer, Joerg

AU - Tompits, Hans

N1 - Conference code: 11

PY - 2011

Y1 - 2011

N2 - Answer-set programming (ASP) is an established paradigm for declarative problem solving, yet comparably little work on testing of answer-set programs has been done so far. In a recent paper, foundations for structure-based testing of answer-set programs building on a number of coverage notions have been proposed. In this paper, we develop a framework for testing answer-set programs based on this work and study how good the structure-based approach to test input generation is compared to random test input generation. The results indicate that random testing is quite ineffective for some benchmarks, while structure-based techniques catch faults with a high rate more consistently also in these cases.

AB - Answer-set programming (ASP) is an established paradigm for declarative problem solving, yet comparably little work on testing of answer-set programs has been done so far. In a recent paper, foundations for structure-based testing of answer-set programs building on a number of coverage notions have been proposed. In this paper, we develop a framework for testing answer-set programs based on this work and study how good the structure-based approach to test input generation is compared to random test input generation. The results indicate that random testing is quite ineffective for some benchmarks, while structure-based techniques catch faults with a high rate more consistently also in these cases.

KW - answer-set programming

KW - structure-based testing

KW - random testing

KW - GROUNDER

KW - GRINGO

UR - http://link.springer.com/chapter/10.1007/978-3-642-20895-9_26

U2 - 10.1007/978-3-642-20895-9_26

DO - 10.1007/978-3-642-20895-9_26

M3 - Conference contribution

SN - 978-3-642-20894-2

T3 - Lecture Notes in Computer Science

SP - 242

EP - 247

BT - International Conference on Logic Programming and Nonmonotonic Reasoning, LPNMR 2011

A2 - Delgrande, James

A2 - Faber, Wolfgang

PB - Springer

Y2 - 16 May 2011 through 19 May 2011

ER -

Janhunen T , Niemelä I, Oetsch J, Puehrer J, Tompits H. Random vs. Structure-Based Testing of Answer-Set Programs: An Experimental Comparison. julkaisussa Delgrande J, Faber W, toimittajat, International Conference on Logic Programming and Nonmonotonic Reasoning, LPNMR 2011. Springer. 2011. s. 242-247. (Lecture Notes in Computer Science). doi: 10.1007/978-3-642-20895-9_26

Random vs. Structure-Based Testing of Answer-Set Programs: An Experimental Comparison

Abstrakti

Julkaisusarja

Conference

Pääsy asiakirjaan

OpenUrl-saatavuus

Muut tiedostot ja linkit

Sormenjälki

Siteeraa tätä