Type of Publication: Article in Collected Edition

Evaluating Responses in Source Code Highlighting Tasks - Preliminary Considerations for Automatic Assessment

Author(s):

Kramer, M.; Barkmin, M.; Brinda, T.

Editor:

Mühling, A.; Cutts, Q.; Schwill, A.

Title of Anthology:

Proceedings of the 13th Workshop in Primary and Secondary Computing Education (WIPSCE 2018), Potsdam, Germany, 4.-6. Oktober 2018

pages:

1-4

Publisher:

ACM Press

Location(s):

New York

Publication Date:

2018

ISBN:

978-1-4503-6588-8

Language:

English

Keywords:

Object-Oriented Programming, Highlighting, Assessment

Digital Object Identifier (DOI):

doi:10.1145/3265757.3265775

Link to complete version:

https://www.ddi.wiwi.uni-due.de/forschung/publikationen/acm/#kramer-barkmin-brinda-2018

Citation:

Download BibTeX

Abstract

The reading and understanding of source code is a necessary prerequisite for prospective programmers to write their own code. Thus, a reasonable task is to determine certain concepts like class identifiers in a given source code. In order to automatically evaluate the responses, they must be quantified. Hence, it is vital to have reliable and valid methods of measurement. In this paper we apply different means of measurement on constructed examples and compare them. Cohen's κ seems to be an adequate measure.