Konferensartikel

Leveraging Task Information in Grammatical Error Correction for Short Answer Assessment through Context-based Reranking

Ramon Ziai

Anna Karnysheva

Ladda ner artikel

Ingår i: Proceedings of the 10th Workshop on Natural Language Processing for Computer Assisted Language Learning (NLP4CALL 2021)

Linköping Electronic Conference Proceedings 177:6, s. 62-68

Visa mer +

Publicerad: 2021-05-21

ISBN: 978-91-7929-625-4

ISSN: 1650-3686 (tryckt), 1650-3740 (online)

Abstract

One of the issues in automatically evaluating learner input in the context of Intelligent Tutoring Systems is learners’ use of incorrect forms and non-standard language. Grammatical Error Correction (GEC) systems have emerged as a way of automatically correcting grammar and spelling mistakes, often by approaching the task as machine translation of individual sentences from non-standard to standard language. However, due to the inherent lack of context awareness, GEC systems often do not produce a contextually appropriate correction. In this paper, we investigate how current neural GEC systems can be optimized for educationally relevant tasks such as Short Answer Assessment. We build on a recent GEC system and train a reranker based on context (e.g. similarity to prompt), task (e.g. type and format) and answer-level (e.g. language modeling) features on a Short Answer Assessment dataset augmented with crowd worker corrections. Results show that our approach successfully gives preference to corrections that are closer to the reference.

Nyckelord

Grammatical Error Correction, Reranking, Short Answer Assessment, Intelligent Tutoring Systems

Referenser

Inga referenser tillgängliga

Citeringar i Crossref