Modeling language learning using specialized Elo ratings

Jue Hou; Maximilian Koppatz; Jose María Hoya Quecedo; Nataliya Stoyanova; Mikhail Kopotev; Roman Yangarber

Modeling language learning using specialized Elo ratings

Jue Hou, Maximilian Koppatz, Jose María Hoya Quecedo, Nataliya Stoyanova, Mikhail Kopotev, Roman Yangarber

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

Abstract

Automatic assessment of the proficiency levels of the learner is a critical part of Intelligent Tutoring Systems. We present methods for assessment in the context of language learning. We use a specialized Elo formula used in conjunction with educational data mining. We simultaneously obtain ratings for the proficiency of the learners and for the difficulty of the linguistic concepts that the learners are trying to master. From the same data we also learn a graph structure representing a domain model capturing the relations among the concepts. This application of Elo provides ratings for learners and concepts which correlate well with subjective proficiency levels of the learners and difficulty levels of the concepts.

Original language	English
Title of host publication	Innovative Use of NLP for Building Educational Applications : Proceedings of the 14th Workshop
Editors	Helen Yannakoudakis, Ekaterina Kochmar, Claudia Leacock, Nitin Madnani, Ildikó Pilán, Torsten Zesch
Number of pages	13
Place of Publication	Stroudsburg
Publisher	The Association for Computational Linguistics
Publication date	Aug 2019
Pages	494-506
ISBN (Electronic)	978-1-950737-34-5
Publication status	Published - Aug 2019
MoE publication type	A4 Article in conference proceedings
Event	Workshop on Innovative Use of NLP for Building Educational Applications - Florence, Italy Duration: 2 Aug 2019 → 2 Aug 2019 Conference number: 14

Fields of Science

113 Computer and information sciences
516 Educational sciences
6121 Languages

Access to Document

W19-4451Final published version, 1.35 MBLicence: CC BY

https://www.aclweb.org/anthology/W19-4451Licence: CC BY

LLL: Language Learning Lab
Yangarber, R., Katinskaia, A., Hou, J., Furlan, G. & Kylliäinen, I. P.
Project: Research project
Revita: Language learning and AI
Yangarber, R., Katinskaia, A., Hou, J., Furlan, G. & Kylliäinen, I. P.
Project: Research project

Cite this

Hou, J., Koppatz, M., Hoya Quecedo, J. M., Stoyanova, N., Kopotev, M., & Yangarber, R. (2019). Modeling language learning using specialized Elo ratings. In H. Yannakoudakis, E. Kochmar, C. Leacock, N. Madnani, I. Pilán, & T. Zesch (Eds.), Innovative Use of NLP for Building Educational Applications: Proceedings of the 14th Workshop (pp. 494-506). The Association for Computational Linguistics. https://www.aclweb.org/anthology/W19-4451

Hou, Jue ; Koppatz, Maximilian ; Hoya Quecedo, Jose María et al. / Modeling language learning using specialized Elo ratings. Innovative Use of NLP for Building Educational Applications: Proceedings of the 14th Workshop. editor / Helen Yannakoudakis ; Ekaterina Kochmar ; Claudia Leacock ; Nitin Madnani ; Ildikó Pilán ; Torsten Zesch. Stroudsburg : The Association for Computational Linguistics, 2019. pp. 494-506

@inproceedings{52dc7c909e77493fa9f21dcee2ec512e,

title = "Modeling language learning using specialized Elo ratings",

abstract = "Automatic assessment of the proficiency levels of the learner is a critical part of Intelligent Tutoring Systems. We present methods for assessment in the context of language learning. We use a specialized Elo formula used in conjunction with educational data mining. We simultaneously obtain ratings for the proficiency of the learners and for the difficulty of the linguistic concepts that the learners are trying to master. From the same data we also learn a graph structure representing a domain model capturing the relations among the concepts. This application of Elo provides ratings for learners and concepts which correlate well with subjective proficiency levels of the learners and difficulty levels of the concepts.",

keywords = "113 Computer and information sciences, 516 Educational sciences, 6121 Languages",

author = "Jue Hou and Maximilian Koppatz and {Hoya Quecedo}, {Jose Mar{\'i}a} and Nataliya Stoyanova and Mikhail Kopotev and Roman Yangarber",

year = "2019",

month = aug,

language = "English",

pages = "494--506",

editor = "Yannakoudakis, {Helen } and Kochmar, {Ekaterina } and Leacock, {Claudia } and Madnani, {Nitin } and Pil{\'a}n, {Ildik{\'o} } and Torsten Zesch",

booktitle = "Innovative Use of NLP for Building Educational Applications",

publisher = "The Association for Computational Linguistics",

address = "United States",

note = "Workshop on Innovative Use of NLP for Building Educational Applications ; Conference date: 02-08-2019 Through 02-08-2019",

}

Hou, J, Koppatz, M, Hoya Quecedo, JM, Stoyanova, N, Kopotev, M & Yangarber, R 2019, Modeling language learning using specialized Elo ratings. in H Yannakoudakis, E Kochmar, C Leacock, N Madnani, I Pilán & T Zesch (eds), Innovative Use of NLP for Building Educational Applications: Proceedings of the 14th Workshop. The Association for Computational Linguistics, Stroudsburg, pp. 494-506, Workshop on Innovative Use of NLP for Building Educational Applications , Italy, 02/08/2019. <https://www.aclweb.org/anthology/W19-4451>

Modeling language learning using specialized Elo ratings. / Hou, Jue; Koppatz, Maximilian; Hoya Quecedo, Jose María et al.

Innovative Use of NLP for Building Educational Applications: Proceedings of the 14th Workshop. ed. / Helen Yannakoudakis; Ekaterina Kochmar; Claudia Leacock; Nitin Madnani; Ildikó Pilán; Torsten Zesch. Stroudsburg : The Association for Computational Linguistics, 2019. p. 494-506.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

TY - GEN

T1 - Modeling language learning using specialized Elo ratings

AU - Hou, Jue

AU - Koppatz, Maximilian

AU - Hoya Quecedo, Jose María

AU - Stoyanova, Nataliya

AU - Kopotev, Mikhail

AU - Yangarber, Roman

N1 - Conference code: 14

PY - 2019/8

Y1 - 2019/8

N2 - Automatic assessment of the proficiency levels of the learner is a critical part of Intelligent Tutoring Systems. We present methods for assessment in the context of language learning. We use a specialized Elo formula used in conjunction with educational data mining. We simultaneously obtain ratings for the proficiency of the learners and for the difficulty of the linguistic concepts that the learners are trying to master. From the same data we also learn a graph structure representing a domain model capturing the relations among the concepts. This application of Elo provides ratings for learners and concepts which correlate well with subjective proficiency levels of the learners and difficulty levels of the concepts.

AB - Automatic assessment of the proficiency levels of the learner is a critical part of Intelligent Tutoring Systems. We present methods for assessment in the context of language learning. We use a specialized Elo formula used in conjunction with educational data mining. We simultaneously obtain ratings for the proficiency of the learners and for the difficulty of the linguistic concepts that the learners are trying to master. From the same data we also learn a graph structure representing a domain model capturing the relations among the concepts. This application of Elo provides ratings for learners and concepts which correlate well with subjective proficiency levels of the learners and difficulty levels of the concepts.

KW - 113 Computer and information sciences

KW - 516 Educational sciences

KW - 6121 Languages

M3 - Conference contribution

SP - 494

EP - 506

BT - Innovative Use of NLP for Building Educational Applications

A2 - Yannakoudakis, Helen

A2 - Kochmar, Ekaterina

A2 - Leacock, Claudia

A2 - Madnani, Nitin

A2 - Pilán, Ildikó

A2 - Zesch, Torsten

PB - The Association for Computational Linguistics

CY - Stroudsburg

T2 - Workshop on Innovative Use of NLP for Building Educational Applications

Y2 - 2 August 2019 through 2 August 2019

ER -

Hou J, Koppatz M, Hoya Quecedo JM, Stoyanova N, Kopotev M , Yangarber R. Modeling language learning using specialized Elo ratings. In Yannakoudakis H, Kochmar E, Leacock C, Madnani N, Pilán I, Zesch T, editors, Innovative Use of NLP for Building Educational Applications: Proceedings of the 14th Workshop. Stroudsburg: The Association for Computational Linguistics. 2019. p. 494-506

Modeling language learning using specialized Elo ratings

Abstract

Fields of Science

Access to Document

Projects

LLL: Language Learning Lab

Revita: Language learning and AI

Cite this