Projects per year
Abstract
We examine supervised learning for multi-class, multi-label text
classification. We are interested in exploring classification in a
real-world setting, where the distribution of labels may change
dynamically over time. First, we compare the performance of an array of
binary classifiers trained on the label distribution found in the
original corpus against classifiers trained on balanced data, where
we try to make the label distribution as nearly uniform as possible. We
discuss the performance trade-offs between balanced vs. unbalanced
training, and highlight the advantages of balancing the training set.
Second, we compare the performance of two classifiers, Naive Bayes and
SVM, with several feature-selection methods, using balanced training. We
combine a Named-Entity-based rote classifier with the statistical
classifiers to obtain better performance than either method alone.
classification. We are interested in exploring classification in a
real-world setting, where the distribution of labels may change
dynamically over time. First, we compare the performance of an array of
binary classifiers trained on the label distribution found in the
original corpus against classifiers trained on balanced data, where
we try to make the label distribution as nearly uniform as possible. We
discuss the performance trade-offs between balanced vs. unbalanced
training, and highlight the advantages of balancing the training set.
Second, we compare the performance of two classifiers, Naive Bayes and
SVM, with several feature-selection methods, using balanced training. We
combine a Named-Entity-based rote classifier with the statistical
classifiers to obtain better performance than either method alone.
| Original language | English |
|---|---|
| Title of host publication | Unknown host publication |
| Number of pages | 12 |
| Publisher | Springer-Verlag |
| Publication date | Oct 2014 |
| Publication status | Published - Oct 2014 |
| MoE publication type | A4 Article in conference proceedings |
| Event | International Conference on Statistical Language and Speech Processing (SLSP 2014) - Grenoble, France Duration: 14 Oct 2014 → 16 Oct 2014 Conference number: 2 |
Publication series
| Name | Lecture notes in artificial intelligence |
|---|---|
| Number | 8791 |
Fields of Science
- 113 Computer and information sciences
-
PULS
Yangarber, R. (Project manager), Du, M. (Participant), Pivovarova, L. (Participant), Pierce, M. (Participant), von Etter, P. (Participant) & Huttunen, S. (Participant)
01/12/2007 → …
Project: Research project
-
LLL: Language Learning Lab
Yangarber, R. (Project manager), Katinskaia, A. (Participant), Hou, J. (Participant), Furlan, G. (Participant) & Kylliäinen, I. P. (Participant)
Project: Research project