Konferenzpaper | | Peer reviewed Open Access

The USAGE review corpus for fine-grained, multi-lingual opinion analysis

Autor(en)
Klinger, Roman ; Cimiano, Philipp 0000-0002-4771-441X
Titel des Konferenzbandes
Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
Name der Konferenz
International Conference on Language Resources and Evaluation (9. : 2014 : Reykjavik)
URN
urn:nbn:de:0070-pub-26642186
URL
https://pub.uni-bielefeld.de/record/2664218

Opinion mining has received wide attention in recent years. Models for this task are typically trained or evaluated with a manually annotated dataset. However, fine-grained annotation of sentiments including information about aspects and their evaluation is very labour-intensive. The data available so far is limited. Contributing to this situation, this paper describes the Bielefeld University Sentiment Analysis Corpus for German and English (USAGE), which we offer freely to the community and which contains the annotation of product reviews from Amazon with both aspects and subjective phrases. It provides information on segments in the text which denote an aspect or a subjective evaluative phrase which refers to the aspect. Relations and coreferences are explicitly annotated. This dataset contains 622 English and 611 German reviews, allowing to investigate how to port sentiment analysis systems across languages and domains. We describe the methodology how the corpus was created and provide statistics including inter-annotator agreement. We further provide figures for a baseline system and results for German and English as well as in a cross-domain setting. The results are encouraging in that they show that aspects and phrases can be extracted robustly without the need of tuning to a particular type of products.

Zitierstile

Download
 RDF/XML-Format
 JSON-LD-Format
 Turtle-Format
 N3-Format