Konferenzpaper | | Peer reviewed

Talking with Robots about Objects: A system-level evaluation in HRI

Autor(en)
Peltason, Julia ; Riether, Nina ; Wrede, Britta 0000-0003-1424-472X ; Lütkebohle, Ingo
Titel des Konferenzbandes
7th ACM/IEEE Conference on Human-Robot-Interaction
Name der Konferenz
7th ACM/IEEE International Conference on Human-Robot-Interaction
DOI
10.1145/2157689.2157841
URL
https://pub.uni-bielefeld.de/record/2451224

Weitere Details

Sprache
englisch
Darstellungsform
Text
DDC
006

We present the design process, realization and evaluation of a robot system for interactive object learning. The system-oriented evaluation, in particular, addresses an open problem for the evaluation of systems, where overall user satisfcation depends not only on the performance of the parts, but also on their combination, and on user behavior. Based on the PARADISE method known from spoken dialog systems, we have defined and applied internal and external metrics for fine-grained and largely automatable identification of such relationships. Through evaluation with n=28 subjects, indicator functions explaining up to 55% of variation in several satisfaction metrics were found. Furthermore, we demonstrate that the system’s interaction style reduces the need for instruction and successfully recovers partial failures.

Zitierstile

Download
 RDF/XML-Format
 JSON-LD-Format
 Turtle-Format
 N3-Format