Evaluating an Algorithm for the Generation of Multimodal Referring Expressions in a Virtual World: A Pilot Study

Ielka van der Sluis, Werner Breitfuss, S. Luz, Helmut Prendinger

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    1 Citation (Scopus)
    259 Downloads (Pure)


    This paper presents a quest for the most suitable setting and method to assess the naturalness of the output of an existing algorithm for the generation of multimodal referring expressions. For the evaluation of this algorithm a setting in Second Life was built. This paper reports on a pilot study that aimed to assess (1) the suitability of the setting and (2) the design of our evaluation method. Results show that subjects are able to discriminate between different types of referring expressions the algorithm produces. Lessons learnt in designing questionnaires are also reported.
    Original languageEnglish
    Title of host publicationProc. of IVA-2009
    Place of PublicationAmsterdam, Netherlands
    Publication statusPublished - 2009

    Cite this