Evaluating an Algorithm for the Generation of Multimodal Referring Expressions in a Virtual World: A Pilot Study

Ielka van der Sluis, Werner Breitfuss, S. Luz, Helmut Prendinger

    OnderzoeksoutputAcademicpeer review

    1 Citaat (Scopus)
    245 Downloads (Pure)


    This paper presents a quest for the most suitable setting and method to assess the naturalness of the output of an existing algorithm for the generation of multimodal referring expressions. For the evaluation of this algorithm a setting in Second Life was built. This paper reports on a pilot study that aimed to assess (1) the suitability of the setting and (2) the design of our evaluation method. Results show that subjects are able to discriminate between different types of referring expressions the algorithm produces. Lessons learnt in designing questionnaires are also reported.
    Originele taal-2English
    TitelProc. of IVA-2009
    Plaats van productieAmsterdam, Netherlands
    StatusPublished - 2009

    Citeer dit