Evaluating algorithms for the Generation of Referring Expressions using a balanced corpus

A. Gatt, Ielka van der Sluis, Kees van Deemter

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    76 Citations (Scopus)
    267 Downloads (Pure)


    Despite being the focus of intensive research, evaluation
    of algorithms that generate referring expressions
    is still in its infancy. We describe a corpusbased
    evaluation methodology, applied to a number
    of classic algorithms in this area. The methodology
    focuses on balance and semantic transparency to
    enable comparison of human and algorithmic output.
    Although the Incremental Algorithm emerges
    as the best match, we found that its dependency on
    manually-set parameters makes its performance difficult
    to predict.
    Original languageEnglish
    Title of host publicationProceedings of the 11th European Workshop on Natural Language Generation, ENLG-07.
    Place of PublicationSloss Dagstuhl, Germany
    Publication statusPublished - 2007

    Cite this