Evaluating algorithms for the Generation of Referring Expressions using a balanced corpus

A. Gatt, Ielka van der Sluis, Kees van Deemter

    OnderzoeksoutputAcademicpeer review

    69 Citaten (Scopus)
    231 Downloads (Pure)


    Despite being the focus of intensive research, evaluation
    of algorithms that generate referring expressions
    is still in its infancy. We describe a corpusbased
    evaluation methodology, applied to a number
    of classic algorithms in this area. The methodology
    focuses on balance and semantic transparency to
    enable comparison of human and algorithmic output.
    Although the Incremental Algorithm emerges
    as the best match, we found that its dependency on
    manually-set parameters makes its performance difficult
    to predict.
    Originele taal-2English
    TitelProceedings of the 11th European Workshop on Natural Language Generation, ENLG-07.
    Plaats van productieSloss Dagstuhl, Germany
    StatusPublished - 2007

    Citeer dit