Comparing Intrinsic and Extrinsic Evaluation of MT Output in a Dialogue System

Ielka van der Sluis, S. Luz, A. Schneider

    OnderzoeksoutputAcademicpeer review

    121 Downloads (Pure)

    Samenvatting

    We present an exploratory study to assess machine translation
    output for application in a dialogue system using an intrinsic
    and an extrinsic evaluation method. For the intrinsic
    evaluation we developed an annotation scheme to determine
    the quality of the translated utterances in isolation. For the
    extrinsic evaluation we employed theWizard of Oz technique
    to assess the quality of the translations in the context of a dialogue
    application. Results differ and we discuss the possible
    reasons for this outcome.
    Originele taal-2English
    TitelProceedings of the 7th International Workshop on Spoken Language Translation
    SubtitelIWSLT 2010
    RedacteurenMarcello Federico
    Plaats van productieParis
    Pagina's329-336
    Aantal pagina's7
    StatusPublished - 2010
    Evenement7th International Workshop on Spoken Language Translation - Paris, France
    Duur: 2-dec-20103-dec-2010

    Conference

    Conference7th International Workshop on Spoken Language Translation
    Land/RegioFrance
    StadParis
    Periode02/12/201003/12/2010

    Citeer dit