MAGPIE: A Large Corpus of Potentially Idiomatic Expressions

Hessel Haagsma, Johan Bos, Malvina Nissim

    OnderzoeksoutputAcademicpeer review

    12 Downloads (Pure)


    Given the limited size of existing idiom corpora, we aim to enable progress in automatic idiom processing and linguistic analysis by creating the largest-to-date corpus of idioms for English. Using a fixed idiom list, automatic pre-extraction, and a strictly controlled crowdsourced annotation procedure, we show that it is feasible to build a high-quality corpus comprising more than 50K instances, an order of a magnitude larger than previous resources. Crucial ingredients of crowdsourcing were the selection of crowdworkers, clear and comprehensive instructions, and an interface that breaks down the task in small, manageable steps. Analysis of the resulting corpus revealed strong effects of genre on idiom distribution, providing new evidence for existing theories on what influences idiom usage. The corpus also contains rich metadata, and is made publicly available.
    Originele taal-2English
    TitelProceedings of The 12th Language Resources and Evaluation Conference
    SubtitelLREC 2020
    UitgeverijEuropean Language Resources Association (ELRA)
    Aantal pagina's9
    StatusPublished - 2020
    Evenement12th Language Resources and Evaluation Conference
    : LREC 2020
    - Marseille, France
    Duur: 11-mei-202016-mei-2020


    Conference12th Language Resources and Evaluation Conference
    Internet adres

    Citeer dit