MAGPIE: A Large Corpus of Potentially Idiomatic Expressions

Hessel Haagsma; Johan Bos; Malvina Nissim

MAGPIE: A Large Corpus of Potentially Idiomatic Expressions

Hessel Haagsma, Johan Bos, Malvina Nissim

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

4 Citations (Scopus)

35 Downloads (Pure)

Abstract

Given the limited size of existing idiom corpora, we aim to enable progress in automatic idiom processing and linguistic analysis by creating the largest-to-date corpus of idioms for English. Using a fixed idiom list, automatic pre-extraction, and a strictly controlled crowdsourced annotation procedure, we show that it is feasible to build a high-quality corpus comprising more than 50K instances, an order of a magnitude larger than previous resources. Crucial ingredients of crowdsourcing were the selection of crowdworkers, clear and comprehensive instructions, and an interface that breaks down the task in small, manageable steps. Analysis of the resulting corpus revealed strong effects of genre on idiom distribution, providing new evidence for existing theories on what influences idiom usage. The corpus also contains rich metadata, and is made publicly available.

Original language	English
Title of host publication	Proceedings of The 12th Language Resources and Evaluation Conference
Subtitle of host publication	LREC 2020
Editors	Nicoletta Calzolari, Frederic Bechet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Publisher	European Language Resources Association (ELRA)
Pages	279-287
Number of pages	9
ISBN (Electronic)	9791095546344
Publication status	Published - 2020
Event	12th Language Resources and Evaluation Conference : LREC 2020 - Marseille, France Duration: 11-May-2020 → 16-May-2020 https://lrec2020.lrec-conf.org/en/

Publication series

Name	LREC 2020 - 12th International Conference on Language Resources and Evaluation, Conference Proceedings

Conference

Conference	12th Language Resources and Evaluation Conference
Country/Territory	France
City	Marseille
Period	11/05/2020 → 16/05/2020
Internet address	https://lrec2020.lrec-conf.org/en/

Access to Document

MAGPIE: A Large Corpus of Potentially Idiomatic ExpressionsFinal publisher's version, 415 KBLicence: CC BY-NC

Cite this

Haagsma, H., Bos, J., & Nissim, M. (2020). MAGPIE: A Large Corpus of Potentially Idiomatic Expressions. In N. Calzolari, F. Bechet, P. Blache, K. Choukri, C. Cieri, T. Declerck, S. Goggi, H. Isahara, B. Maegaard, J. Mariani, H. Mazo, A. Moreno, J. Odijk, & S. Piperidis (Eds.), Proceedings of The 12th Language Resources and Evaluation Conference: LREC 2020 (pp. 279-287). (LREC 2020 - 12th International Conference on Language Resources and Evaluation, Conference Proceedings). European Language Resources Association (ELRA).

Haagsma, Hessel ; Bos, Johan ; Nissim, Malvina. / MAGPIE : A Large Corpus of Potentially Idiomatic Expressions. Proceedings of The 12th Language Resources and Evaluation Conference: LREC 2020. editor / Nicoletta Calzolari ; Frederic Bechet ; Philippe Blache ; Khalid Choukri ; Christopher Cieri ; Thierry Declerck ; Sara Goggi ; Hitoshi Isahara ; Bente Maegaard ; Joseph Mariani ; Helene Mazo ; Asuncion Moreno ; Jan Odijk ; Stelios Piperidis. European Language Resources Association (ELRA), 2020. pp. 279-287 (LREC 2020 - 12th International Conference on Language Resources and Evaluation, Conference Proceedings).

@inproceedings{98738fc4983842e7b9514d96414e657a,

title = "MAGPIE: A Large Corpus of Potentially Idiomatic Expressions",

abstract = "Given the limited size of existing idiom corpora, we aim to enable progress in automatic idiom processing and linguistic analysis by creating the largest-to-date corpus of idioms for English. Using a fixed idiom list, automatic pre-extraction, and a strictly controlled crowdsourced annotation procedure, we show that it is feasible to build a high-quality corpus comprising more than 50K instances, an order of a magnitude larger than previous resources. Crucial ingredients of crowdsourcing were the selection of crowdworkers, clear and comprehensive instructions, and an interface that breaks down the task in small, manageable steps. Analysis of the resulting corpus revealed strong effects of genre on idiom distribution, providing new evidence for existing theories on what influences idiom usage. The corpus also contains rich metadata, and is made publicly available.",

author = "Hessel Haagsma and Johan Bos and Malvina Nissim",

note = "Funding Information: 4www.figure-eight.com. These experiments were funded by an “AI For Everyone Challenge” grant awarded to us by FigureEight. Funding Information: This work was funded by the NWO-VICI grant Lost in Translation – Foundin Meaning (288-89-003). The crowd-sourcing effort was made possible by FigureEight, as part of their AI For Everyone Challenge competition. Publisher Copyright: {\textcopyright} European Language Resources Association (ELRA), licensed under CC-BY-NC; 12th Language Resources and Evaluation Conference<br/> : LREC 2020 ; Conference date: 11-05-2020 Through 16-05-2020",

year = "2020",

language = "English",

series = "LREC 2020 - 12th International Conference on Language Resources and Evaluation, Conference Proceedings",

publisher = "European Language Resources Association (ELRA)",

pages = "279--287",

editor = "Nicoletta Calzolari and Frederic Bechet and Philippe Blache and Khalid Choukri and Christopher Cieri and Thierry Declerck and Sara Goggi and Hitoshi Isahara and Bente Maegaard and Joseph Mariani and Helene Mazo and Asuncion Moreno and Jan Odijk and Stelios Piperidis",

booktitle = "Proceedings of The 12th Language Resources and Evaluation Conference",

url = "https://lrec2020.lrec-conf.org/en/",

}

Haagsma, H, Bos, J & Nissim, M 2020, MAGPIE: A Large Corpus of Potentially Idiomatic Expressions. in N Calzolari, F Bechet, P Blache, K Choukri, C Cieri, T Declerck, S Goggi, H Isahara, B Maegaard, J Mariani, H Mazo, A Moreno, J Odijk & S Piperidis (eds), Proceedings of The 12th Language Resources and Evaluation Conference: LREC 2020. LREC 2020 - 12th International Conference on Language Resources and Evaluation, Conference Proceedings, European Language Resources Association (ELRA), pp. 279-287, 12th Language Resources and Evaluation Conference
, Marseille, France, 11/05/2020.

MAGPIE : A Large Corpus of Potentially Idiomatic Expressions. / Haagsma, Hessel; Bos, Johan ; Nissim, Malvina.

Proceedings of The 12th Language Resources and Evaluation Conference: LREC 2020. ed. / Nicoletta Calzolari; Frederic Bechet; Philippe Blache; Khalid Choukri; Christopher Cieri; Thierry Declerck; Sara Goggi; Hitoshi Isahara; Bente Maegaard; Joseph Mariani; Helene Mazo; Asuncion Moreno; Jan Odijk; Stelios Piperidis. European Language Resources Association (ELRA), 2020. p. 279-287 (LREC 2020 - 12th International Conference on Language Resources and Evaluation, Conference Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - MAGPIE

T2 - 12th Language Resources and Evaluation Conference<br/>

AU - Haagsma, Hessel

AU - Bos, Johan

AU - Nissim, Malvina

N1 - Funding Information: 4www.figure-eight.com. These experiments were funded by an “AI For Everyone Challenge” grant awarded to us by FigureEight. Funding Information: This work was funded by the NWO-VICI grant Lost in Translation – Foundin Meaning (288-89-003). The crowd-sourcing effort was made possible by FigureEight, as part of their AI For Everyone Challenge competition. Publisher Copyright: © European Language Resources Association (ELRA), licensed under CC-BY-NC

PY - 2020

Y1 - 2020

N2 - Given the limited size of existing idiom corpora, we aim to enable progress in automatic idiom processing and linguistic analysis by creating the largest-to-date corpus of idioms for English. Using a fixed idiom list, automatic pre-extraction, and a strictly controlled crowdsourced annotation procedure, we show that it is feasible to build a high-quality corpus comprising more than 50K instances, an order of a magnitude larger than previous resources. Crucial ingredients of crowdsourcing were the selection of crowdworkers, clear and comprehensive instructions, and an interface that breaks down the task in small, manageable steps. Analysis of the resulting corpus revealed strong effects of genre on idiom distribution, providing new evidence for existing theories on what influences idiom usage. The corpus also contains rich metadata, and is made publicly available.

AB - Given the limited size of existing idiom corpora, we aim to enable progress in automatic idiom processing and linguistic analysis by creating the largest-to-date corpus of idioms for English. Using a fixed idiom list, automatic pre-extraction, and a strictly controlled crowdsourced annotation procedure, we show that it is feasible to build a high-quality corpus comprising more than 50K instances, an order of a magnitude larger than previous resources. Crucial ingredients of crowdsourcing were the selection of crowdworkers, clear and comprehensive instructions, and an interface that breaks down the task in small, manageable steps. Analysis of the resulting corpus revealed strong effects of genre on idiom distribution, providing new evidence for existing theories on what influences idiom usage. The corpus also contains rich metadata, and is made publicly available.

M3 - Conference contribution

T3 - LREC 2020 - 12th International Conference on Language Resources and Evaluation, Conference Proceedings

SP - 279

EP - 287

BT - Proceedings of The 12th Language Resources and Evaluation Conference

A2 - Calzolari, Nicoletta

A2 - Bechet, Frederic

A2 - Blache, Philippe

A2 - Choukri, Khalid

A2 - Cieri, Christopher

A2 - Declerck, Thierry

A2 - Goggi, Sara

A2 - Isahara, Hitoshi

A2 - Maegaard, Bente

A2 - Mariani, Joseph

A2 - Mazo, Helene

A2 - Moreno, Asuncion

A2 - Odijk, Jan

A2 - Piperidis, Stelios

PB - European Language Resources Association (ELRA)

Y2 - 11 May 2020 through 16 May 2020

ER -

Haagsma H, Bos J , Nissim M. MAGPIE: A Large Corpus of Potentially Idiomatic Expressions. In Calzolari N, Bechet F, Blache P, Choukri K, Cieri C, Declerck T, Goggi S, Isahara H, Maegaard B, Mariani J, Mazo H, Moreno A, Odijk J, Piperidis S, editors, Proceedings of The 12th Language Resources and Evaluation Conference: LREC 2020. European Language Resources Association (ELRA). 2020. p. 279-287. (LREC 2020 - 12th International Conference on Language Resources and Evaluation, Conference Proceedings).