LSDC - A comprehensive dataset for Low Saxon Dialect Classification

Janine Siewert*, Yves Scherrer, Martijn Wieling, Jörg Tiedemann

*Corresponding author for this work

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    5 Downloads (Pure)

    Abstract

    We present a new comprehensive dataset for the unstandardised West-Germanic language Low Saxon covering the last two centuries, the majority of modern dialects and various genres, which will be made openly available in connection with the final version of this paper. Since so far no such comprehensive dataset of contemporary Low Saxon exists, this provides a great contribution to NLP research on this language. We also test the use of this dataset for dialect classification by training a few baseline models comparing statistical and neural approaches. The performance of these models shows that in spite of an imbalance in the amount of data per dialect, enough features can be learned for a relatively high classification accuracy.
    Original languageEnglish
    Title of host publicationProceedings of the 7th Workshop on NLP for Similar Languages, Varieties and Dialects
    EditorsMarcos Zampieri, Preslav Nakov, Nikola Ljubešić, Jörg Tiedemann, Yves Scherrer
    PublisherInternational Committee on Computational Linguistics (ICCL)
    Pages25-35
    Number of pages11
    Publication statusPublished - 2020
    Event7th Workshop on NLP for Similar Languages, Varieties and Dialects - Online
    Duration: 13-Dec-2020 → …

    Workshop

    Workshop7th Workshop on NLP for Similar Languages, Varieties and Dialects
    Abbreviated titleVarDial 2020
    Period13/12/2020 → …

    Cite this