GruPaTo at SemEval-2020 Task 12: Retraining mBERT on Social Media and Fine-tuned Offensive Language Models

Tommaso Caselli, Davide Colla, Valerio Basile, Jelena Mitrović, Michael Granitzer

    OnderzoeksoutputAcademicpeer review

    63 Downloads (Pure)

    Samenvatting

    We introduce an approach to multilingual Offensive Language Detection based on the mBERT transformer model. We download extra training data from Twitter in English, Danish, and Turkish, and use it to re-train the model. We then fine-tuned the model on the provided training data and, in some configurations, implement transfer learning approach exploiting the typological relatedness between English and Danish. Our systems obtained good results across the three languages (.9036 for EN, .7619 for DA, and .7789 for TR).
    Originele taal-2English
    TitelProceedings of the 14th International Workshop on Semantic Evaluation
    RedacteurenAurelie Herbelot, Xiaodan Zhu, Alexis Palmer, Nathan Schneider, Jonathan May, Ekaterina Shutova
    UitgeverijAssociation for Computational Linguistics (ACL)
    Aantal pagina's9
    StatusPublished - 2020
    EvenementFourteenth Workshop on Semantic Evaluation - Barcelona, Spain
    Duur: 12-dec.-202013-dec.-2020

    Workshop

    WorkshopFourteenth Workshop on Semantic Evaluation
    Verkorte titelSemEval-2020
    Land/RegioSpain
    StadBarcelona
    Periode12/12/202013/12/2020

    Vingerafdruk

    Duik in de onderzoeksthema's van 'GruPaTo at SemEval-2020 Task 12: Retraining mBERT on Social Media and Fine-tuned Offensive Language Models'. Samen vormen ze een unieke vingerafdruk.

    Citeer dit