Probing Linguistic Knowledge in Italian Neural Language Models across Language Varieties

Alessio Miaschi*, Gabriele Sarti, Dominique Brunato, Felice Dell’Orletta, Giulia Venturi

*Bijbehorende auteur voor dit werk

OnderzoeksoutputAcademicpeer review

69 Downloads (Pure)


In this paper, we present an in-depth investigation of the linguistic knowledge encoded by the transformer models currently available for the Italian language. In particular, we investigate how the complexity of two different architectures of probing models affects the performance of the Transformers in encoding a wide spectrum of linguistic features. Moreover, we explore how this implicit knowledge varies according to different textual genres and language varieties.
Originele taal-2English
Pagina's (van-tot)25-44
Aantal pagina's20
TijdschriftItalilan Journal of Computational Linguistics
Nummer van het tijdschrift1
StatusPublished - jul.-2022

Citeer dit