Abstract
We automatically generate headlines that are expected to comply with the specific styles of two different Italian newspapers. Through a data alignment strategy and different training/testing settings, we aim at decoupling content from style and preserve the latter in generation. In order to evaluate the generated headlines’ quality in terms of their specific newspaper-compliance, we devise a fine-grained evaluation strategy based on automatic classification. We observe that our models do indeed learn newspaper-specific style.Importantly, we also observe that humans aren’t reliable judges for this task, since although familiar with the newspapers, they are notable to discern their specific styles even in the original human-written headlines. The utility of automatic evaluation goes therefore beyond saving the costs and hurdles of manual annotation, and deserves particular care in its design.
Original language | English |
---|---|
Title of host publication | Proceedings of The 12th Language Resources and Evaluation Conference |
Subtitle of host publication | LREC 2020 |
Publisher | European Language Resources Association (ELRA) |
Pages | 6709-6717 |
Number of pages | 9 |
Publication status | Published - 2020 |
Event | 12th Language Resources and Evaluation Conference : LREC 2020 - Marseille, France Duration: 11-May-2020 → 16-May-2020 https://lrec2020.lrec-conf.org/en/ |
Conference
Conference | 12th Language Resources and Evaluation Conference |
---|---|
Country | France |
City | Marseille |
Period | 11/05/2020 → 16/05/2020 |
Internet address |