Pictures and Text (PAT)

The PAT project addresses the use, effects and optimisation of documents that contain pictures and text (PAT). PAT innovatively combines approaches from Information Design Research and Computational Linguistics employing corpus collection and analysis, (automatic) annotation, experimentation, and natural language generation. The PAT project will deliver theoretical results in terms of empirically validated models for effective multimodal documents. Results of practical value include new annotated multimodal corpora, implemented taggers to automatically annotate potentially effective properties of multimodal documents, algorithms to automatically evaluate and to automatically generate effective text-picture combinations and authoring guidelines to produce good quality multimodal documents.