Persoonlijk profiel
Speerpunten
My research focuses on pragmatic language understanding in Human Machine Interaction, with an emphasis on how multimodal cues (e.g., textual, audio, and visual) can be utilized to unreveal meaning beyond literal content. Sarcasm serves as a central case study in my research. Drawing on linguistics, cognitive science, my work investigates how pragmatic cues like prosodic variation, semantic incongruity, and facial expressions can be systematically modeled using multimodal fusion strategies. The broader aim is to move beyond surface-level prompt-style language processing, and toward systems that understand language as it is used in real human interaction: emotionally charged, culturally embedded, and shaped by dynamic social context.
Key words: multimodal sarcasm detection, pragmatic computing, human-machine-interaction, affective computing.
Vingerafdruk
- 1 Soortgelijke profielen
Samenwerkingen en hoofdonderzoeksgebieden uit de afgelopen vijf jaar
-
AMuSeD: An Attentive Deep Neural Network for Multimodal Sarcasm Detection Incorporating Bi-modal Data Augmentation
Gao, X., Bansal, S., Gowda, K., Li, Z., Nayak, S., Kumar, N. & Coler, M., 2026, In: IEEE Transactions on Affective Computing. 17, 1, blz. 900-912 13 blz.Onderzoeksoutput › Academic › peer review
1 Citaat (Scopus) -
Toward pragmatic inference in machines: Relation-aware multimodal modeling of sarcasm in conversation
Gao, X., 2026, [Groningen]: University of Groningen. 314 blz.Onderzoeksoutput
Open AccessBestand -
A Multimodal Chinese Dataset for Cross-lingual Sarcasm Detection
Gao, X., Wang, B. X., Zhang, M., Huang, S., Li, Z., Nayak, S. & Coler, M., 2025, Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH. ISCA, blz. 3968-3972 5 blz. (Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH).Onderzoeksoutput › Academic › peer review
Open AccessBestand4 Downloads (Pure)
Datasets
-
MCSD 1.0 - Multimodal Chinese Sarcasm Dataset
Gao, X. (Creator), Wang, B. X. (Contributor), Zhang, M. (Contributor), Zhang, S. (Contributor), Li, Z. (Contributor), Nayak, S. (Supervisor) & Coler, M. (Supervisor), University of Groningen, 9-jul.-2025
DOI: 10.34894/A0NLTQ
Dataset
Knipsels
-
Researchers Have Built an AI-Powered Sarcasm Detector
05/08/2024
1 item van Media-aandacht
Pers / media: Expert Comment › Popular
-
Des chercheurs néerlandais améliorent la détection du sarcasme grâce à une approche multimodale
01/07/2024
1 item van Media-aandacht
Pers / media: Expert Comment › Popular
-
Algoritam koji kuži sarkazam? Da, baš nam to treba
31/05/2024
1 item van Media-aandacht
Pers / media: Expert Comment › Popular
-
Why Does Google's Latest Experimental Search Tool Feature Make Bizarre Suggestions Like Eating Rocks?
28/05/2024
1 item van Media-aandacht
Pers / media: Expert Comment › Popular
-
Algoritmos para detectar el sarcasmo
27/05/2024
1 item van Media-aandacht
Pers / media: Expert Comment › Popular