Personal profile
Research interests
My research focuses on pragmatic language understanding in Human Machine Interaction, with an emphasis on how multimodal cues (e.g., textual, audio, and visual) can be utilized to unreveal meaning beyond literal content. Sarcasm serves as a central case study in my research. Drawing on linguistics, cognitive science, my work investigates how pragmatic cues like prosodic variation, semantic incongruity, and facial expressions can be systematically modeled using multimodal fusion strategies. The broader aim is to move beyond surface-level prompt-style language processing, and toward systems that understand language as it is used in real human interaction: emotionally charged, culturally embedded, and shaped by dynamic social context.
Key words: multimodal sarcasm detection, pragmatic computing, human-machine-interaction, affective computing.
Fingerprint
- 1 Similar Profiles
Collaborations and top research areas from the last five years
-
A Multimodal Chinese Dataset for Cross-lingual Sarcasm Detection
Gao, X., Wang, B. X., Zhang, M., Huang, S., Li, Z., Nayak, S. & Coler, M., 2025, Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH. ISCA, p. 3968-3972 5 p. (Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH).Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review
Open AccessFile3 Downloads (Pure) -
AMuSeD: An Attentive Deep Neural Network for Multimodal Sarcasm Detection Incorporating Bi-modal Data Augmentation
Gao, X., Bansal, S., Gowda, K., Li, Z., Nayak, S., Kumar, N. & Coler, M., 2-Dec-2025, (E-pub ahead of print) In: IEEE Transactions on Affective Computing. 14 p.Research output: Contribution to journal › Article › Academic › peer-review
-
Intra-modal Relation and Emotional Incongruity Learning using Graph Attention Networks for Multimodal Sarcasm Detection
Raghuvanshi, D., Gao, X., Li, Z., Bansal, S., Coler, M., Kumar, N. & Nayak, S., 2025, 2025 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2025 - Proceedings. Rao, B. D., Trancoso, I., Sharma, G. & Mehta, N. B. (eds.). IEEE, 5 p. (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings).Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review
Open AccessFile5 Citations (Scopus)13 Downloads (Pure)
Datasets
-
MCSD 1.0 - Multimodal Chinese Sarcasm Dataset
Gao, X. (Creator), Wang, B. X. (Contributor), Zhang, M. (Contributor), Zhang, S. (Contributor), Li, Z. (Contributor), Nayak, S. (Supervisor) & Coler, M. (Supervisor), University of Groningen, 9-Jul-2025
DOI: 10.34894/A0NLTQ
Dataset
Press/Media
-
Researchers Have Built an AI-Powered Sarcasm Detector
05/08/2024
1 item of Media coverage
Press/Media: Expert Comment › Popular
-
Des chercheurs néerlandais améliorent la détection du sarcasme grâce à une approche multimodale
01/07/2024
1 item of Media coverage
Press/Media: Expert Comment › Popular
-
Algoritam koji kuži sarkazam? Da, baš nam to treba
31/05/2024
1 item of Media coverage
Press/Media: Expert Comment › Popular
-
Why Does Google's Latest Experimental Search Tool Feature Make Bizarre Suggestions Like Eating Rocks?
28/05/2024
1 item of Media coverage
Press/Media: Expert Comment › Popular
-
Algoritmos para detectar el sarcasmo
27/05/2024
1 item of Media coverage
Press/Media: Expert Comment › Popular