TY - GEN
T1 - Robot-assisted Recognition of Vocal Emotions in Pseudospeech for Cochlear Implanted Adolescents
AU - Araiza-Illan, Gloria
AU - Meyer, Luke
AU - Maat, Bert
AU - Başkent, Deniz
N1 - Publisher Copyright:
© 2025 International Speech Communication Association. All rights reserved.
PY - 2025
Y1 - 2025
N2 - Recognising vocal emotions in speech is difficult for children with hearing loss and who use a cochlear implant (CI). As regular monitoring could be burdensome, we propose a NAO robot as a test interface. Adolescents with CIs (10-17yr) performed the EmoHI test for recognising vocal emotions in pseudospeech (no linguistic emotion information), once with a computer and once with a NAO. Interfaces are compared via test results and durations, and participants' perception of the interfaces. Test results (sensitivity index, d') were similar (0.36 ± 0.36 vs. 0.37 ± 0.43), but durations were significantly longer on the NAO (4.18 min ± 39 sec vs. 5.13 min ± 51 sec). The computer had a higher perceived usability, but the NAO was rated more enjoyable, engaging and preferable. Overall, the NAO sound quality seems sufficient for conducting the EmoHI test, even with a CI. The higher ratings of enjoyability for NAO may be especially useful in conducting such tests in populations with hearing devices.
AB - Recognising vocal emotions in speech is difficult for children with hearing loss and who use a cochlear implant (CI). As regular monitoring could be burdensome, we propose a NAO robot as a test interface. Adolescents with CIs (10-17yr) performed the EmoHI test for recognising vocal emotions in pseudospeech (no linguistic emotion information), once with a computer and once with a NAO. Interfaces are compared via test results and durations, and participants' perception of the interfaces. Test results (sensitivity index, d') were similar (0.36 ± 0.36 vs. 0.37 ± 0.43), but durations were significantly longer on the NAO (4.18 min ± 39 sec vs. 5.13 min ± 51 sec). The computer had a higher perceived usability, but the NAO was rated more enjoyable, engaging and preferable. Overall, the NAO sound quality seems sufficient for conducting the EmoHI test, even with a CI. The higher ratings of enjoyability for NAO may be especially useful in conducting such tests in populations with hearing devices.
KW - cochlear-implanted adolescents
KW - human-robot interaction
KW - psychophysics
KW - user-experience
KW - vocal emotion recognition
UR - https://www.scopus.com/pages/publications/105020064341
U2 - 10.21437/Interspeech.2025-2448
DO - 10.21437/Interspeech.2025-2448
M3 - Conference contribution
AN - SCOPUS:105020064341
T3 - Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
SP - 818
EP - 822
BT - Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
PB - International Speech Communication Association
T2 - 26th Interspeech Conference 2025
Y2 - 17 August 2025 through 21 August 2025
ER -