Research
My interests lie in the automatic analysis and understanding of verbal and nonverbal (vocal) behaviors in human-human and human-machine interaction, and the design of socially interactive technology to support human needs. Using methods from affective computing and social signal processing, I aim to develop socially and affective intelligent interfaces (e.g. virtual conversational agents, social robots) that can recognize and display social and affective signals and to study how humans interact with this new kind of technology. Coming from a background in (computational) paralinguistics and speech analysis, my main focus is on analysing vocal cues in addition to visual cues (e.g. facial expressions, eye gaze) and physiological (e.g. heart rate, galvanic skin response) measurements in social interaction.
Prior to HMI, I was employed by TNO Human Factors in Soesterberg where I worked towards my PhD on automatic emotion recognition in speech and automatic laughter detection. During my master research at Radboud University in Nijmegen, I worked on automatic pronunciation error detection in second language learners' speech.
Publications
Jump to: Abstract | Article | Chapter | Conference article | Conference contribution | Paper | PhD Thesis - Research UT, graduation UT | Poster | Preprint
Abstract
2024
Evaluating the State-of-the-Art Automatic Speech Recognition systems for Dutch (2024)[Contribution to conference › Abstract] 34th Meeting of Computational Linguistics in The Netherlands, CLIN 2024. Bălan, D. A., Ordelman, R. J. F. & Truong, K. P.https://clin34.leidenuniv.nl/abstracts/evaluating-the-state-of-the-art-automatic-speech-recognition-systems-for-dutch/
Article
2024
Automated Speech Audiometry: Can It Work Using Open-Source Pre-Trained Kaldi-NL Automatic Speech Recognition? (2024)Trends in hearing, 28. Araiza-Illan, G., Meyer, L., Truong, K. P. & Başkent, D.https://doi.org/10.1177/23312165241229057Does conversation lead to better searches?: Investigating single-shot and multi-turn spoken searches with children (2024)International Journal of Child-Computer Interaction, 41. Article 100668. Beelen, T., Ordelman, R., Truong, K. P., Evers, V. & Huibers, T.https://doi.org/10.1016/j.ijcci.2024.100668
2023
Natural Language Processing Markers for Psychosis and Other Psychiatric Disorders: Emerging Themes and Research Agenda From a Cross-Linguistic Workshop (2023)Schizophrenia Bulletin, 49(Supplement 2), S86-S92. Corona Hernández, H., Corcoran, C., Achim, A. M., De Boer, J. N., Boerma, T., Brederoo, S. G., Cecchi, G. A., Ciampelli, S., Elvevåg, B., Fusaroli, R., Giordano, S., Hauglid, M., van Hessen, A., Hinzen, W., Homan, P., de Kloet, S. F., Koops, S., Kuperberg, G. R., Maheshwari, K., … Palaniyappan, L.https://doi.org/10.1093/schbul/sbac215Acoustic speech markers for schizophrenia-spectrum disorders: A diagnostic and symptom-recognition tool (2023)Psychological medicine, 53(4), 1302-1312. de Boer, J. N., Voppel, A. E., Brederoo, S. G., Schnack, H. G., Truong, K. P., Wijnen, F. N. K. & Sommer, I. E. C.https://doi.org/10.1017/S0033291721002804
2020
Recognizing hotspots in Brief Eclectic Psychotherapy for PTSD by text and audio mining (2020)European Journal of psychotraumatology, 11(1). Article 1726672. Wiegersma, S., Nijdam, M. J., van Hessen, A. J., Truong, K. P., Veldkamp, B. P. & Olff, M.https://doi.org/10.1080/20008198.2020.1726672
2018
Automatic temporal ranking of children’s engagement levels using multi-modal cues (2018)Computer Speech and Language, 50, 16-39. Kim, J., Truong, K. P. & Evers, V.https://doi.org/10.1016/j.csl.2017.12.005
2017
A word of advice: how to tailor motivational text messages based on behavior change theory to personality and gender (2017)Personal and ubiquitous computing, 21(4), 675-687. de Vries, R. A. J., Truong, K. P., Zaga, C., Li, J. & Evers, V.https://doi.org/10.1007/s00779-017-1025-1
2016
The Geneva Minimalistic Acoustic Parameter Set (GeMAPS) for Voice Research and Affective Computing (2016)IEEE transactions on affective computing, 7(2), 190-202. Eyben, F., Scherer, K., Schuller, B., Sundberg, J., André, E., Busso, C., Devillers, L., Epps, J., Laukka, P., Narayanan, S. & Truong, K. P.https://doi.org/10.1109/TAFFC.2015.2457417
2014
Towards modeling expressed emotions in oral history interviews: Using verbal and nonverbal signals to track personal narratives (2014)Literary and linguistic computing, 29(4), 621-636. Truong, K. P., Westerhof, G. J., Lamers, S. M. A. & de Jong, F. M. G.https://doi.org/10.1093/llc/fqu041
2013
Preface: (to CLIN Journal volume 3) (2013)Computational linguistics in the Netherlands journal, 3, 1-1. Dadvar, M., Hondorp, H., Nijholt, A., Theune, M., Trieschnigg, D. & Truong, K.http://clinjournal.org/sites/default/files/00-preface-CLIN2013.pdfPerceptual evaluation of backchannel strategies for artificial listeners (2013)Autonomous agents and multi-agent systems, 27(2), 235-253. Poppe, R. W., Truong, K. P. & Heylen, D. K. J.https://doi.org/10.1007/s10458-013-9219-z
2012
Speech-based recognition of self-reported and observed emotion in a dimensional space (2012)Speech communication, 54(9), 1049-1063. Truong, K. P., van Leeuwen, D. A. & de Jong, F. M. G.https://doi.org/10.1016/j.specom.2012.04.006
2011
How Agents' Turn-taking Strategies Influence Impressions and Response Behaviors (2011)Presence- teleoperators and virtual environments, 20(5), 412-430. ter Maat, M., Truong, K. P. & Heylen, D. K. J.https://doi.org/10.1162/PRES_a_00064Continuous Interaction with a Virtual Human (2011)Journal on multimodal user interfaces, 4(2), 97-118. Reidsma, D., Salah, A. A., Gevers, T., de Kok, I. A., Neiberg, D., Pammi, S. C., van Straalen, B., Truong, K. P. & van Welbergen, H.https://doi.org/10.1007/s12193-011-0060-x
2009
Comparing different approaches for automatic pronunciation error detection (2009)Speech communication, 51(10), 845-852. Strik, H., Truong, K. P., de Wet, F. & Cucchiarini, C.https://doi.org/10.1016/j.specom.2009.05.007
Chapter
2019
“You Can Do It!” - Crowdsourcing Motivational Speech and Text Messages (2019)In Macrotask Crowdsourcing: Engaging the Crowds to Address Complex Problems (pp. 217-231) (Human–Computer Interaction Series). Springer. de Vries, R. A. J., Truong, K. P., Kim, J. & Evers, V.https://doi.org/10.1007/978-3-030-12334-5_8
2017
Laughter (2017)In The Routledge Handbook of Language and Humor (pp. 340-355) (Routledge Handbooks in Linguistics). Routledge. Trouvain, J. & Truong, K. P.https://www.routledge.com/The-Routledge-Handbook-of-Language-and-Humor/Attardo/p/book/9781138843066
2011
More Than Words: Inference of Socially Relevant Information from Nonverbal Vocal Cues in Speech (2011)In Toward Autonomous, Adaptive, and Context-Aware Multimodal Interfaces. Theoretical and Practical Issues (pp. 23-33) (Lecture Notes in Computer Science; Vol. 6456). Springer. Vinciarelli, A., Salamin, H., Mohammadi, G. & Truong, K. P.https://doi.org/10.1007/978-3-642-18184-9_3
Conference article
2018
Multisensory garments for optimal body-mind awareness in space travel (2018)Proceedings of the International Astronautical Congress, IAC, 2018(October). Neidlinger, K. & Truong, K. P.https://iafastro.directory/iac/archive/browse/IAC-18/B3/IP/44992/
Conference contribution
2024
‘Uhm... Are you sure?’ An Exploratory Study of Trust Indicators in Robot-Directed Child Speech (2024)In Proceedings of the 24th ACM International Conference on Intelligent Virtual Agents, IVA 2024. Article 35. Association for Computing Machinery. Velner, E., Beelen, T., Schadenberg, B., Ordelman, R., Huibers, T., Truong, K. P. & Evers, V.https://doi.org/10.1145/3652988.3673933ICMI 2024 Chairs’ Welcome (2024)In 26th International Conference on Multimodal Interaction, ICMI 2024 (pp. III-V) (ACM International Conference Proceeding Series). ACM Publishing. Hung, H., Oertel, C., Soleymani, M., Chaspari, T., Dibeklioğlu, H., Shukla, J. & Truong, K.Benchmarking and Research Infrastructures: Evaluating Dutch Automatic Speech Recognition (2024)In CLARIN Annual Conference Proceedings (pp. 140-143). Bălan, D. A., Truong, K. P., van den Heuvel, H. & Ordelman, R. J. F.https://www.clarin.eu/sites/default/files/CLARIN2024_ConferenceProceedings_final.pdfA Conversational Robot for Children’s Access to a Cultural Heritage Multimedia Archive (2024)In Advances in Information Retrieval: 46th European Conference on Information Retrieval, ECIR 2024, Glasgow, UK, March 24–28, 2024, Proceedings, Part V (pp. 144–151) (Lecture Notes in Computer Science; Vol. 14612). Springer. Beelen, T., Ordelman, R., Truong, K. P., Evers, V. & Huibers, T.https://doi.org/10.1007/978-3-031-56069-9_11
2023
Children’s Trust in Robots and the Information They Provide (2023)In CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (pp. 1-7). Article 66. ACM Publishing. Beelen, T. H. J., Velner, E., Truong, K. P., Ordelman, R. J. F., Huibers, T. W. C. & Evers, V.https://doi.org/10.1145/3544549.3585801Robot-Supported Information Search: Which Conversational Interaction Style do Children Prefer? (2023)In HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (pp. 466–470). ACM Publishing. Sharma, S., Beelen, T. & Truong, K. P.https://doi.org/10.1145/3568294.3580128Acoustic characteristics of depression in older adults’ speech: The role of covariates (2023)In Proceedings of INTERSPEECH 2023 (pp. 4159-4163). International Speech Communication Association. Mijnders, C., Janse, E., Naarding, P. & Truong, K. P.https://doi.org/10.21437/Interspeech.2023-839Effects of perceived gender on the perceived social function of laughter (2023)In Proceedings of INTERSPEECH 2023 (pp. 1878-1882). International Speech Communication Association. Arts, J. & Truong, K. P.https://doi.org/10.21437/Interspeech.2023-846Laughter in task-based settings: Whom we talk to affects how, when, and how often we laugh (2023)In Proceedings of INTERSPEECH 2023 (pp. 3622-3626). International Speech Communication Association. Branco, C., Trancoso, I., Infante, P. & Truong, K. P.https://doi.org/10.21437/Interspeech.2023-1914
2022
A Child-Friendly Approach to Spoken Conversational Search (2022)In CIKM-WS 2022: Proceedings of the CIKM 2022 Workshops, Atlanta, USA, October 17-21, 2022 (CEUR Workshop Proceedings; Vol. 3318). CEUR. Beelen, T. H. J., Truong, K. P., Ordelman, R. J. F., Velner, E., Evers, V. & Huibers, T. W. C.https://ceur-ws.org/Vol-3318/The Robot That Showed Remorse: Repairing Trust with a Genuine Apology (2022)In Proceedings of the 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN): Social, Asocial, and Antisocial Robots (pp. 260-265). IEEE. Pompe, B. L., Velner, E. & Truong, K. P.https://doi.org/10.1109/RO-MAN53752.2022.9900860Inhalation Noises as Endings of Laughs in Conversational Speech (2022)In Smiling and Laughter across Contexts and the Life-span (SmiLa2022) (pp. 28-29). European Language Resources Association (ELRA). Trouvain, J., Werner, R. & Truong, K. P.http://www.lrec-conf.org/proceedings/lrec2022/workshops/SmiLa/index.html
2021
How Familiarity Influences the Frequency, Temporal Dynamics and Acoustics of Laughter (2021)In 2021 9th International Conference on Affective Computing and Intelligent Interaction (ACII) (pp. 1-8). Jansen, M.-P., Truong, K. P. & Heylen, D. K. J.https://doi.org/10.1109/ACII52823.2021.9597414Let’s talk about it: Spoken conversational search with a robot for children (2021)In CUI@CSCW: Inclusive and Collaborative Child-facing Voice Technologies: A workshop at the virtual ACM CSCW 2021 conference. ACM Publishing. Beelen, T., Velner, E., Ordelman, R., Truong, K. P., Evers, V. & Huibers, T.Give the Body a Voice: Co-design with Profound Intellectual and Multiple Disabilities to Create Multisensory Wearables (2021)In CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (pp. 1). Article 375. ACM SigCHI. Neidlinger, K., Koenderink, S. & Truong, K. P.https://doi.org/10.1145/3411763.3451797Uncanny, sexy, and threatening robots: The online community's attitude to and perceptions of robots varying in humanlikeness and gender (2021)In HRI 2021 - Proceedings of the 2021 ACM/IEEE International Conference on Human-Robot Interaction (pp. 119-128). Article 3444661 (ACM/IEEE International Conference on Human-Robot Interaction). IEEE. Hover, Q. R. M., Velner, E., Beelen, T., Boon, M. & Truong, K. P.https://doi.org/10.1145/3434073.3444661
2020
Introducing MULAI: A Multimodal Database of Laughter during Dyadic Interactions (2020)In Proceedings of the 12th Conference on Language Resources and Evaluation (LREC 2020) (pp. 4333-4342). European Language Resources Association (ELRA). Jansen, M.-P., Truong, K. P., Nazareth, D. S. & Heylen, D. K. J.https://www.aclweb.org/anthology/2020.lrec-1.534/Emobook: A Multimedia Life Story Book App for Reminiscence Intervention (2020)In MobileHCI '20: 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services. Association for Computing Machinery. Catala, A., Nazareth, D. S., Félix, P., Truong, K. P. & Westerhof, G. J.https://doi.org/10.1145/3406324.3410717
2019
Context in Human Emotion Perception for Automatic Affect Detection: A Survey of Audiovisual Databases (2019)In 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII) (pp. 206-212). Article 8925446 (International Conference on Affective Computing and Intelligent Interaction (ACII); Vol. 2019). IEEE. Dudzik, B., Jansen, M.-P., Burger, F., Kaptein, F., Broekens, J., Heylen, D. K. J., Hung, H., Neerincx, M. & Truong, K. P.https://doi.org/10.1109/ACII.2019.8925446MEMOA: Introducing the Multi-Modal Emotional Memories of Older Adults Database (2019)In 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII) (pp. 697-703). Article 8925462 (International Conference on Affective Computing and Intelligent Interaction (ACII); Vol. 2013). IEEE. Nazareth, D. S., Jansen, M.-P., Truong, K. P., Westerhof, G. J. & Heylen, D.https://doi.org/10.1109/ACII.2019.8925462Real-time pain detection in facial expressions for health robotics (2019)In 2019 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) (pp. 277-283). Article 8925192. IEEE. Dai, L., Broekens, J. & Truong, K. P.https://doi.org/10.1109/ACIIW.2019.8925192Babbelbord: A personalized conversational game for people with dementia. (2019)In Dementia Lab 2019. Making Design Work: Engaging with Dementia in Context: 4th Conference, D-Lab 2019, Eindhoven, The Netherlands, October 21–22, 2019, Proceedings (pp. 169-173) (Communications in Computer and Information Science; Vol. 1117). Nazareth, D. S., Burghardt, C., Capra, A., Cristoforetti, P., Lam, W., van Waterschoot, J. B., Westerhof, G. J. & Truong, K. P.https://doi.org/10.1007/978-3-030-33540-3_18Emotional prosthesis for animating awe through performative biofeedback (2019)In ISWC '19: Proceedings of the 2019 International Symposium on Wearable Computers (pp. 312-317). ACM Publishing. Neidlinger, K., Toussaint, L., Dertien, E., Truong, K. P., Hermens, H. & Evers, V.https://doi.org/10.1145/3341163.3346939An acoustic and lexical analysis of emotional valence in spontaneous speech: Autobiographical memory recall in older adults (2019)In Proceedings Interspeech 2019 (pp. 3287-3291). International Speech Communication Association. Nazareth, D. S., Tournier, E., Leimkötter, S., Janse, E., Heylen, D., Westerhof, G. J. & Truong, K. P.https://doi.org/10.21437/Interspeech.2019-1823Towards an annotation scheme for complex laughter in speech corpora (2019)In Interspeech 2019 (pp. 529-533). ISCA. Truong, K. P., Trouvain, J. & Jansen, M.-P.https://doi.org/10.21437/Interspeech.2019-1557
2018
Nanogami:: The microbiome expanded. Speak your truth. Listen to your gut (2018)In ISWC'18: Proceedings of the 2018 ACM International Symposium on Wearable Computers (pp. 295-300). Association for Computing Machinery. Neidlinger, K., Willson, C., Truong, K. P., Hermens, H. & Evers, V.https://doi.org/10.1145/3267242.3267296The MULAI Corpus: Multimodal Recordings of Spontaneous Laughter in Dyadic Interaction (2018)In Proceedings of Laughter Workshop 2018 (pp. 58-63). Jansen, M.-P., Heylen, D. K. J., Truong, K. P., Nazareth, D. S. & Englebienne, G.A Dyadic Conversation Dataset on Moral Emotions (2018)In 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) (pp. 687-691). IEEE. Heron, L., Kim, J., Lee, M., El Haddad, K., Dupont, S., Dutoit, T. & Truong, K. P.https://doi.org/10.1109/FG.2018.00108Learning spectro-temporal features with 3D CNNs for speech emotion recognition (2018)In 2017 7th International Conference on Affective Computing and Intelligent Interaction, ACII 2017 (pp. 383-388). IEEE. Kim, J., Truong, K. P., Englebienne, G. & Evers, V.https://doi.org/10.1109/ACII.2017.8273628
2017
A Simple Nod of the Head: The Effect of Minimal Robot Movements on Children's Perception of a Low-Anthropomorphic Robot (2017)In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (pp. 336-341). Association for Computing Machinery. Zaga, C., de Vries, R. A. J., Li, J., Truong, K. P. & Evers, V.https://doi.org/10.1145/3025453.3025995Experts Get Me Started, Peers Keep Me Going: Comparing Crowd- versus Expert-Designed Motivational Text Messages for Exercise Behavior Change (2017)In Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare (pp. 155-162) (PervasiveHealth: Pervasive Computing Technologies for Healthcare). Association for Computing Machinery. De Vries, R. A. J., Zaga, C., Bayer, F., Drossaert, C. H. C., Truong, K. P. & Evers, V.https://doi.org/10.1145/3154862.3154875AWElectric: that gave me goosebumps, did you feel it too? (2017)In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (TEI'17) (pp. 315-324). Association for Computing Machinery. Neidlinger, K. L., Truong, K. P., Telfair, C., Feijs, L., Dertien, E. C. & Evers, V.https://doi.org/10.1145/3024969.3025004Bridge the gap of codification and personalization strategies: Gain and lost of knowledge management of postgraduate student project meetings (2017)In Proceedings of the 9th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management. Volume 3 KMIS (pp. 247-254). SCITEPRESS. Dai, X., Oberhagemann, M., Truong, K. P. & Van Der Velde, F.https://doi.org/10.5220/0006584602470254Deep Temporal Models using Identity Skip-Connections for Speech Emotion Recognition (2017)In MM '17: Proceedings of the 2017 ACM on Multimedia Conference (pp. 1006-1013). Association for Computing Machinery. Kim, J., Englebienne, G., Truong, K. P. & Evers, V.https://doi.org/10.1145/3123266.3123353Towards Speech Emotion Recognition "in the wild" using Aggregated Corpora and Deep Multi-Task Learning (2017)In Interspeech 2017: 20-24 August 2017, Stockholm (pp. 1113-1117). International Speech Communication Association. Kim, J., Englebienne, G., Truong, K. P. & Evers, V.https://doi.org/10.21437/Interspeech.2017
2016
ASSP4MI2016: 2nd international workshop on advancements in social signal processing for multimodal interaction (workshop summary) (2016)In ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal Interaction (pp. 591-592). Association for Computing Machinery. Truong, K. P., Heylen, D., Nishida, T. & Chetouani, M.https://doi.org/10.1145/2993148.3007629Multimodal Detection of Engagement in Groups of Children Using Rank Learning (2016)In Human Behavior Understanding: 7th International Workshop, HBU 2016, Amsterdam, The Netherlands, October 16, 2016, Proceedings (pp. 35-48) (Lecture Notes in Computer Science; Vol. 9997). Springer. Kim, J., Truong, K. P., Charisi, V., Zaga, C., Evers, V. & Chetouani, M.https://doi.org/10.1007/978-3-319-46843-3_3Automatic analysis of children’s engagement using interactional network features (2016)In Proceedings of the Workshop on Child Computer Interaction (WOCCI 2016) (pp. 23-28). ISCA. Kim, J. & Truong, K. P.https://doi.org/10.21437/WOCCI.2016-4Automatic detection of children's engagement using non-verbal features and ordinal learning (2016)In Proceedings of the Workshop on Child Computer Interaction (WOCCI 2016) (pp. 29-34). ISCA. Kim, J., Truong, K. P. & Evers, V.https://doi.org/10.21437/WOCCI.2016-5Help-Giving Robot Behaviors in Child-Robot Games: Exploring Semantic Free Utterances (2016)In 11th ACM/IEEE International Conference on Human Robot Interaction (HRI 2016) (pp. 541-542). IEEE. Zaga, C., De Vries, R. A. J., Spenkelink, S. J., Truong, K. P. & Evers, V.https://doi.org/10.1109/HRI.2016.7451846
2015
The Effect of a Robot's Social Character on Children Task Engagement: Peer Versus Tutor (2015)In Social Robotics: 7th International Conference, ICSR 2015, Paris, France, October 26-30, 2015, Proceedings (pp. 704- 713) (Lecture Notes in Computer Science; Vol. 9388). Springer. Zaga, C., Lohse, M., Truong, K. P. & Evers, V.https://doi.org/10.1007/978-3-319-25554-5_70A database for analysis of speech under physical stress: detection of exercise intensity while running and talking (2015)In Proceedings of Interspeech (pp. 3705-3709) (Proceedings of Interspeech). International Speech Communication Association. Truong, K. P., Nieuwenhuys, A., Beek, P. & Evers, V.http://www.isca-speech.org/archive/interspeech_2015/papers/i15_3705.pdfDynamics of social positioning patterns in group-robot interactions (2015)In Proceedings of the 24th IEEE International Sumposium on Robot and Human Interactive Communication (RoMan 2015) (pp. 394-399). IEEE. Vroon, J., Joosse, M., Lohse, M., Kolkmeier, J., Kim, J., Truong, K., Englebienne, G., Heylen, D. & Evers, V.https://doi.org/10.1109/ROMAN.2015.7333633Prosodic characteristics of read speech before and after treadmill running (2015)In Proceedings of Interspeech (pp. 3700-3704) (Proceedings of Interspeech). International Speech Communication Association. Trouvain, J. & Truong, K. P.http://www.isca-speech.org/archive/interspeech_2015/papers/i15_3700.pdfSelecting the right robot: Influence of user attitude, robot sociability and embodiment on user preferences (2015)In Proceedings of the 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 2015) (pp. 682-687). IEEE. Ligthart, M. & Truong, K. P.https://doi.org/10.1109/ROMAN.2015.7333598Vocal turn-taking patterns in groups of children performing collaborative tasks: an exploratory study (2015)In INTERSPEECH 2015: 16th Annual Conference of the International Speech Communication Association (pp. 1645-1649) (INTERSPEECH : Annual Conference of the International Speech Communication Association; Vol. 2015). International Speech Communication Association. Kim, J., Truong, K. P., Charisi, V., Zaga, C., Lohse, M., Heylen, D. & Evers, V.http://www.isca-speech.org/archive/interspeech_2015/i15_1645.html
2014
An annotation scheme for sighs in spontaneous dialogue (2014)In Proceedings of the 15th Annual Conference of the International Speech Communication Association (INTERSPEECH 2014) (pp. 228-232). International Speech Communication Association. Truong, K. P., Westerhof, G. J., de Jong, F. M. G. & Heylen, D. K. J.http://www.isca-speech.org/archive/interspeech_2014/i14_0228.htmlInvestigating prosodic relations between initiating and responding laughs (2014)In Proceedings of the 15th Annual Conference of the International Speech Communication Association (INTERSPEECH 2014) (pp. 1811-1815). International Speech Communication Association. Truong, K. P. & Trouvain, J.http://www.isca-speech.org/archive/interspeech_2014/i14_1811.htmlApplying prosodic speech features in mental health care: An exploratory study in a life-review intervention for depression (2014)In Proceedings of the ACL Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality (pp. 61-68). Association for Computational Linguistics (ACL). Lamers, S. M. A., Truong, K. P., Steunenberg, B., de Jong, F. & Westerhof, G. J.https://doi.org/10.3115/v1/W14-3208Exploring child-robot engagement in a collaborative task (2014)In Proceedings of the Child-Robot Interaction Workshop: Social Bonding, Learning and Ethics. Instituto de Engenharia de Sistemas e Computadores, Investigacao e Desenvolvimento em Lisboa (INESC-ID). Zaga, C., Truong, K. P., Lohse, M. & Evers, V.http://gaips.inesc-id.pt/~tribeiro/idc2014/assets/zaga_truong_lohse_evers_exploring_child_robot_engagement_in_a_collaborative_task_final_version.pdf
2013
Classification of cooperative and competitive overlaps in speech using cues from the context, overlapper, and overlappee (2013)In Proceedings of the 14th Annual Conference of the International Speech Communication Association, Interspeech 2013 (pp. 1404-1408). International Speech Communication Association. Truong, K. P.http://www.isca-speech.org/archive/interspeech_2013/i13_1404.htmlDetection of nonverbal vocalizations using Gaussian Mixture Models: looking for fillers and laughter in conversational speech (2013)In Proceedings of the 14th Annual Conference of the International Speech Communication Association, Interspeech 2013 (pp. 163-167). International Speech Communication Association. Krikke, T. F. & Truong, K. P.http://www.isca-speech.org/archive/interspeech_2013/i13_0163.htmlEmotional expression in oral history narratives: comparing results of automated verbal and nonverbal analyses (2013)In Proceedings of the Workshop on Computational Models of Narrative, CMN 2013 (pp. 310-314) (Open Access Series in Informatics (OASIcs); Vol. 32). Dagstuhl. Truong, K. P., Westerhof, G. J., Lamers, S. M. A., de Jong, F. & Sools, A.https://doi.org/10.4230/OASIcs.CMN.2013.310
2012
Acoustic, Morphological, and Functional Aspects of `yeah/ja' in Dutch, English and German (2012)In Proceedings of the Interdisciplinary Workshop on Feedback Behaviors (pp. 77-80). University of Texas. Trouvain, J. & Truong, K. P.http://www.cs.utep.edu/feedback/pdf/P21trouvain.pdfConvergence of laughter in conversational speech: effects of quantity, temporal alignment and imitation (2012)In Proceedings of the International Symposium on Imitation and Convergence in Speech, ISICS 2012 (pp. 37-38). Laboratoire Parole et Langage, CNRS. Trouvain, J. & Truong, K. P.http://isics2012.sciencesconf.org/conference/isics2012/pages/booklet_2.pdfMeasuring prosodic alignment in cooperative task-based conversations (2012)In Proceedings of the 13th Annual Conference of the International Speech Communication Association (Interspeech 2012) (pp. 843-846). International Speech Communication Association. Truong, K. P. & Heylen, D. K. J.http://www.isca-speech.org/archive/interspeech_2012/i12_0843.htmlOn the acoustics of overlapping laughter in conversational speech (2012)In Proceedings of the 13th Annual Conference of the International Speech Communication Association (Interspeech 2012) (pp. 851-854). International Speech Communication Association. Truong, K. P. & Trouvain, J.http://www.isca-speech.org/archive/interspeech_2012/i12_0851.htmlComparing non-verbal vocalisations in conversational speech corpora (2012)In Proceedings of the 4th International Workshop on Corpora for Research on Emotion Sentiment and Social Signals (ES3 2012) (pp. 36-39). European Language Resources Association (ELRA). Trouvain, J. & Truong, K. P.http://www.lrec-conf.org/proceedings/lrec2012/workshops/18.Proceedings%20ES3%202012.pdfLaughter annotations in conversational speech corpora - possibilities and limitations for phonetic analysis (2012)In Proceedings of the 4th International Workshop on Corpora for Research on Emotion Sentiment and Social Signals (ES3 2012) (pp. 20-24). European Language Resources Association (ELRA). Truong, K. P. & Trouvain, J.http://www.lrec-conf.org/proceedings/lrec2012/workshops/18.Proceedings%20ES3%202012.pdf
2011
Towards visual and vocal mimicry recognition in human-human interactions (2011)In IEEE SMC 2011: 2011 IEEE International Conference on Systems, Man and Cybernetics October 9-12, 2011 (pp. 367-373). IEEE. Sun, X., Truong, K. P., Pantic, M. & Nijholt, A.https://doi.org/10.1109/ICSMC.2011.6083693Automatic Understanding of Affective and Social Signals by Multimodal Mimicry Recognition (2011)In Proceedings 4th International Conference on Affective Computing and Intelligent Interaction (ACII 2011) (pp. 289-296) (Lecture Notes in Computer Science; Vol. 6975). Springer. Sun, X., Truong, K. P., Nijholt, A. & Pantic, M.https://doi.org/10.1007/978-3-642-24571-8_32Backchannels: Quantity, Type and Timing Matters (2011)In International Conference on Intelligent Virtual Agents (IVA 2011) (pp. 228-239) (Lecture Notes in Computer Science; Vol. 6895). Springer. Poppe, R. W., Truong, K. P. & Heylen, D. K. J.https://doi.org/10.1007/978-3-642-23974-8_25Automatic visual mimicry expression analysis in interpersonal interaction (2011)In IEEE Computer Vision and Pattern Recognition Workshops, CVPRW 2011 (pp. 40-46). IEEE. Sun, X., Nijholt, A., Truong, K. P. & Pantic, M.https://doi.org/10.1109/CVPRW.2011.5981812A Multimodal Analysis of Vocal and Visual Backchannels in Spontaneous Dialogs (2011)In Proceedings of Interspeech 2011 (pp. 2973-2976). International Speech Communication Association. Truong, K. P., Poppe, R. W., de Kok, I. A. & Heylen, D. K. J.http://www.isca-speech.org/archive/interspeech_2011/i11_2973.htmlOnline Detection Of Vocal Listener Responses With Maximum Latency Constraints (2011)In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) (pp. 5836-5839). IEEE. Neiberg, D. & Truong, K. P.https://doi.org/10.1109/ICASSP.2011.5947688
2010
The Organisation of Floor in Meetings and the Relation with Speaker Addressee Patterns (2010)In Proceedings of the 2nd International Workshop on Social Signal Processing, SSPW '10 (pp. 35-40). Association for Computing Machinery. op den Akker, H. J. A., Theune, M., Truong, K. P. & de Kok, I. A.https://doi.org/10.1145/1878116.1878129A rule-based backchannel prediction model using pitch and pause information (2010)In Proceedings of Interspeech 2010 (pp. 3058-3061). International Speech Communication Association. Truong, K. P., Poppe, R. W. & Heylen, D. K. J.Backchannel Strategies for Artificial Listeners (2010)In International Conference on Intelligent Virtual Agents (IVA) (pp. 146-158) (Lecture Notes in Computer Science; Vol. 6356). Springer. Poppe, R. W., Truong, K. P., Reidsma, D. & Heylen, D. K. J.https://doi.org/10.1007/978-3-642-15892-6_16Disambiguating the functions of conversational sounds with prosody: the case of 'yeah' (2010)In Proceedings of Interspeech 2010 (pp. 2554-2557). International Speech Communication Association. Truong, K. P. & Heylen, D. K. J.How turn-taking strategies influence users’ impressions of an agent (2010)In Proceedings of the International Conference on Intelligent Virtual Agents (IVA) (pp. 441-453) (Lecture Notes in Computer Science; Vol. 6356). Springer. ter Maat, M., Truong, K. P. & Heylen, D. K. J.https://doi.org/10.1007/978-3-642-15892-6_48Towards affective state modeling in narrative and conversational settings (2010)In Proceedings of Interspeech 2010 (pp. 490-493). International Speech Communication Association. Jochems, B., Larson, M., Ordelman, R. J. F., Poppe, R. W. & Truong, K. P.Continuous Interaction with a Virtual Human (2010)In Proceedings of the 6th International Summer Workshop on Multimodal Interfaces (eNTERFACE'10) (pp. 24-39). University of Amsterdam. Reidsma, D., Truong, K. P., van Welbergen, H., Neiberg, D., Pammi, S., de Kok, I. A. & van Straalen, B.http://enterface10.science.uva.nlAutomatic Role Recognition Based on Conversational and Prosodic Behaviour (2010)In Proceedings of the ACM International Conference on Multimedia (pp. 847-850). Association for Computing Machinery. Salamin, H., Truong, K. P. & Mohammadi, G.https://doi.org/10.1145/1873951.1874094
2009
Arousal and Valence Prediction in Spontaneous Emotional Speech: Felt versus Perceived Emotion (2009)In Proceedings of the 10th Annual Conference of the International Speech Communication Association (Interspeech 2009) (pp. 2027-2030) (Publications Speech Processing Group, Brno University of Technology). International Speech Communication Association. Truong, K. P., van Leeuwen, D. A., Neerincx, M. A. & de Jong, F. M. G.
2008
Decision-Level Fusion for Audio-Visual Laughter Detection (2008)In 5th International Workshop, MLMI 2008 (pp. 137-148). Article 10.1007/978-3-540-85853-9_13 (Lecture Notes on Computer Science; Vol. 5237/2008). Springer. Reuderink, B., Poel, M., Truong, K. P., Poppe, R. W. & Pantic, M.https://doi.org/10.1007/978-3-540-85853-9_13
Paper
2022
Designing Conversational Robots with Children during the Pandemic (2022)[Contribution to conference › Paper] 6th International and Interdisciplinary Perspectives on Children & Recommender and Information Retrieval Systems, KidRec 2022. Beelen, T., Velner, E., Ordelman, R., Truong, K. P., Evers, V. & Huibers, T.https://doi.org/10.48550/arXiv.2205.11300Exploring audio-based stylistic variation in podcasts (2022)[Contribution to conference › Paper] 23rd INTERSPEECH 2022. Martikainen, K., Karlgren, J. & Truong, K. P.https://doi.org/10.21437/Interspeech.2022-10871
2021
Does your robot know? Enhancing children’s information retrieval through spoken conversation with responsible robots (2021)[Contribution to conference › Paper] IR for Children, IR4C 2021. Beelen, T., Velner, E., Ordelman, R., Truong, K. P., Evers, V. & Huibers, T.https://doi.org/10.48550/arXiv.2106.07931
2017
Exploring Moral Conflicts in Speech: Multidisciplinary Analysis of Affect and Stress (2017)[Contribution to conference › Paper] 7th International Conference on Affective Computing and Intelligent Interaction, ACII 2017. Lee, M., Kim, J., Truong, K., de Kort, Y., Beute, F. & IJsselsteijn, W.Learning spectral-temporal features with 3D CNNs for speech emotion recognition (2017)[Contribution to conference › Paper] 7th International Conference on Affective Computing and Intelligent Interaction, ACII 2017. Kim, J., Truong, K., Englebienne, G. & Evers, V.
2016
Crowd-Designed Motivation: Motivational Messages for Exercise Adherence Based on Behavior Change Theory (2016)[Contribution to conference › Paper] 34th Annual CHI Conference on Human Factors in Computing Systems, CHI 2016. de Vries, R. A. J., Truong, K. P., Kwint, S., Drossaert, C. H. C. & Evers, V.https://doi.org/10.1145/2858036.2858229Crowd-designed motivation: combining personality and the Transtheoretical Model (2016)[Contribution to conference › Paper] 11th International Conference on Persuasive Technology, PERSUASIVE 2016. de Vries, R. A. J., Truong, K. P. & Evers, V.https://doi.org/10.1007/978-3-319-31510-2_4
2015
TERESA: a socially intelligent semi-autonomous telepresence system (2015)[Contribution to conference › Paper] Workshop on Machine Learning for Social Robotics 2015. Shiarlis, K., Messias, J., van Someren, M., Whiteson, S., Kim, J., Vroon, J. H., Englebienne, G., Truong, K. P., Pérez-Higueras, N., Pérez-Hurtado, I., Ramon-Vigo, R., Caballero, F., Merino, L., Shen, J., Petridis, S., Pantic, M., Hedman, L., Scherlund, M., Koster, R. & Michel, H.https://staff.fnwi.uva.nl/s.a.whiteson/Shimon_Whiteson/ICRA_files/teresa_icra15ws-crc.pdf
2013
Exploring sequences of speech and laughter activity using visualisations of conversations (2013)[Contribution to conference › Paper] Workshop on Affective Social Speech Signals 2013. Trouvain, J. & Truong, K. P.
PhD Thesis - Research UT, graduation UT
2021
The Design of Robothings: Non-Anthropomorphic and Non-Verbal Robots to Promote Children’s Collaboration Through Play (2021)[Thesis › PhD Thesis - Research UT, graduation UT]. University of Twente. Zaga, C.https://doi.org/10.3990/1.9789036551380
2018
Theory-Based and Tailor-Made: Motivational Messages for Behavior Change Technology (2018)[Thesis › PhD Thesis - Research UT, graduation UT]. University of Twente. de Vries, R. A. J.https://doi.org/10.3990/1.9789036546492Automatic recognition of engagement and emotion in a group of children (2018)[Thesis › PhD Thesis - Research UT, graduation UT]. University of Twente. Kim, J.https://doi.org/10.3990/1.9789036545839
2009
How does real affect affect affect recognition in speech? (2009)[Thesis › PhD Thesis - Research UT, graduation UT]. University of Twente. Truong, K. P.https://doi.org/10.3990/1.9789036528801
Poster
2025
Benchmarking State-of-the-Art Automatic Speech Recognition systems for Dutch (2025)[Contribution to conference › Poster] 3rd Dutch Speech Tech Day. Bălan, D. A., Truong, K. P. & Ordelman, R. J. F.
Preprint
2023
Automated speech audiometry: Can it work using open-source pre-trained Kaldi-NL automatic speech recognition? (2023)[Working paper › Preprint]. ArXiv.org. Araiza-Illan, G., Meyer, L., Truong, K. P. & Baskent, D.https://doi.org/10.48550/arXiv.2312.12269
2021
Speaking of Trust - Speech as a Measure of Trust (2021)[Working paper › Preprint]. ArXiv.org. Velner, E., Truong, K. P. & Evers, V.https://doi.org/10.48550/arXiv.2104.05340
2017
Towards Speech Emotion Recognition "in the wild" using Aggregated Corpora and Deep Multi-Task Learning (2017)[Working paper › Preprint]. Kim, J., Englebienne, G., Truong, K. P. & Evers, V.