profile
Roeland Ordelman is senior researcher Multimedi
a Retrieval at University of Twente (PhD, 2003), manager R&D at the Netherlands Institute for Sound and Vision and founder of a start-up company for audio search technology, Cross Media Interaction (X-MI).
The main focus of his work is on deploying state-of-the-art multimedia access technology in real-life application scenarios. The aim is to enhance the exploitability of the large volumes of audiovisual content becoming available for various types of user groups such as professional archivists, broadcast professionals, researchers, and home users.
Recent projects are among others AXES (Access to Audiovisual Archives), LiWA (internetarchiving), Verteld Verleden (distributed access to Oral History) and COMMIT (rich speech retrieval).
publications
Jump to: 2024 | 2023 | 2022 | 2021 | 2019 | 2018 | 2017 | 2016 | 2015 | 2014 | 2013 | 2012 | 2011
2024
Benchmarking and Research Infrastructures: Evaluating Dutch Automatic Speech Recognition (2024)In CLARIN Annual Conference Proceedings (pp. 140-143). Bălan, D. A., Truong, K. P., van den Heuvel, H. & Ordelman, R. J. F.https://www.clarin.eu/sites/default/files/CLARIN2024_ConferenceProceedings_final.pdfDoes conversation lead to better searches?: Investigating single-shot and multi-turn spoken searches with children (2024)International Journal of Child-Computer Interaction, 41. Article 100668. Beelen, T., Ordelman, R., Truong, K. P., Evers, V. & Huibers, T.https://doi.org/10.1016/j.ijcci.2024.100668Evaluating the State-of-the-Art Automatic Speech Recognition systems for Dutch (2024)[Contribution to conference › Abstract] 34th Meeting of Computational Linguistics in The Netherlands, CLIN 2024. Bălan, D. A., Ordelman, R. J. F. & Truong, K. P.https://clin34.leidenuniv.nl/abstracts/evaluating-the-state-of-the-art-automatic-speech-recognition-systems-for-dutch/A Systematic Benchmark for Dutch Automatic Speech Recognition (2024)[Contribution to conference › Poster] CLARIAH Annual Conference 2024. Bălan, D. A., Ordelman, R. J. F. & van den Heuvel, H.A Conversational Robot for Children’s Access to a Cultural Heritage Multimedia Archive (2024)In Advances in Information Retrieval: 46th European Conference on Information Retrieval, ECIR 2024, Glasgow, UK, March 24–28, 2024, Proceedings, Part V (pp. 144–151) (Lecture Notes in Computer Science; Vol. 14612). Springer. Beelen, T., Ordelman, R., Truong, K. P., Evers, V. & Huibers, T.https://doi.org/10.1007/978-3-031-56069-9_11
2023
Children’s Trust in Robots and the Information They Provide (2023)In CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (pp. 1-7). Article 66. ACM Publishing. Beelen, T. H. J., Velner, E., Truong, K. P., Ordelman, R. J. F., Huibers, T. W. C. & Evers, V.https://doi.org/10.1145/3544549.3585801
2022
A Child-Friendly Approach to Spoken Conversational Search (2022)In CIKM-WS 2022: Proceedings of the CIKM 2022 Workshops, Atlanta, USA, October 17-21, 2022 (CEUR Workshop Proceedings; Vol. 3318). CEUR. Beelen, T. H. J., Truong, K. P., Ordelman, R. J. F., Velner, E., Evers, V. & Huibers, T. W. C.https://ceur-ws.org/Vol-3318/Data Stories in CLARIAH — Developing a Research Infrastructure for Storytelling with Heritage and Culture Data (2022)[Dataset Types › Dataset]. Zenodo. Ordelman, R., Sanders, W., Zijdeman, R., Klein, R., Noordegraaf, J., Van Gorp, J., Wigham, M. & Windhouwer, M.https://doi.org/10.5281/zenodo.6597109Designing Conversational Robots with Children during the Pandemic (2022)[Contribution to conference › Paper] 6th International and Interdisciplinary Perspectives on Children & Recommender and Information Retrieval Systems, KidRec 2022. Beelen, T., Velner, E., Ordelman, R., Truong, K. P., Evers, V. & Huibers, T.https://doi.org/10.48550/arXiv.2205.11300Data Stories in CLARIAH – Developing a Research Infrastructure for Storytelling with Heritage and Culture Data (2022)[Contribution to conference › Abstract] DARIAH Annual Event 2022. Ordelman, R., Sanders, W., Zijdeman, R. L., Klein, R., Noordegraaf, J., van Gorp, J., Wigham, M. & Windhouwer, M.
2021
Let’s talk about it: Spoken conversational search with a robot for children (2021)In CUI@CSCW: Inclusive and Collaborative Child-facing Voice Technologies: A workshop at the virtual ACM CSCW 2021 conference. ACM Publishing. Beelen, T., Velner, E., Ordelman, R., Truong, K. P., Evers, V. & Huibers, T.Does your robot know? Enhancing children’s information retrieval through spoken conversation with responsible robots (2021)[Contribution to conference › Paper] IR for Children, IR4C 2021. Beelen, T., Velner, E., Ordelman, R., Truong, K. P., Evers, V. & Huibers, T.https://doi.org/10.48550/arXiv.2106.07931Automatic Annotations and Enrichments for Audiovisual Archives (2021)In Proceedings of the 13th International Conference on Agents and Artificial Intelligence - Volume 1: ARTIDIGH (pp. 633-640). SCITEPRESS. Noord, N. V., Olesen, C., Ordelman, R. & Noordegraaf, J.https://doi.org/10.5220/0010387706330640
2019
The CLARIAH Media Suite: A Hybrid Approach to System Design in the Humanities (2019)In CHIIR 2019 - Proceedings of the 2019 Conference on Human Information Interaction and Retrieval (pp. 373-377). ACM Siggraph. Melgar-Estrada, L., Koolen, M., Beelen, K., Huurdeman, H., Wigham, M., Martínez-Ortíz, C., Blom, J. & Ordelman, R.https://doi.org/10.1145/3295750.3298918Jupyter Notebooks for Generous Archive Interfaces (2019)In 2018 IEEE International Conference on Big Data (Big Data) (pp. 2766-2774). Article 8622203. Wigham, M., Melgar Estrada, L. & Ordelman, R. J. F.https://doi.org/10.1109/BigData.2018.8622203
2018
Media Suite: Unlocking Archives for Mixed Media Scholarly Research (2018)In CLARIN 2018 Annual Conference (pp. 21-25). Ordelman, R. J. F., Melgar Estrada, L., Martínez-Ortíz, C. & Noordegraaf, J.https://office.clarin.eu/v/CE-2018-1292-CLARIN2018_ConferenceProceedings.pdfSpeech Recognition and Scholarly Research: Usability and Sustainability (2018)In CLARIN 2018 Annual Conference (pp. 163-168). Ordelman, R. J. F. & van Hessen, A. J.https://office.clarin.eu/v/CE-2018-1292-CLARIN2018_ConferenceProceedings.pdfChallenges in Enabling Mixed Media Scholarly Research with Multi-media Data in a Sustainable Infrastructure (2018)In Digital Humanities 2018 Conference. Ordelman, R., Martínez-Ortíz, C., Melgar Estrada, L., Koolen, M., Blom, J., Melder, W., van Gorp, J., De Boer, V., Karavellas, T., Aroyo, L., Poell, T., Karrouche, N., Baaren, E., Wassenaar, J., Inel, O. & Noordegraaf, J.https://dh2018.adho.org/en/challenges-in-enabling-mixed-media-scholarly-research-with-multi-media-data-in-a-sustainable-infrastructure/
2017
Multimodal video-to-video linking: Turning to the crowd for insight and evaluation (2017)In Multimedia Modeling: Proceedings of the 23rd International Conference on Multimedia Modeling, MMM 2017 (pp. 280-292) (Lecture Notes in Computer Science; Vol. 10133). Springer. Amsaleg, L., Eskevich, M., Guðmundsson, G. Þ., Larson, M., Aly, R., Gurrin, C., Jónsson, B. Þ., Sabetghadam, S., Jones, G. J. F., Satoh, S., Ordelman, R. J. F. & Huet, B.https://doi.org/10.1007/978-3-319-51814-5_24TREC video retrieval evaluation TRECVID 2017 (2017)[Contribution to conference › Paper] 17th annual TREC Video Retrieval Evaluation, TRECVID 2017. Awad, G., Soboroff, I., Butt, A., Ellis, A., Dimmick, D., Fiscus, J., Joy, D., Michel, M., Delgado, A., Smeaton, A., Kraaij, W., Quénot, G., Ordelman, R., Eskevich, M., Jones, G., Huet, B., Strassel, S. & Li, X.Trecvid 2017: Evaluating ad-hoc and instance video search, events detection, video captioning and hyperlinking (2017)In Proceedings of TRECVID. Awad, G., Butt, A. A., Fiscus, J., Joy, D., Delgado, A., Michel, M., Smeaton, A. F., Graham, Y., Kraaij, W., Quénot, G., Ordelman, R. J. F., Jones, G. J. F. & Huet, B.Video hyperlinking (LNK) TRECVID 2017 (2017)[Contribution to conference › Paper] 17th annual TREC Video Retrieval Evaluation, TRECVID 2017. Eskevich, M., Ordelman, R., Jones, G. J. F. & Huet, B.
2016
Evaluating Unsupervised Thesaurus-based Labeling of Audiovisual Content in an Archive Production Environment (2016)International journal on digital libraries, 17(3), 189-201. de Boer, V., Ordelman, R. J. F. & Schuurman, J.https://doi.org/10.1007/s00799-016-0182-6Developing Benchmarks: The Importance of the Process and New Paradigms (2016)In MMCommons '16: Proceedings of the 2016 ACM Workshop on Multimedia COMMONS. ACM Publishing. Ordelman, R. J. F.https://doi.org/10.1145/2983554.2983562Pursuing a moving target: Iterative use of benchmarking of a task to understand the task (2016)CEUR workshop proceedings, 1739. Eskevich, M., Jones, G. J. F., Aly, R., Ordelman, R. & Huet, B.TREC video retrieval evaluation (2016)[Contribution to conference › Paper] TREC Video Retrieval Evaluation, TRECVID 2016. Awad, G., Smeaton, A., Soboroff, I., Kraaij, W., Ellis, A., Quénot, G., Dimmick, D., Ordelman, R., Aly, R., Eskevich, M., Larson, M., Jones, G., Fiscus, J., Huet, B., Joy, D., Ritter, M., Michel, M., Strassel, S., Delgado, A. & Li, X.Video hyperlinking (LNK) TRECVID 2016 (2016)[Contribution to conference › Paper] TREC Video Retrieval Evaluation, TRECVID 2016. Eskevich, M., Larson, M., Aly, R., Ordelman, R., Jones, G. J. F. & Huet, B.
2015
Convenient Discovery of Archived Video Using Audiovisual Hyperlinking (2015)In Proceedings of the Third Edition Workshop on Speech, Language & Audio in Multimedia (SLAM 2015) (pp. 23-26). Association for Computing Machinery. Ordelman, R. J. F., Aly, R., Eskevich, M., Huet, B. & Jones, G. J. F.https://doi.org/10.1145/2802558.2814652Overview of the 2015 Workshop on Speech, Language and Audio in Multimedia (2015)In Proceedings of the 23rd ACM International Conference on Multimedia (MM 2015) (pp. 1347-1348). Association for Computing Machinery. Gravier, G., Jones, G. J. F., Larson, M. & Ordelman, R. J. F.https://doi.org/10.1145/2733373.2806414Practice-Oriented Evaluation of Unsupervised Labeling of Audiovisual Content in an Archive Production Environment (2015)In Research and Advanced Technology for Digital Libraries, Proceedings of the 19th International Conference on Theory and Practice of Digital Libraries, TPDL 2015 (pp. 43-55) (Lecture Notes in Computer Science; Vol. 9316). Springer. de Boer, V., Ordelman, R. J. F. & Schuurman, J.https://doi.org/10.1007/978-3-319-24592-8_4SAVA at MediaEval 2015: Search and Anchoring in Video Archives (2015)In Working Notes Proceedings of the MediaEval 2015 Workshop (pp. 11). CEUR. Eskevich, M., Aly, R., Ordelman, R. J. F., Racca, D. N., Chen, S. & Jones, G. J. F.http://ceur-ws.org/Vol-1436/Paper11.pdfDefining and Evaluating Video Hyperlinking for Navigating Multimedia Archives (2015)In Proceedings of the 24th International Conference on World Wide Web, WWW 2015 Companion (pp. 727-732). International World Wide Web Conferences Steering Committee. Ordelman, R. J. F., Eskevich, M., Aly, R., Huet, B. & Jones, G. J. F.https://doi.org/10.1145/2740908.2742915Exploiting program guides for contextualisation (2015)In 2015 Digital Heritage International Congress, Digital Heritage 2015 (pp. 161-164). Article 7419477. IEEE. Baltussen, L. B., Karavellas, T. & Ordelman, R. J. F.https://doi.org/10.1109/DigitalHeritage.2015.7419477
2014
User perspectives on semantic linking in the audio domain (2014)In Proceedings of the 10th International Conference on Signal-Image Technology and Internet-Based Systems (SITIS 2014) (pp. 244-247). IEEE. Nadeem, D., Ordelman, R. J. F., Aly, R. & de Jong, F. M. G.https://doi.org/10.1109/SITIS.2014.47The Search and Hyperlinking Task at MediaEval 2014 (2014)In MediaEval 2014: Multimedia Benchmark Workshop (pp. 30) (CEUR workshop proceedings; Vol. 1263). CEUR. Eskevich, M., Aly, R., Racca, D. N., Ordelman, R. J. F., Chen, S. & Jones, G. J. F.http://ceur-ws.org/Vol-1263/mediaeval2014_submission_30.pdfBeyond metadata: searching your archive based on its audio-visual content (2014)In Proceedings of the 2014 International Broadcasting Convention, IBC 2014 (pp. 1.3). Institution of Engineering and Technology (IET). Tommasi, T., Aly, R., McGuinness, K., Chatfield, K., Arandjelovic, R., Parkhi, O., Ordelman, R. J. F., Zisserman, A. & Tuytelaars, T.https://doi.org/10.1049/ib.2014.0003Talking With Scholars: Developing a Research Environment for Oral History Collections (2014)In Proceedings of the 2nd International Workshop on Supporting Users Exploration of Digital Libraries (SUEDL 2013), Revised Selected Papers (pp. 197-201) (Communications in Computer and Information Science; Vol. 416). Springer. Kemman, M., Scagliola, S., de Jong, F. M. G. & Ordelman, R. J. F.https://doi.org/10.1007/978-3-319-08425-1_22
2013
Users Requirements in Audiovisual Search: A Quantitative Approach (2013)In Proceedings of the International Conference on Theory and Practice of Digital Libraries, TPDL 2013 (pp. 241-246) (Lecture Notes in Computer Science; Vol. 8092). Springer. Nadeem, D., Ordelman, R. J. F., Aly, R. & Verbruggen, E.https://doi.org/10.1007/978-3-642-40501-3_24Linking inside a video collection - what and how to measure? (2013)In Proceedings of the 22nd International Conference on World Wide Web Companion, IW3C2 2013 (pp. 457-460). Association for Computing Machinery. Aly, R., Ordelman, R. J. F., Eskevich, M., Jones, G. J. F. & Chen, S.http://www2013.org/companion/p457.pdfMultimedia information seeking through search and hyperlinking (2013)In ICMR 2013: Proceedings of the 3rd ACM International Conference on Multimedia Retrieval (pp. 287-294). Association for Computing Machinery. Eskevich, M., Jones, G. J. F., Aly, R., Ordelman, R. J. F., Chen, S., Nadeem, D., Guinaudeau, C., Gravier, G., Sébillot, P., de Nies, T., Debevere, P., Van de Walle, R., Galuščáková, P., Pecina, P. & Larson, M.https://doi.org/10.1145/2461466.2461511Improving cyberbullying detection with user context (2013)In Proceedings of the 35th European Conference on IR Research, ECIR 2013 (pp. 693-696) (Lecture Notes in Computer Science; Vol. 7814). Springer. Dadvar, M., Trieschnigg, R. B., Ordelman, R. J. F. & de Jong, F. M. G.https://doi.org/10.1007/978-3-642-36973-5_62
2012
Search and Hyperlinking Task at MediaEval 2012 (2012)In MediaEval 2012 Multimedia Benchmark Workshop: Working Notes Proceedings of the MediaEval 2012 Workshop, Santa Croce in Fossabanda, Pisa, Italy, October 4-5, 2012 (pp. 14) (CEUR Workshop Proceedings; Vol. 927). CEUR. Eskevich, M., Jones, G. J. F., Chen, S., Aly, R., Ordelman, R. & Larson, M.http://ceur-ws.org/Vol-927/UTwente does Brave New Tasks for MediaEval 2012: Searching and Hyperlinking (2012)In MediaEval 2012 Multimedia Benchmark Workshop (pp. 44) (CEUR Workshop Proceedings; Vol. 927). CEUR. Nadeem, D., Aly, R. & Ordelman, R. J. F.http://ceur-ws.org/Vol-927/mediaeval2012_submission_44.pdfThe Community and the Crowd: Multimedia Benchmark Dataset Development (2012)IEEE multimedia, 19(3), 15-23. Larson, M., Soleymani, M., Eskevich, M., Serdyukov, P., Ordelman, R. J. F. & Jones, G.https://doi.org/10.1109/MMUL.2012.27Comparing Retrieval Effectiveness of Alternative Content Segmentation Methods for Internet Video Search (2012)In Proceedings of the 10th Workshop on Content-Based Multimedia Indexing (CMBI 2012) (Proceedings International Workshop on Content-Based Multimedia Indexing (CBMI); Vol. 2012). IEEE. Eskevich, M., Jones, G. J. F., Larson, M., Wartena, C., Aly, R., Verschoor, T. & Ordelman, R.https://doi.org/10.1109/CBMI.2012.6269810Towards User Modelling in the Combat Against Cyberbullying (2012)In Proceedings of the17th International Conference on Applications of Natural Language to Information Systems, NLDB 2012 (pp. 277-283) (Lecture Notes in Computer Science; Vol. 7337). Springer. Dadvar, M., Ordelman, R. J. F., de Jong, F. M. G. & Trieschnigg, R. B.https://doi.org/10.1007/978-3-642-31178-9_34Link Anchors in Images: Is there Truth? (2012)In Proceedings of the 12th Dutch Belgian Information Retrieval Workshop (DIR 2012) (pp. 1-4). Ghent University. Aly, R., McGuinness, K., Kleppe, M., Ordelman, R. J. F., O'Connor, N. & de Jong, F. M. G.http://dir2012.intec.ugent.be/system/files/proceedings/DIR2012_35_Robin_Aly.pdfImproved cyberbullying detection using gender information (2012)In Proceedings of the Twelfth Dutch-Belgian Information Retrieval Workshop (DIR 2012) (pp. 23-25). Ghent University. Dadvar, M., de Jong, F. M. G., Ordelman, R. J. F. & Trieschnigg, R. B.http://dir2012.intec.ugent.be/system/files/proceedings/DIR2012_04_Maral_Dadvar.pdf
2011
AXES at TRECVid 2011 (2011)In TREC 2011 Video Retrieval Evaluation Online Proceedings (TRECVid 2011) (pp. -) (TREC Video Retrieval Evaluation: TRECVID; Vol. 2011). NIST. McGuinness, K., Aly, R., Chen, S., Frappier, M., Kleppe, M., Lee, H., Ordelman, R. J. F. & Arandjelovic, R.http://www-nlpir.nist.gov/projects/tvpubs/tv11.papers/axes-dcu.pdfAudiovisual Archive Exploitation in the Networked Information Society (2011)In MIRUM '11: Proceedings of the 1st International ACM Workshop on Music Information Retrieval with User-centered and Multimodal Strategies (pp. 19-20). Association for Computing Machinery. Ordelman, R. J. F.https://doi.org/10.1145/2072529.2072535Audio-visual Collections and the User Needs of Scholars in the Humanities: a Case for Co-Development (2011)In Proceedings of the 2nd Conference on Supporting Digital Humanities (SDH 2011) (pp. -). Centre for Language Technology, Copenhagen. de Jong, F. M. G., Ordelman, R. J. F. & Scagliola, S.http://crdo.up.univ-aix.fr/SLDRdata/doc/show/copenhagen/SDH-2011/submissions/sdh2011_submission_36.pdfUTwente does Rich Speech Retrieval at MediaEval 2011 (2011)In Working Notes Proceedings of the MediaEval 2011 Workshop (pp. 1) (CEUR Workshop Proceedings; Vol. 807). Sun SITE Central Europe. Aly, R., Verschoor, T. & Ordelman, R. J. F.http://ceur-ws.org/Vol-807/Larson_RSR_and_Genre_me11overview.pdfDistributed Access to Oral History collections: Fitting Access Technology to the needs of Collection Owners and Researchers (2011)In Digital Humanities 2011: Conference Abstracts (pp. 347-349). Stanford University Library. Ordelman, R. J. F. & de Jong, F. M. G.http://dh2011abstracts.stanford.edu/xtf/view?docId=tei/ab-276.xmlAccessing Audiovisual Heritage: A Roadmap for Collaborative Innovation (2011)IEEE multimedia, 18(4), 4-10. Oomen, J. & Ordelman, R. J. F.https://doi.org/10.1109/MMUL.2011.60Automatic Tagging and Geotagging in Video Collections and Communities (2011)In Proceedings of the 1st ACM International Conference on Multimedia Retrieval, ICMR2011 (pp. 51:1-51:8). Association for Computing Machinery. Larson, M., Soleymani, M., Serdyukov, P., Rudinac, S., Wartena, C., Murdock, V., Ordelman, R. J. F., Friedland, G. & Jones, G. J. F.https://doi.org/10.1145/1991996.1992047Automated Metadata Extraction for Semantic Access to Spoken Word Archives (2011)In Proceedings 12th International Symposium on Social Communication (pp. 896-905). Centre for Applied Linguistics. de Jong, F. M. G., Heeren, W. F. L., van Hessen, A. J., Ordelman, R. J. F. & Nijholt, A.http://www.santiago.cu/hosting/linguistica/descargar.php?d=1713