Dr. Dmitry Ustalov, Yandex
Crowdsourcing is an efficient approach for knowledge acquisition and data annotation that enables building impressive human-computer systems. In this tutorial, we will discuss the relations between Crowdsourcing and Natural Language Processing, focusing on its practical use for Language Resource construction and evaluation. We will describe the established genres of crowdsourcing, show their strengths and weaknesses on real-world examples and case studies, and provide recommendations for ensuring the high quality of the crowdsourced annotation.Biography
Dmitry Ustalov works for Yandex at the Data Analysis and Research Group. In 2018 he defended his PhD thesis which he worked on at the Krasovskii Institute of Mathematics and Mechanics, Russia. His research interests are focused on Computational Lexical Semantics and Crowdsourcing. Before joining Yandex, Dmitry worked as a Post-Doctoral Research Fellow at the University of Mannheim, Germany and as a Teaching Assistant at the Ural Federal University, Russia.
Dr. Ustalov's research is published in premier international scientific journals and conferences, such as COLI, ACL, EACL, and EMNLP. He serves as a reviewer for COLI, SWJ, ACL, EMNLP, ISWC, and other publications. In 2012 Dmitry founded NLPub
, the leading Russian wiki on Computational Linguistics. Also, he has been co-organizing the workshop and shared task on Russian Semantic Evaluation
(RUSSE) since 2014 and the TextGraphs
workshop since 2018.