CSW 2023
Crowd Science Workshop: Collaboration of Humans and Learning Algorithms for Data Labeling

Table of Contents

• Preface
  Summary: There were 6 papers submitted for peer-review to this workshop. Out of these, 5 papers were accepted for this volume, 4 as regular papers, 0 as short papers, and 1 as a non-archival talk.

Papers

• WSDM Cup 2023 Challenge on Visual Question Answering (invited paper) 1-7
  Dmitry Ustalov, Nikita Pavlichenko, Daniil Likhobaba, Alisa Smirnova
• To Aggregate or Not? Learning with Separate Noisy Labels 8-43
  Jiaheng Wei, Zhaowei Zhu, Tianyi Luo, Ehsan Amid, Abhishek Kumar, Yang Liu
• AI Decision Systems with Feedback Loop Active Learner 44-58
  Mert Kosan, Linyun He, Shubham Agrawal, Hongyi Liu, Chiranjeet Chetia
• The Determination of the Learning Performance based on Assessment Item Analysis 59-76
  Doru Anastasiu Popescu, Ovidiu Domsa, Nicolae Bold
• Utilising Crowdsourcing to Assess the Effectiveness of Item-based Explanations of Merchant Recommendations 77-86
  Denis Krasilnikov, Oleg Lashinin, Maksim Tsygankov, Marina Ananyeva, Sergey Kolesnikov