CSW 2021
Crowd Science Workshop: Trust, Ethics, and Excellence in Crowdsourced Data Management at Scale

Table of Contents

• Preface
  Summary: There were 11 papers submitted for peer-review to this workshop. Out of these, 7 papers were accepted for this volume, 5 as regular papers and 2 as short papers.

Session 1: Shared Task

• VLDB 2021 Crowd Science Challenge on Aggregating Crowdsourced Audio Transcriptions 1-7
  Dmitry Ustalov, Nikita Pavlichenko, Ivan Stelmakh, Dmitriy Kuznetsov
• Fine-Tuning Pre-Trained Language Model for Crowdsourced Texts Aggregation 8-14
  Mikhail Orzhenovskii
• Noisy Text Sequences Aggregation as a Summarization Subtask 15-20
  Sergey Pletenev

Session 2: Regular Papers

• A Multi-Objective Clustering Ensemble Approach for Crowdsourced Clustering 21-34
  Sujoy Chatterjee
• Crowdsourcing of Parallel Corpora: the Case of Style Transfer for Detoxification 35-49
  Daryna Dementieva, Sergey Ustyantsev, David Dale, Olga Kozlova, Nikita Semenov, Alexander Panchenko, Varvara Logacheva
• Training-Induced Class Imbalance in Crowdsourced Data 50-59
  Shawn Ogunseye, Jeffrey Parsons, Doyinsola Afolabi
• Aggregation of Crowdsourced Ontology-Based Item Descriptions by Hierarchical Voting 60-71
  Andrew Ponomarev
• Finer Granularity Means Better Data: a Crowdsourcing Lab Experiment 72-86
  Ryan Murphy, Jeffrey Parsons