EVALITA 2020
Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian

Table of Contents

• Preface
  Summary: There were 73 papers submitted for peer-review to this workshop. Out of these, 72 papers were accepted for this volume, 33 as regular papers and 39 as short papers.
• EVALITA 2020: Overview of the 7th Evaluation Campaign of Natural Language Processing and Sspeech Tools for Italian
  Valerio Basile, Danilo Croce, Maria Di Maro, Lucia C. Passaro

Keynote Talk

• Flattening the Curve of the COVID-19 Infodemic: These Evaluation Campaigns Can Help!
  Preslav Nakov

Track "Affect, Hate, and Stance"

AMI: Automatic Misogyny Identification

• AMI @ EVALITA2020: Automatic Misogyny Identification
  Elisabetta Fersini, Debora Nozza and Paolo Rosso
• UniBO @ AMI: A Multi-Class Approach to Misogyny and Aggressiveness Identification on Twitter Posts Using AlBERTo
  Arianna Muti and Alberto Barrón-Cedeño
• fabsam @ AMI: A Convolutional Neural Network Approach (short paper)
  Samuel Fabrizi
• Jigsaw @ AMI and HaSpeeDe2: Fine-Tuning a Pre-Trained Comment-Domain BERT Model
  Alyssa Lees, Jeffrey Sorensen and Ian Kivlichan
• PoliTeam @ AMI: Improving Sentence Embedding Similarity with Misogyny Lexicons for Automatic Misogyny Identification in Italian Tweets
  Giuseppe Attanasio and Eliana Pastor
• MDD @ AMI: Vanilla Classifiers for Misogyny Identification (short paper)
  Samer El Abassi and Sergiu Nisioi
• No Place For Hate Speech @ AMI: Convolutional Neural Network and Word Embedding for the Identification of Misogyny in Italian (short paper)
  Adriano dos S. R. da Silva and Norton T. Roman

ATE_ABSITA: Aspect Term Extraction and Aspect-Based Sentiment Analysis

• ATE_ABSITA @ EVALITA2020: Overview of the Aspect Term Extraction and Aspect-based Sentiment Analysis Task
  Lorenzo de Mattei, Graziella De Martino, Andrea Iovine, Alessio Miaschi, Marco Polignano and Giulia Rambelli
• SentNA @ ATE_ABSITA: Sentiment Analysis of Customer Reviews Using Boosted Trees with Lexical and Lexicon-based Features (short paper)
  Francesco Mele, Antonio Sorgente and Giuseppe Vettigli
• ghostwriter19 @ ATE_ABSITA: Zero-Shot and ONNX to Speed up BERT on Sentiment Analysis Tasks at EVALITA 2020 (short paper)
  Mauro Bennici
• App2Check @ ATE_ABSITA 2020: Aspect Term Extraction and Aspect-based Sentiment Analysis (short paper)
  Emanuele Di Rosa and Alberto Durante

HaSpeeDe: Hate Speech Detection

• HaSpeeDe 2 @ EVALITA2020: Overview of the EVALITA 2020 Hate Speech Detection Task
  Manuela Sanguinetti, Gloria Comandini, Elisa Di Nuovo, Simona Frenda, Marco Stranisci, Cristina Bosco, Tommaso Caselli, Viviana Patti and Irene Russo
• YNU_OXZ @ HaSpeeDe 2 and AMI : XLM-RoBERTa with Ordered Neurons LSTM for Classification Task at EVALITA 2020
  Xiaozhi Ou and Hongling Li
• DH-FBK @ HaSpeeDe2: Italian Hate Speech Detection via Self-Training and Oversampling
  Elisa Leonardelli, Stefano Menini and Sara Tonelli
• By1510 @ HaSpeeDe 2: Identification of Hate Speech for Italian Language in Social Media Data (short paper)
  Tao Deng, Yang Bai and Hongbing Dai
• Venses @ HaSpeeDe2 & SardiStance: Multilevel Deep Linguistically Based Supervised Approach to Classification
  Rodolfo Delmonte
• UR NLP @ HaSpeeDe 2 at EVALITA 2020: Towards Robust Hate Speech Detection with Contextual Embeddings
  Julia Hoffmann and Udo Kruschwitz
• Fontana-Unipi @ HaSpeeDe2: Ensemble of transformers for the Hate Speech task at Evalita (short paper)
  Michele Fontana and Giuseppe Attardi
• TheNorth @ HaSpeeDe 2: BERT-based Language Model Fine-tuning for Italian Hate Speech Detection (short paper)
  Eric Lavergne, Rajkumar Saini, György Kovács and Killian Murphy
• UO @ HaSpeeDe2: Ensemble Model for Italian Hate Speech Detection (short paper)
  Mariano Jason Rodriguez Cisnero and Reynier Ortega Bueno
• No Place For Hate Speech @ HaSpeeDe 2: Ensemble to Identify Hate Speech in Italian (short paper)
  Adriano dos S. R. da Silva and Norton T. Roman
• Svandiela @ HaSpeeDe: Detecting Hate Speech in Italian Twitter Data with BERT (short paper)
  Svea Klaus, Anna-Sophie Bartle and Daniela Rossmann
• CHILab @ HaSpeeDe 2: Enhancing Hate Speech Detection with Part-of-Speech Tagging (short paper)
  Giuseppe Gambino and Roberto Pirrone
• Montanti @ HaSpeeDe2 EVALITA 2020: Hate Speech Detection in online contents (short paper)
  Elia Bisconti, Matteo Montagnani

SardiStance: Stance Detection

• SardiStance @ EVALITA2020: Overview of the Task on Stance Detection in Italian Tweets
  Alessandra Teresa Cignarella, Mirko Lai, Cristina Bosco, Viviana Patti and Paolo Rosso
• UNITOR @ Sardistance2020: Combining Transformer-based Architectures and Transfer Learning for Robust Stance Detection
  Simone Giorgioni, Marcello Politi, Samir Salman, Roberto Basili and Danilo Croce
• ghostwriter19 @ SardiStance: Generating New Tweets to Classify SardiStance EVALITA 2020 Political Tweets (short paper)
  Mauro Bennici
• QMUL-SDS @ SardiStance: Leveraging Network Interactions to Boost Performance on Stance Detection using Knowledge Graphs (short paper)
  Rabab Alkhalifa and Arkaitz Zubiaga
• DeepReading @ SardiStance 2020: Combining Textual, Social and Emotional Features
  Maria S. Espinosa, Rodrigo Agerri, Alvaro Rodrigo and Roberto Centeno
• TextWiller @ SardiStance, HaSpeede2: Text or Con-text? A Smart Use of Social Network Data in Predicting Polarization (short paper)
  Federico Ferraccioli, Andrea Sciandra, Mattia Da Pont, Paolo Girardi, Dario Solari and Livio Finos
• UninaStudents @ SardiStance: Stance Detection in Italian Tweets - Task A (short paper)
  Maurizio Moraca, Gianluca Sabella and Simone Morra
• SSN NLP @ SardiStance : Stance Detection from Italian Tweets using RNN and Transformers (short paper)
  Kayalvizhi S, Thenmozhi D and Aravindan Chandrabose
• SSNCSE-NLP @ EVALITA2020: Textual and Contextual Stance Detection from Tweets Using Machine Learning Approach (short paper)
  Bharathi B, Bhuvana J and Nitin Nikamanth Appiah Balaji

Track "Creativity and Style"

CHANGE-IT: Style Transfer

• CHANGE-IT @ EVALITA 2020: Change Headlines, Adapt News, GEnerate (short paper)
  Lorenzo De Mattei, Michele Cafagna, Felice Dell'Orletta, Malvina Nissim and Albert Gatt

TAG-it: Topic, Age and Gender Prediction

• TAG-it @ EVALITA2020: Overview of the Topic, Age, and Gender Prediction Task for Italian
  Andrea Cimino, Felice Dell'Orletta and Malvina Nissim
• UO_4to @ TAG-it 2020: Ensemble of Machine Learning Methods (short paper)
  Maria Fernanda Artigas Herold and Daniel Castro Castro
• UOBIT @ TAG-it: Exploring a Multi-faceted Representation for Profiling Age, Topic and Gender in Italian Texts.
  Roberto Labadie Tamayo, Daniel Castro Castro and Reynier Ortega Bueno
• ItaliaNLP @ TAG-IT: UmBERTo for Author Profiling at TAG-it 2020 (short paper)
  Daniela Occhipinti, Andrea Tesei, Maria Iacono, Carlo Aliprandi and Lorenzo De Mattei

Track "Semantics and Multimodality"

DANKMEMES: Multimodal Artefacts Recognition

• DANKMEMES @ EVALITA 2020: The Memeing of Life: Memes, Multimodality and Politics
  Martina Miliani, Giulia Giorgi, Ilir Rama, Guido Anselmi and Gianluca E. Lebani
• SNK @ DANKMEMES: Leveraging Pretrained Embeddings for Multimodal Meme Detection (short paper)
  Stefano Fiorucci
• UPB @ DANKMEMES: Italian Memes Analysis - Employing Visual Models and Graph Convolutional Networks for Meme Identification and Hate Speech Detection (short paper)
  George-Alexandru Vlad, George-Eduard Zaharia, Dumitru-Clementin Cercel and Mihai Dascalu
• ArchiMeDe @ DANKMEMES: A New Model Architecture for Meme Detection
  Jinen Setpal and Gabriele Sarti
• UNITOR @ DANKMEME: Combining Convolutional Models and Transformer-based architectures for accurate MEME management
  Claudia Breazzano, Edoardo Rubino, Danilo Croce and Roberto Basili

CONcreTEXT: Concreteness in Context

• CONcreTEXT @ EVALITA2020: The Concreteness in Context Task
  Lorenzo Gregori, Maria Montefinese, Daniele P. Radicioni, Andrea Amelio Ravelli and Rossella Varvara
• ANDI @ CONcreTEXT: Predicting Concreteness in Context for English and Italian using Distributional Models and Behavioural Norms (short paper)
  Armand Stefan Rotaru
• CAPISCO @ CONcreTEXT 2020: (Un)supervised Systems to Contextualize Concreteness with Norming Data
  Alessandro Bondielli, Gianluca E. Lebani, Lucia C. Passaro and Alessandro Lenci
• KonKretiKa @ CONcreTEXT: Computing Concreteness Indexes with Sigmoid Transformation and Adjustment for Context
  Yulia Badryzlova

Ghigliottin-AI: Evaluating Artificial Players for the Language Game “La Ghigliottina”

• Ghigliottin-AI@EVALITA2020: Evaluating Artificial Players for the Language Game ``La Ghigliottina'' (short paper)
  Pierpaolo Basile, Marco Lovetere, Johanna Monti, Antonio Pascucci, Federico Sangati and Lucia Siciliani
• “Il Mago della Ghigliottina” @ GhigliottinAI: When Linguistics meets Artificial Intelligence
  Federico Sangati, Antonio Pascucci and Johanna Monti
• GUL.LE.VER @ GhigliottinAI: A Glove based Artificial Player to Solve the Language Game “La Ghigliottina” (short paper)
  Nazareno de Francesco

PRELEARN: Prerequisite Relation Learning

• PRELEARN @ EVALITA 2020: Overview of the Prerequisite Relation Learning Task for Italian
  Chiara Alzetta, Alessio Miaschi, Felice Dell'Orletta, Frosina Koceva and Ilaria Torre
• B4DS @ PRELEARN: Ensemble Method for Prerequisite Learning (short paper)
  Giovanni Puccetti, Luis Bolanos, Filippo Chiarello and Gualtiero Fantoni
• UNIGE_SE @ PRELEARN: Utility for Automatic Prerequisite Learning from Italian Wikipedia (short paper)
  Alessio Moggio and Andrea Parizzi
• NLP-CIC @ PRELEARN: Mastering Prerequisites Relations, from Handcrafted Features to Embeddings (short paper)
  Jason Angel and Segun Aroyehun

Track "Time and Diachrony"

DaDoEval: Dating Documents

• DaDoEval @ EVALITA 2020: Same-Genre and Cross-Genre Dating of Historical Documents
  Stefano Menini, Giovanni Moretti, Rachele Sprugnoli and Sara Tonelli
• matteo-brv @ DaDoEval: An SVM-based Approach for Automatic Document Dating (short paper)
  Matteo Brivio
• rmassidda @ DaDoEval: Document Dating Using Sentence Embeddings at EVALITA 2020
  Riccardo Massidda

DIACR-Ita: Diachronic Lexical Semantics

• DIACR-Ita @ EVALITA2020: Overview of the EVALITA2020 Diachronic Lexical Semantics (DIACR-Ita) Task
  Pierpaolo Basile, Annalina Caputo, Tommaso Caselli, Pierluigi Cassotti and Rossella Varvara
• University of Padova @ DIACR-Ita (short paper)
  Benyou Wang, Emanuele Di Buccio and Massimo Melucci
• UWB @ DIACR-Ita: Lexical Semantic Change Detection with CCA and Orthogonal Transformation
  Ondřej Pražák, Pavel Přibáň, Stephen Taylor
• QMUL-SDS @ DIACR-Ita: Evaluating Unsupervised Diachronic Lexical Semantics Classification in Italian (short paper)
  Rabab Alkhalifa, Adam Tsakalidis, Arkaitz Zubiaga and Maria Liakata
• CL-IMS @ DIACR-Ita: Volente o Nolente: BERT is still not Outperforming SGNS on Semantic Change Detection
  Severin Laicher, Gioia Baldissin, Enrique Castaneda, Dominik Schlechtweg and Sabine Schulte Im Walde
• OP-IMS @ DIACR-Ita: Back to the Roots: SGNS+OP+CD still Rocks Semantic Change Detection
  Jens Kaiser, Dominik Schlechtweg and Sabine Schulte Im Walde
• UNIMIB @ DIACR-Ita: Aligning Distributional Embeddings with a Compass for Semantic Change Detection in the Italian Language (short paper)
  Federico Belotti, Federico Bianchi and Matteo Palmonari
• NLP-CIC @ DIACR-Ita: POS and Neighbor Based Distributional Models for Lexical Semantic Change in Diachronic Italian Corpora (short paper)
  Jason Angel

Track "New Challenges in Long-standing Tasks"

AcCompl-it: Acceptability & Complexity evaluation

• AcCompl-it @ EVALITA2020: Overview of the Acceptability & Complexity Evaluation Task for Italian
  Dominique Brunato, Cristiano Chesi, Felice Dell'Orletta, Simonetta Montemagni, Giulia Venturi and Roberto Zamparelli
• UmBERTo-MTSA @ AcCompl-It: Improving Complexity and Acceptability Prediction with Multi-task Learning on Self-Supervised Annotations (short paper)
  Gabriele Sarti
• Venses @ AcCompl-It: Computing Complexity vs Acceptability with a Constituent Trigram Model and Semantics
  Rodolfo Delmonte

KIPoS: Part-of-speech Tagging on Spoken Language

• KIPoS @ EVALITA2020: Overview of the Task on KIParla Part of Speech Tagging
  Cristina Bosco, Silvia Ballarè, Massimo Cerruti, Eugenio Goria and Caterina Mauri
• UniBO @ KIPoS: Fine-tuning the Italian “BERTology” for PoS-tagging Spoken Data (short paper)
  Fabio Tamburini
• UniBA @ KIPoS: A Hybrid Approach for Part-of-Speech Tagging (short paper)
  Giovanni Luca Izzi and Stefano Ferilli
• KLUMSy @ KIPoS: Experiments on Part-of-Speech Tagging of Spoken Italian
  Thomas Proisl and Gabriella Lapesa