|  | Vol-2263 urn:nbn:de:0074-2263-0 Copyright © 2018 for the individual papers by the papers' authors. Copying permitted for private and academic purposes. This volume is published and copyrighted by its editors.

# EVALITA 2018
Sixth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian

### Proceedings of the Sixth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2018)
co-located with the Fifth Italian Conference on Computational Linguistics (CLiC-it 2018)

### Turin, Italy, December 12-13, 2018.

Edited by

### Tommaso Caselli *
Nicole Novielli **
Viviana Patti ***
Paolo Rosso ****

* Center for Language and Cognition Groningen, Rijksuniversiteit Groningen, Groningen, The Netherlands
** Computer Science Department, University of Bari “A. Moro”, Bari, Italy
*** Computer Science Department, University of Torino, Torino, Italy
**** PRHLT Research Center, Universitat Politècnica de València, València, Spain

## Table of Contents

- Preface

### Keynote Talk

- The Search for Emotions, Creativity, and Fairness in Language
  Saif M. Mohammad, National Research Council Canada

### PART I: Introduction to Evalita 2018 and Task Overviews

- Evalita 2018: Overview on the 6th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian
  Tommaso Caselli, Nicole Novielli, Viviana Patti, Paolo Rosso
- Overview of the EVALITA 2018 Aspect-based Sentiment Analysis Task (ABSITA)
  Pierpaolo Basile, Valerio Basile, Danilo Croce, Marco Polignano
- Overview of the EVALITA 2018 Italian Emoji Prediction (ITAMoji) Task
  Francesco Ronzano, Francesco Barbieri, Endang Wahyu Pamungkas, Viviana Patti, Francesca Chiusaroli
- Overview of the EVALITA 2018 Task on Irony Detection in Italian Tweets (IronITA)
  Alessandra Teresa Cignarella, Simona Frenda, Valerio Basile, Cristina Bosco, Viviana Patti, Paolo Rosso
- Overview of the EVALITA 2018 Cross-Genre Gender Prediction (GxG) Task
  Felice Dell'Orletta, Malvina Nissim
- Overview of the Evalita 2018 itaLIan Speech acT labEliNg (iLISTEN) Task
  Pierpaolo Basile, Nicole Novielli
- Overview of the EVALITA 2018 Evaluation of Italian DIALogue Systems (IDIAL) Task
  Francesco Cutugno, Maria Di Maro, Sara Falcone, Marco Guerini, Bernardo Magnini, Antonio Origlia
- Overview of the Evalita 2018 Task on Automatic Misogyny Identification (AMI)
  Elisabetta Fersini, Debora Nozza, Paolo Rosso
- Overview of the EVALITA 2018 Hate Speech Detection Task
  Cristina Bosco, Felice Dell'Orletta, Fabio Poletto, Manuela Sanguinetti, Maurizio Tesconi
- Overview of the EVALITA 2018 Solving Language Games (NLP4FUN) Task
  Pierpaolo Basile, Marco de Gemmis, Lucia Siciliani, Giovanni Semeraro
- Overview of the EVALITA 2018 Spoken Utterances Guiding Chef’s Assistant Robots (SUGAR) Task
  Maria Di Maro, Antonio Origlia, Francesco Cutugno

### PART II: Participant Reports

- Multi-task Learning in Deep Neural Networks at EVALITA 2018
  Andrea Cimino, Lorenzo De Mattei, Felice Dell'Orletta
- ItVENSES - A Symbolic System for Aspect-Based Sentiment Analysis
  Rodolfo Delmonte
- Aspect-based Sentiment Analysis: X2Check at ABSITA 2018
  Emanuele Di Rosa, Alberto Durante
- Bidirectional Attentional LSTM for Aspect Based Sentiment Analysis on Italian
  Giancarlo Nicola
- Ensemble of LSTMs for EVALITA 2018 Aspect-based Sentiment Analysis Task (ABSITA) (Short Paper)
  Mauro Bennici, Xileny Seijas Portocarrero
- Fully Convolutional Networks for Text Classification
  Jacob Anderson
- ITAmoji 2018: Emoji Prediction via Tree Echo State Networks
  Daniele Di Sarli, Claudio Gallicchio, Alessio Micheli
- The UNIBA System at the EVALITA 2018 Italian Emoji Prediction Task
  Lucia Siciliani, Daniela Girardi
- Predicting Emoji Exploiting Multimodal Data: FBK Participation in ITAmoji Task
  Andrei Catalin Coman, Yaroslav Nechaev, Giacomo Zara
- The Validity of Word Vectors Over the Time for the EVALITA 2018 Emoji Prediction Task (ITAmoji)
  Mauro Bennici, Xileny Seijas Portocarrero
- A Kernel-based Approach for Irony and Sarcasm Detection in Italian
  Andrea Santilli, Danilo Croce, Roberto Basili
- UNIBA - Integrating Distributional Semantics Features in a Supervised Approach for Detecting Irony in Italian Tweets
  Pierpaolo Basile, Giovanni Semeraro
- Irony Detection in Tweets: X2Check at Ironita 2018 (Short Paper)
  Emanuele Di Rosa, Alberto Durante
- Aspie96 at IronITA (EVALITA 2018): Irony Detection in Italian Tweets with Character-Level Convolutional RNN
  Valentino Giudice
- UO_IRO: Linguistic Informed Deep-learning Model for Irony Detection
  Reynier Ortega-Bueno, José E. Medina Pagola
- CapetownMilanoTirana for GxG at Evalita2018. Simple N-gram Based Models Perform Well for Gender Prediction. Sometimes. (Short Paper)
  Angelo Basile, Gareth Dwyer, Chiara Rubagotti
- A Markovian Kernel-based Approach for itaLIan Speech acT labEliNg
  Danilo Croce, Roberto Basili
- Misogyny Detection and Classification in English Tweets: The Experience of the ITT Team
  Elena Shushkevich, John Cardiff
- Automatic Expansion of Lexicons for Multilingual Misogyny Detection
  Simona Frenda, Bilal Ghanem, Estefanía Guzmán-Falcón, Manuel Montes-y-Gómez, Luis Villaseñor-Pineda
- Detecting Hate Speech Against Women in English Tweets
  Resham Ahluwalia, Himani Soni, Edward Callow, Anderson Nascimento, Martine De Cock
- Automatic Identification of Misogyny in English and Italian Tweets at EVALITA 2018 with a Multilingual Hate Lexicon
  Endang Wahyu Pamungkas, Alessandra Teresa Cignarella, Valerio Basile, Viviana Patti
- CrotoneMilano for AMI at Evalita2018. A Performant, Cross-lingual Misogyny Detection System.
  Angelo Basile, Chiara Rubagotti
- Vector Space Models for Automatic Misogyny Identification (Short Paper)
  Amir Bakarov
- Tweetaneuse @ AMI EVALITA2018: Character-based Models for the Automatic Misogyny Identification Task (Short Paper)
  Davide Buscaldi
- Merging Datasets for Hate Speech Classification in Italian
  Paula Fortuna, Ilaria Bonavita, Sérgio Nunes
- HanSEL: Italian Hate Speech Detection Through Ensemble Learning and Deep Neural Networks
  Marco Polignano, Pierpaolo Basile
- Comparing Different Supervised Approaches to Hate Speech Detection
  Michele Corazza, Stefano Menini, Pinar Arslan, Rachele Sprugnoli, Elena Cabrio, Sara Tonelli, Serena Villata
- Hate Speech Detection Using Attention-based LSTM
  Gretel Liz De la Peña Sarracén, Reynaldo Gil Pons, Carlos Enrique Muñiz Cuza, Paolo Rosso
- Detecting Hate Speech for Italian Language in Social Media
  Valentino Santucci, Stefania Spina, Alfredo Milani, Giulio Biondi, Gabriele Di Bari
- RuG @ EVALITA 2018: Hate Speech Detection In Italian Social Media
  Xiaoyu Bai, Flavio Merenda, Claudia Zaghi, Tommaso Caselli, Malvina Nissim
- Text Analysis for Hate Speech Detection in Italian Messages on Twitter and Facebook
  Giulio Bianchini, Lorenzo Ferri, Tommaso Giorni
- Exploiting Multiword Expressions to Solve “La Ghigliottina”
  Federico Sangati, Antonio Pascucci, Johanna Monti
- Computer Challenges Guillotine: How an Artificial Player Can Solve a Complex Language TV game with Web Data Analysis
  Luca Squadrone
- The Perfect Recipe: Add SUGAR, Add Data
  Simone Magnolini, Vevake Balaraman, Marco Guerini, Bernardo Magnini

2018-12-01: submitted by Viviana Patti, metadata incl. bibliographic data published under Creative Commons CC0
2018-12-03: published on CEUR-WS.org |valid HTML5|