| Vol-1749 urn:nbn:de:0074-1749-2 Copyright © 2016 for the individual papers by the papers' authors. Copying permitted for private and academic purposes. This volume is published and copyrighted by its editors.

# CLiC-it & EVALITA 2016
Proceedings CLiC-it 2016 and EVALITA 2016

### Proceedings of Third Italian Conference on Computational Linguistics (CLiC-it 2016) & Fifth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2016)
Napoli, Italy, December 5-7, 2016.

Edited by

### Pierpaolo Basile1
Anna Corazza2
Franco Cutugno2
Simonetta Montemagni3
Malvina Nissim4
Viviana Patti5
Giovanni Semeraro1
Rachele Sprugnoli6

1 Università degli Studi di Bari "Aldo Moro"
2 Università degli Studi di Napoli Federico II
3 Istituto di Linguistica Computazionale "Antonio Zampolli" - CNR
4 Center for Language and Cognition Groningen, Rijksuniversiteit Groningen
5 Università degli Studi di Torino
6 Fondazione Bruno Kessler and Università degli Studi di Trento

## Table of Contents

- Third Italian Conference on Computational Linguistics CLiC–it 2016
- Fifth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop EVALITA 2016

## Third Italian Conference on Computational Linguistics CLiC-it 2016

Chaired by Anna Corazza, Simonetta Montemagni, Giovanni Semeraro

- Preface

### Invited Speakers

- Reflections on Universal Dependencies Joakim Nivre, Department of Linguistics and Philology – Uppsala University
- What’s this movie about? Automatic Content Analysis and Summarization Mirella Lapata, Institute for Language, Cognition and Computation – School of Informatics – University of Edinburgh

### 1. Linguistic Issues in CL and NLP

- Determining the Compositionality of Noun–Adjective Pairs with Lexical Variants and Distributional Semantics
  Marco S. G. Senaldi, Gianluca E. Lebani, Alessandro Lenci
- Studio sull'Ordine dei Costituenti nel Confronto tra Generi e Complessità
  (Analysis of Constituents Order Across Textual Genres and Complexity)
  Giulia Pieri, Dominique Brunato, Felice Dell'Orletta
- Grounding the Lexical Sets of Causative–Inchoative Verbs with Word Embedding
  Edoardo Maria Ponti, Elisabetta Jezek, Bernardo Magnini
- Dieci sfumature di marcatezza sintattica: verso una nozione computazionale di complessità
  (Ten Shades of Syntactic Markedness: Towards a Computational Notion of Complexity)
  Erica Tusa, Felice Dell'Orletta, Simonetta Montemagni, Giulia Venturi

### 2. Machine Translation and Multilingual Applications

- Online Automatic Post–Editing across Domains
  Rajen Chatterjee, Gebremedhen Gebremelak, Matteo Negri, Marco Turchi
- Language Resources for Italian: towards the Development of a Corpus of Annotated Italian Multiword Expressions
  Shiva Taslimipoor, Anna Desantis, Manuela Cherchi, Ruslan Mitkov, Johanna Monti
- Emojitalianobot and EmojiWorldBot – New online Tools and Digital Environments for Translation into Emoji
  Johanna Monti, Federico Sangati, Francesca Chiusaroli, Martin Benjamin, Sina Mansour

### 3. Machine Learning for CL and NLP

- IR Scientific Data: How to Semantically Represent and Enrich Them
  Toine Bogers, Georgeta Bordea, Paul Buitelaar, Nicola Ferro, Gianmaria Silvello
- Nyström Methods for Efficient Kernel–Based Methods for Community Question Answering
  Danilo Croce, Simone Filice, Roberto Basili
- Topic Modelling with Word Embeddings
  Fabrizio Esposito, Anna Corazza, Francesco Cutugno

### 4. Information Retrieval and Question Answering

- Imparare a Quantificare Guardando
  (Learning to Quantify by Watching)
  Sandro Pezzelle, Ionut Sorodoc, Aurelie Herbelot, Raffaella Bernardi
- Appetitoso: A Search Engine for Restaurant Retrieval based on Dishes
  Gianni Barlacchi, Azad Abad, Emanuele Rossinelli, Alessandro Moschitti
- Gamification for IR: The Query Aspects Game
  Giorgio Maria Di Nunzio, Maria Maistro, Daniel Zilio

### 5. Information Extraction, Entity Linking and (Linked) Open Data

- Semantic Interpretation of Events in Live Soccer Commentaries
  Anne–Lyse Minard, Manuela Speranza, Bernardo Magnini, Mohammed R. H. Qwaider
- Linking IMAGACT Ontology to BabelNet through Action Videos
  Lorenzo Gregori, Alessandro Panunzi, Andrea Amelio Ravelli
- Relation Mining from Clinical Records
  Anita Alicante, Anna Corazza, Francesco Isgrò, Stefano Silvestri

### 6. Linguistic Resources

- Subjective Well–Being and Social Media. A Semantically Annotated Twitter Corpus on Fertility and Parenthood
  Emilio Sulis, Cristina Bosco, Viviana Patti, Mirko Lai, Delia Irazu Hernandez Farias, Letizia Mencarini, Michele Mozzachiodi, Daniele Vignoli
- An Extended Version of the KoKo German L1 Learner Corpus
  Andrea Abel, Aivars Glaznieks, Lionel Nicolas, Egon Stemle
- Annotating Content Zones in News Articles
  Daniela Baiamonte, Tommaso Caselli, Irina Prodanof
- LICO: A Lexicon of Italian Connectives
  Anna Feltracco, Elisabetta Jezek, Bernardo Magnini, Manfred Stede
- Formatio formosa est. Building a Word Formation Lexicon for Latin
  Eleonora Litta, Marco Passarotti, Chris Culy
- SIMPITIKI: a Simplification corpus for Italian
  Sara Tonelli, Alessio Palmero Aprosio, Francesca Saltori
- (Almost) Automatic Conversion of the Venice Italian Treebank into the Merged Italian Dependency Treebank Format
  Linda Alfieri, Fabio Tamburini
- Enrichring the Ita–TimeBank with Narrative Containers
  Alice Bracchi, Tommaso Caselli, Irina Prodanof
- Increasing Information Accessibility on the Web: a Rating System for Specialized Dictionaries
  Valeria Caruso, Anna De Meo, Vincenzo Norman Vitale
- Parsing di Corpora di Apprendenti di Italiano: un Primo Studio su VALICO
  (Parsing Italian Learner Corpora: a Case Study on VALICO)
  Elisa Corino, Claudio Russo
- Spammare senza pietà – Corpus based analysis of English, unacclimatised verb Loans in Italian and Creation of a Reference Lexicon
  Anna Fantini
- Taming Sense Sparsity: a Common–Sense Approach
  Antonio Lieto, Enrico Mensa, Daniele P. Radicioni
- Building a Computational Lexicon by using SQL
  Alessandro Mazzei
- FB-NEWS15: A Topic–Annotated Facebook Corpus for Emotion Detection and Sentiment Analysis
  Lucia C. Passaro, Alessandro Bondielli, Alessandro Lenci
- Sardinian on Facebook: Analysing Diatopic Varieties through Translated Lexical Lists
  Irene Russo, Simone Pisano, Claudia Soria
- A New Dataset for Source Code Comment Coherence
  Anna Corazza, Valerio Maggio, Giuseppe Scanniello

### 7. Pragmatics, Creativity and Linguistic Games

- Tracing Metaphors in Time through Self–Distance in Vector Spaces
  Marco Del Tredici, Malvina Nissim, Andrea Zaninello

### 8. Semantics and Knowledge Acquisition

- KD Strikes Back: from Keyphrases to Labelled Domains Using External Knowledge Sources
  Giovanni Moretti, Rachele Sprugnoli, Sara Tonelli

### 9. NLP for Digital Humanities

- Investigating the Application of Distributional Semantics to Stylometry
  Giulia Benotto, Emiliano Giovannetti, Simone Marchi
- Diachronic Analysis of the Italian Language exploiting Google Ngram
  Pierpaolo Basile, Annalina Caputo, Roberta Luisi, Giovanni Semeraro
- Hybrid Language Segmentation for Historical Documents
  David Alfter, Yuri Bizzoni
- La Leggibilità dei Testi di Ambito Medico rivolti al Paziente: il Caso dei Bugiardini di Farmaci Senza Obbligo di Prescrizione Medica
  (Readability of Medical Texts for Patients: a Case Study on Information Leaflets of Drugs without Obligation of Medical Prescription)
  Franca Orletti, Felice Dell'Orletta, Rossella Iovino
- La Modellazione Diacronica di Risorse Termino–Ontologiche nell'Ambito delle Digital Humanities: Esperimenti su Clavius
  (Diachronic Modeling of Terminological-Ontological Resources within Digital Humanities: Experiments on Clavius)
  Silvia Piccini, Andrea Bellandi, Giulia Benotto, Emiliano Giovannetti
- Panta Rei: Tracking Semantic Change with Distributional Semantics in Ancient Greek
  Martina Astrid Rodda, Marco S. G. Senaldi, Alessandro Lenci

### 10. Cognitive Modeling of Language Processing and Psycholinguistics

- Reassessing Inflectional Regularity in Modern Greek Conjugation
  Stavros Bompolas, Marcello Ferro, Claudia Marzi, Franco Alberto Cardillo, Vito Pirrelli
- Written Word Production and Lexical Self–Organisation: Evidence from English (Pseudo)Compounds
  Marcello Ferro, Franco Alberto Cardillo, Vito Pirrelli, Christina L. Gagné, Thomas L. Spalding
- Lexical Categories or Frequency Effects? A Feedback from Quantitative Methods Applied to Psycholinguistic Models in two Studies on Italian
  Francesca Franzon, Giorgio Arcara, Chiara Zanini
- Semantic Priming Effects in Italian Verbs Recognition: the Role of Grammatical Classes and Semantic Categories
  Azzurra Mancuso, Maria De Martino, Alessandro Laudanna
- Sentiment Analysis: Applicazione in un Dominio Psico–Forense
  Francesca Guglielmi, Pierpaolo Basile, Antonietta Curci, Giovanni Semeraro
- Stepping out of the Chinese Room: Word meaning with and without consciousness
  Roberto Bottini, Daniel Casasanto, Andrea Nadalini, Davide Crepaldi

### 11. Spoken Language Processing and Understanding

- Context–aware Spoken Language Understanding for Human Robot Interaction
  Andrea Vanzo, Danilo Croce, Roberto Basili, Daniele Nardi

### 12. NLP for Web and Social Media

- Argument Mining on Italian News Blogs
  Pierpaolo Basile, Valerio Basile, Elena Cabrio, Serena Villata
- Twitter Sentiment Polarity Classification using Barrier Features
  Anita Alicante, Anna Corazza, Antonio Pironti
- The DiDi Corpus of South Tyrolean CMC Data: A multilingual corpus of Facebook texts
  Jennifer–Carmen Frey, Aivars Glaznieks, Egon W. Stemle
- Sequenze N+pN (Nome Comune + Nome Proprio): Descrizione Linguistica da un Corpus dell’Italiano
  (N+pN (Common Noun + Proper Noun) Sequences: Linguistic Description from an Italian Corpus)
  Felicia Logozzo

### 13. Morphology and Syntax Processing

- (Better than) State–of–the–Art PoS–tagging for Italian Texts
  Fabio Tamburini
- Tree Kernels–based Discriminative Reranker for Italian Constituency Parsers
  Antonio Uva, Alessandro Moschitti
- Comparing State–of–the–art Dependency Parsers on the Italian Stanford Dependency Treebank
  Alberto Lavelli
- May the Goddess of Hope Help Us. Homonymy in Latin Lexicon and Onomasticon
  Marco Passarotti, Marco Budassi

## Fifth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop EVALITA 2016

Chaired by Pierpaolo Basile, Franco Cutugno, Malvina Nissim, Viviana Patti, Rachele Sprugnoli

- Preface

### PART I: Introduction to Evalita 2016

- EVALITA 2016: Overview of the 5th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian
  Pierpaolo Basile, Franco Cutugno, Malvina Nissim, Viviana Patti, Rachele Sprugnoli
- Raising Interest and Collecting Suggestions on the EVALITA Evaluation Campaign
  Rachele Sprugnoli, Viviana Patti, Franco Cutugno
- Keynote: Profiling the Personality of Social Media Users
  Walter Daelemans

### PART II: Task Overviews and Participant Reports

### Task 1: ArtiPhon – Articulatory Phone Recognition

- The ArtiPhon Task at Evalita 2016
  Leonardo Badino
- Phone Recognition Experiments on ArtiPhon with KALDI
  Piero Cosi

### Task 2: FactA – Event Factuality Annotation

- The EVALITA 2016 Event Factuality Annotation Task (FactA)
  Anne–Lyse Minard, Manuela Speranza, Tommaso Caselli

### Task 3: NEEL–IT – Named Entity rEcognition and Linking in Italian Tweets

- Overview of the EVALITA 2016 Named Entity rEcognition and Linking in Italian Tweets (NEEL–IT) Task
  Pierpaolo Basile, Annalina Caputo, Anna Lisa Gentile, Giuseppe Rizzo
- Using Embeddings for Both Entity Recognition and Linking in Tweet
  Giuseppe Attardi, Daniele Sartiano, Maria Simi, Irene Sucameli
- UNIMIB@NEEL–IT: Named Entity Recognition and Linking of Italian Tweets
  Flavio Massimiliano Cecchini, Elisabetta Fersini, Pikakshi Manchanda, Enza Messina, Debora Nozza, Matteo Palmonari, Cezar Sas
- MicroNeel: Combining NLP Tools to Perform Named Entity Detection and Linking on Microposts
  Francesco Corcoglioniti, Alessio Palmero Aprosio, Yaroslav Nechaev, Claudio Giuliano
- sisinflab: an Ensemble of Supervised and Unsupervised Strategies for the NEEL–IT Challenge at Evalita 2016
  Vittoria Cozza, Wanda La Bruna, Tommaso Di Noia
- FBK–NLP at NEEL–IT: Active Learning for Domain Adaptation
  Anne–Lyse Minard, Mohammed Refat Hamouda Qwaider, Bernardo Magnini

### Task 4: PoSTWITA – POS tagging for Italian Social Media Texts

- Overview of the EVALITA 2016 Part Of Speech on TWitter for ITAlian Task
  Cristina Bosco, Fabio Tamburini, Andrea Bolioli, Alessandro Mazzei
- Character Embeddings PoS Tagger vs HMM Tagger for Tweets
  Giuseppe Attardi, Maria Simi
- Building the state–of–the–art in POS tagging of Italian Tweets
  Andrea Cimino, Felice Dell'Orletta
- Building a Social Media Adapted PoS Tagger Using FlexTag –– A Case Study on Italian Tweets
  Tobias Horsmann, Torsten Zesch
- Mivoq Evalita 2016 PosTwITA tagger
  Giulio Paci
- NLP–NITMZ: Part–of–Speech Tagging on Italian Social Media Text using Hidden Markov Model
  Partha Pakray, Goutam Majumder
- When silver glitters more than gold: Bootstrapping an Italian part–of–speech tagger for Twitter
  Barbara Plank, Malvina Nissim
- bot.zen @ EVALITA 2016 – A minimally–deep learning PoS–tagger (trained for Italian Tweets)
  Egon W. Stemle
- A BiLSTM–CRF PoS–tagger for Italian tweets using morphological information
  Fabio Tamburini

### Task 5: QA4FAQ – Question Answering for Frequently Asked Questions

- Overview of the EVALITA 2016 Question Answering for Frequently Asked Questions (QA4FAQ) Task
  Annalina Caputo, Marco de Gemmis, Pasquale Lops, Francesco Lovecchio, Vito Manzari
- Question Answering System for Frequently Asked Question
  Divyanshu Bhardwaj, Partha Pakray, Jereemi Bentham, Saurav Saha, Alexander Gelbukh
- Tweaking Word Embeddings for FAQ Ranking
  Erick R. Fonseca, Simone Magnolini, Anna Feltracco, Mohammed R. H. Qwaider, Bernardo Magnini
- ChiLab4It System in the QA4FAQ Competition
  Arianna Pipitone, Giuseppe Tirone, Roberto Pirrone

### Task 6: SENTIPOLC – SENTIment POLarity Classification

- Overview of the Evalita 2016 SENTIment POLarity Classification Task
  Francesco Barbieri, Valerio Basile, Danilo Croce, Malvina Nissim, Nicole Novielli, Viviana Patti
- Convolutional Neural Networks for Sentiment Analysis on Italian Tweets
  Giuseppe Attardi, Daniele Sartiano, Chiara Alzetta, Federica Semplici
- IRADABE2: Lexicon Merging and Positional Features for Sentiment Analysis in Italian
  Davide Buscaldi, Delia Irazú Hernández Farías
- Context–aware Convolutional Neural Networks for Twitter Sentiment Analysis in Italian
  Giuseppe Castellucci, Danilo Croce, Roberto Basili
- Tandem LSTM–SVM Approach for Sentiment Analysis
  Andrea Cimino, Felice Dell'Orletta
- Lacam&Int@UNIBA at the EVALITA 2016–SENTIPOLC Task
  Vito Vincenzo Covella, Berardina Nadja De Carolis, Stefano Ferilli, Domenico Redavid
- Sentiment Detection using Convolutional Neural Networks with Multi–Task Training and Distant Supervision
  Jan Deriu, Mark Cieliebak
- Tweet2Check evaluation at Evalita Sentipolc 2016
  Emanuele Di Rosa, Alberto Durante
- Computational rule–based model for Irony Detection in Italian Tweets
  Simona Frenda
- On the performance of B4MSA on SENTIPOLC'16
  Daniela Moctezuma, Eric S. Tellez, Mario Graff, Sabino Miranda–Jiménez
- Exploiting Emotive Features for the Sentiment Polarity Classification of tweets
  Lucia C. Passaro, Alessandro Bondielli, Alessandro Lenci
- Samskara Minimal structural features for detecting subjectivity and polarity in Italian tweets
  Irene Russo, Monica Monachini

2016-11-29: submitted by Simonetta Montemagni, metadata incl. bibliographic data published under Creative Commons CC0
2016-12-04: published on CEUR-WS.org |valid HTML5|