| Vol-2421 urn:nbn:de:0074-2421-6 Copyright © 2019 for the individual papers by the papers' authors. Copyright © 2019 for the volume as a collection by its editors. This volume and its papers are published under the Creative Commons License Attribution 4.0 International (CC BY 4.0).

# IberLEF 2019
Iberian Languages Evaluation Forum 2019

### Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2019)
co-located with 35th Conference of the Spanish Society for Natural Language Processing (SEPLN 2019)

### Bilbao, Spain, September 24th, 2019.

Edited by

### Miguel Ángel García Cumbreras *
Julio Gonzalo **
Eugenio Martínez Cámara ***
Raquel Martínez Unanue **
Paolo Rosso ****
Jorge Carrillo-de-Albornoz **
Soto Montalvo *****
Luis Chiruzzo ******
Sandra Collovini *******
Yoan Guitiérrez ********
Salud Jiménez Zafra *
Martin Krallinger *********
Manuel Montes-y-Gómez **********
Reynier Ortega-Bueno ***********
Aiala Rosá ******

* Universidad de Jaén, Spain
** Universidad Nacional de Educación a Distancia, Spain
*** Universidad de Granada, Spain
**** PRHLT Research Center, Universitat Politècnica de València, Spain
***** Universidad Rey Juan Carlos, Spain
****** Universidad de la República, Uruguay
******* Pontificia Universidades Católica do Rio Grande do Sul, Brazil
******** Universidad de Alicante, Spain
********* Barcelona Supercomputing Center, Spain
********** Instituto Nacional de Astrofísica, Óptica y Electrónica, Mexico
*********** Universidad de Oriente, Cuba

## Table of Contents

- Preface
- Organization

### Track 1: eHealth Knowledge Discovery (eHealth-KD)

- Overview of the eHealth Knowledge Discovery Challenge at IberLEF 2019 1-16
  Alejandro Piad-Morffis, Yoan Gutiérrez, Juan Pablo Consuegra-Ayala, Suilan Estevez-Velarde, Yudivián Almeida-Cruz, Rafael Muñoz, Andrés Montoyo
- Coin_flipper at eHealth-KD Challenge 2019: Voting LSTMs for Key Phrases and Semantic Relation Identification Applied to Spanish eHealth Texts 17-25
  Neus Catalá, Mario Martin
- Hulat-TaskA at eHealth-KD Challenge 2019: Sequence Key Phrases Recognition in the Spanish Clinical Narrative 26-34
  Alejandro Ruiz-de-laCuadra, Jose Luis Lopez-Cuadrado, Israel Gonzalez-Carrasco, Belen Ruiz-Mezcua
- Hulat-TaskAB at eHealth-KD Challenge 2019: Knowledge Recognition from Health Documents by BiLSTM-CRF 35-42
  Cristóbal Colón-Ruiz, Isabel Segura-Bedmar
- IxaMed at eHealth-KD Challenge 2019: Using Different Paradigms to Solve Clinical Relation Extraction 43-50
  Iakes Goenaga, Sergio Santana, Sara Santiso, Koldo Gojenola, Alicia Pérez, Arantza Casillas
- LaSTUS-TALN at IberLEF 2019 eHealth-KD Challenge: Deep Learning Approaches to Information Extraction in Biomedical Texts 51-59
  Álex Bravo, Pablo Accuosto, Horacio Saggion
- LSI2_UNED at eHealth-KD Challenge 2019: A Few-shot Learning Model for Knowledge Discovery from eHealth Documents 60-66
  Alicia Lara-Clares, Ana Garcia-Serrano
- NLP_UNED at eHealth-KD Challenge 2019: Deep Learning for Named Entity Recognition and Attentive Relation Extraction 67-77
  Hermenegildo Fabregat, Andres Duque, Juan Martinez-Romo, Lourdes Araujo
- TALP-UPC at eHealth-KD Challenge 2019: A Joint Model with Contextual Embeddings for Clinical Information Extraction 78-84
  Salvador Medina, Jordi Turmo
- UH-MAJA-KD at eHealth-KD Challenge 2019: Deep Learning Models for Knowledge Discovery in Spanish eHealth Documents 85-94
  Jorge Mederos Alvarado, Ernesto Quevedo Caballero, Alejandro Rodríguez Pérez, Rocío Cruz Linares
- VSP at eHealth-KD Challenge 2019: Recurrent Neural Networks for Relation Classification in Spanish eHealth Documents 95-104
  Víctor Suárez-Paniagua

### Track 2: Factuality Analysis and Classification Task (FACT)

- Overview of FACT at IberLEF 2019: Factuality Analysis and Classification Task 105-110
  Aiala Rosá, Irene Castellón, Luis Chiruzzo, Hortensia Curell, Mathias Etcheverry, Ana Fernández, Gloria Vázquez, Dina Wonsever
- Amrita_CEN@FACT: Factuality Identification in Spanish Text 111-118
  Bhavukam Premjith, Kutti Padannayil Soman, Prabaharan Poornachandran
- Aspie96 at FACT (IberLEF 2019): Factuality Classification in Spanish Texts with Character-Level Convolutional RNN and Tokenization 119-125
  Valentino Giudice
- Factuality Classification Using the Pre-trained Language Representation Model BERT 126-131
  Jihang Mao, Wanli Liu

### Track 3: Humor Analysis based on Human Annotation (HAHA)

- Overview of HAHA at IberLEF 2019: Humor Analysis based on Human Annotation 132-144
  Luis Chiruzzo, Santiago Castro, Mathias Etcheverry, Diego Garat, Juan José Prada, Aiala Rosá
- LaSTUS/TALN at HAHA: Humor Analysis based on Human Annotation 145-150
  Lutfiye Seda Mut Altin, Álex Bravo, Horacio Saggion
- Generating Document Embeddings for Humor Recognition using Tensor Decomposition 151-159
  Andrew Cattle, Zhenjie Zhao, Evangelos Papalexakis, Xiaojuan Ma
- Humor Analysis Based on Human Annotation Challenge at IberLEF 2019: First-place Solution 160-164
  Adilzhan Ismailov
- Aspie96 at HAHA (IberLEF 2019): Humor Detection in Spanish Tweets with Character-Level Convolutional RNN 165-171
  Valentino Giudice
- Applying a Pre-trained Language Model to Spanish Twitter Humor Prediction 172-179
  Bobak Farzin, Piotr Czapla, Jeremy Howard
- OFAI-UKP at HAHA@IberLEF2019: Predicting the Humorousness of Tweets Using Gaussian Process Preference Learning 180-190
  Tristan Miller, Erik-Lân Do Dinh, Edwin Simpson, Iryna Gurevych
- Humor Analysis based on Human Annotation(HAHA)-2019: Humor Analysis at Tweet Level using Deep Learning 191-196
  Avishek Garain
- A BERT-based Approach for Automatic Humor Detection and Scoring 197-202
  Jihang Mao, Wanli Liu
- INGEOTEC at IberLEF 2019 Task HaHa 203-211
  José Ortiz-Bejar, Eric Tellez, Mario Graff, Daniela Moctezuma, Sabino Miranda-Jiménez
- UO_UPV2 at HAHA 2019: BiGRU Neural Network Informed with Linguistic Features for Humor Recognition 212-221
  Reynier Ortega-Bueno, Paolo Rosso, José Medina Pagola
- UTMN at HAHA@IberLEF2019: Recognizing Humor in Spanish Tweets using Hard Parameter Sharing for Neural Networks 222-228
  Anna Glazkova, Nadezhda Ganzherli, Elena Mikhalkova

### Track 4: Irony Detection in Spanish Variants (IroSvA)

- Overview of the Task on Irony Detection in Spanish Variants 229-256
  Reynier Ortega-Bueno, Francisco Rangel, Delia Irazú Hernández Farías, Paolo Rosso, Manuel Montes-y-Gómez, José Medina-Pagola
- ATC at IroSvA 2019: Shallow Syntactic Dependency-based Features for Irony Detection in Spanish Variants 257-263
  Alessandra Teresa Cignarella, Cristina Bosco
- Emotion-Based Cross-Variety Irony Detection 264-271
  Hiram Calvo, Omar Juárez Gambino
- Early Fusion of Traditional and Deep Features for Irony Detection in Twitter 272-277
  Hairo Ulises Miranda-Belmonte, Adrián Pastor López-Monroy
- ELiRF-UPV at IroSvA: Transformer Encoders for Spanish Irony Detection 278-284
  José- Ángel González, Lluís-Felip Hurtado, Ferran Pla
- A Contextualized Word Representation Approach for Irony Detection 285-290
  Lizeth García, Daniela Moctezuma, Víctor Muñiz
- LaSTUS/TALN at IroSvA: Irony Detection in Spanish Variants 291-296
  Lutfiye Seda Mut Altin, Álex Bravo, Horacio Saggion
- Computational Models for Irony Detection in Three Spanish Variants 297-309
  Simona Frenda, Viviana Patti
- UFPelRules to Irony Detection in Spanish Variants 310-314
  Diulia Justin Deon, Larissa Astrogildo de Freitas
- UO-CERPAMID at IroSvA: Impostor Method Adaptation for Irony Detection IroSvA@IberLEF 2019 315-321
  Daniel Castro, Llinet Benavides
- VRAIN at IroSva 2019: Exploring Classical and Transfer Learning Approaches to Short Message Irony Detection 322-328
  Javier Iranzo-Sánchez, Ramon Ruiz-Dolz

### Track 5: Negation in Spanish (NEGES)

- NEGES 2019 Task: Negation in Spanish 329-341
  Salud María Jiménez-Zafra, Noa Patricia Cruz Díaz, Roser Morante, María-Teresa Martín-Valdivia
- Aspie96 at NEGES (IberLEF 2019): Negation Cues Detection in Spanish with Character-Level Convolutional RNN and Tokenization 342-351
  Valentino Giudice
- Detection of Negation Cues in Spanish: The CLiC-Neg System 352-360
  Javier Beltrán, Mónica González
- Supervised Learning Approaches to Detect Negation Cues in Spanish Reviews 361-368
  Lluís Domínguez-Mas, Francesco Ronzano, Laura Furlong
- Extending a Deep Learning Approach for Negation Cues Detection in Spanish 369-377
  Hermenegildo Fabregat, Andres Duque, Juan Martinez-Romo, Lourdes Araujo
- LTG-Oslo Hierarchical Multi-task Network: The Importance of Negation for Document-level Sentiment in Spanish 378-389
  Jeremy Barnes

### Track 6: Named Entity Recognition and Relation Extraction for Portuguese (NER_Portuguese)

- IberLEF 2019 Portuguese Named Entity Recognition and Relation Extraction Tasks 390-410
  Sandra Collovini, Joaquim Santos, Bernardo Consoli, Juliano Terra, Renata Vieira, Paulo Quaresma, Marlo Souza, Daniela Barreiro Claro, Rafael Glauber
- Contextual Representations and Semi-Supervised Named Entity Recognition for Portuguese Language 411-420
  Pedro Vitor Quinta de Castro, Nádia Félix Felipe da Silva, Anderson da Silva Soares
- Adapting NER (CRF+LG) for Many Textual Genres 421-433
  Juliana Pirovani, James Alves, Marcos Spalenza, Wesley Silva, Cristiano da Silveira Colombo, Elias Oliveira
- Multidomain Contextual Embeddings for Named Entity Recognition 434-441
  Joaquim Santos, Juliano Terra, Bernardo Consoli, Renata Vieira
- Dependency Parser on Open Information Extraction for Portuguese Texts - DptOIE and DependentIE on IberLEF 442-448
  Rafael Glauber, Daniela Barreiro Claro, Leandro Souza de Oliveira
- Towards a Pragmatic Open Information Extraction for Portuguese Text - ICEIS17, InferPortOIE and PragmaticOIE on IberLEF 449-456
  Rafael Glauber, Daniela Barreiro Claro, Cleiton Fernando Lima Sena
- NER and Open Information Extraction for Portuguese: Notebook for IberLEF 2019 Portuguese Named Entity Recognition and Relation Extraction Tasks 457-467
  Pablo Gamallo, Marcos Garcia, Patricia Martín-Rodilla
- NLPyPort: Named Entity Recognition with CRF and Rule-Based Relation Extraction 468-477
  João Ferreira, Hugo Gonçalo Oliveira, Ricardo Rodrigues

### Track 7: MEX-A3T: Authorship and aggressiveness analysis in Twitter: case study in Mexican Spanish

- Overview of MEX-A3T at IberLEF 2019: Authorship and Aggressiveness Analysis in Mexican Spanish Tweets 478-494
  Mario Ezra Aragón, Miguel Álvarez-Carmona, Manuel Montes-y-Gómez, Hugo Jair Escalante, Luis Villaseñor-Pineda, Daniela Moctezuma
- Ensemble Learning to Detect Aggressiveness in Mexican Spanish Tweets 495-501
  María Dolores Molina-González, Flor Miriam Plaza-del-Arco, María Teresa Martín-Valdivia, Luis Alfonso Ureña-López
- CerpamidUA at MexA3T 2019: Transition Point Proposal 502-507
  Daniel Castro Castro, María Fernanda Artigas Herold, Reynier Ortega Bueno, Rafael Muñoz
- Author Profiling From Images Using 3D Convolutional Neural Networks 508-514
  Eduardo Valdez-Rodríguez, Hiram Calvo, Edgardo Felipe-Riverón
- Attribute Selection Techniques for Classification of Aggressive Tweets LyR-UAMC participation at MexA3T 2019 Task 515-519
  Gabriela Ramírez-de-la-Rosa, Esaú Villatoro-Tello, Héctor Jiménez-Salazar
- Detection of Aggressive Tweets in Mexican Spanish Using Multiple Features with Parameter Optimization 520-525
  Germán Ortiz, Helena Gómez-Adorno, Jorge Reyes-Magaña, Gemma Bel-Enguix, Gerardo Sierra
- Aggressiveness Identification in Twitter at IberLEF2019: Frequency Analysis Interpolation for Aggressiveness Identification 526-530
  Óscar Garibo i Orts
- Aggressive Analysis in Twitter using a Combination of Models 531-536
  Gretel Liz De la Peña Sarracén, Paolo Rosso
- UACh at MEX-A3T 2019: Preliminary Results on Detecting Aggressive Tweets by Adding Author Information Via an Unsupervised Strategy 537-543
  Marco Casavantes, Roberto López, Luis Carlos González
- Aggressiveness Detection through Deep Learning Approaches 544-549
  Victor Nina-Alcocer, José-Ángel González, Lluís-Felip Hurtado, Ferran Pla

### Track 8: Sentiment Analysis Task at SEPLN (TASS)

- Overview of TASS 2019: One More Further for the Global Spanish Sentiment Analysis Corpus 550-560
  Manuel Carlos Díaz-Galiano, Manuel García-Vega, Edgar Casasola, Luis Chiruzzo, Miguel García-Cumbreras, Eugenio Martínez Cámara, Daniela Moctezuma, Arturo Montejo Ráez, Marco Antonio Sobrevilla Cabezudo, Eric Tellez, Mario Graff, Sabino Miranda
- Atalaya at TASS 2019: Data Augmentation and Robust Embeddings for Sentiment Analysis 561-570
  Franco Martín Luque
- ELiRF-UPV at TASS 2019: Transformer Encoders for Twitter Sentiment Analysis in Spanish 571-578
  José-Ángel González, Lluís-Felip Hurtado, Ferran Pla
- GTH-UPM at TASS 2019: Sentiment Analysis of Tweets for Spanish Variants 579-588
  Ignacio González Godino, Luis Fernando D'Haro
- From Recurrency to Attention in Opinion Analysis: Comparing RNN vs Transformer Models 589-597
  Rosa María Montañés-Salas, Rafael del-Hoyo-Alonso, Rocío Aznar-Gimeno
- LaSTUS/TALN at TASS 2019: Sentiment Analysis for Spanish Language Variants with Neural Networks 598-604
  Lutfiye Seda Mut Altin, Álex Bravo, Horacio Saggion
- RETUYT-InCo at TASS 2019: Sentiment Analysis in Spanish Tweets 605-610
  Marcos Pastorini, Mauricio Pereira, Nicolás Zeballos, Luis Chiruzzo, Aiala Rosá, Mathias Etcheverry
- Sentiment Analysis at SEPLN (TASS)-2019: Sentiment Analysis at Tweet Level Using Deep Learning 611-617
  Avishek Garain, Sainik Kumar Mahata

### Track 9: Medical Document Anonymization Task (MEDDOCAN)

- Automatic De-identification of Medical Texts in Spanish: the MEDDOCAN Track, Corpus, Guidelines, Methods and Evaluation of Results 618-638
  Montserrat Marimon, Aitor Gonzalez-Agirre, Ander Intxaurrondo, Heidy Rodríguez, Jose Lopez Martin, Marta Villegas, Martin Krallinger
- Spanish Medical Document Anonymization with Three-channel Convolutional Neural Networks 639-646
  Jordi Porta-Zamorano
- Anonymization of Sensitive Information in Medical Health Records 647-653
  Bhavna Saluja, Gaurav Kumar, João Sedoc, Chris Callison-Burch
- VSP at MEDDOCAN 2019 De-Identification of Medical Documents in Spanish with Recurrent Neural Networks 654-662
  Víctor Suárez-Paniagua
- De-Identification through Named Entity Recognition for Medical Document Anonymization 663-670
  Hermenegildo Fabregat, Andres Duque, Juan Martinez-Romo, Lourdes Araujo
- NLNDE: The Neither-Language-Nor-Domain-Experts' Way of Spanish Medical Document De-Identification 671-678
  Lukas Lange, Heike Adel, Jannik Strötgen
- Protected Health Information Recognition by BiLSTM-CRF 679-686
  Cristóbal Colón-Ruiz, Isabel Segura-Bedmar
- Anonymization of Clinical Reports in Spanish: a Hybrid Method Based on Machine Learning and Rules 687-695
  Pilar López- Úbeda, Manuel Díaz-Galiano, Luis Alfonso Ureña-López, María-Teresa Martín-Valdivia
- Vicomtech at MEDDOCAN: Medical Document Anonymization 696-703
  Naiara Perez, Laura García-Sardiña, Manex Serras, Arantza Del Pozo
- Resource-Based Anonymization for Spanish Clinical Cases 704-711
  Fernando Sánchez-León
- E2EJ: Anonymization of Spanish Medical Records using End-to-End Joint Neural Networks 712-719
  Mohammed Jabreel, Fadi Hassan, Najlaa Maarrof, David Sánchez, Josep Domingo-Ferrer, Antonio Moreno
- Hadoken: a BERT-CRF Model for Medical Document Anonymization 720-726
  Jihang Mao, Wanli Liu
- ReCRF: Spanish Medical Document Anonymization using Automatically-crafted Rules and CRF 727-734
  Fadi Hassan, Mohammed Jabreel, Najlaa Maarrof, David Sánchez, Josep Domingo-Ferrer, Antonio Moreno
- A Generic Neural Exhaustive Approach for Entity Recognition and Sensitive Span Detection 735-743
  Mohammad Golam Sohrab, Pham Minh Thang, Makoto Miwa
- Window Classifiers and Conditional Random Fields for Medical Report De-Identification 744-754
  Viviana Cotik, Franco Luque, Juan Manuel Pérez
- Key Phrases Annotation in Medical Documents: MEDDOCAN 2019 Anonymization Task 755-760
  Alicia Lara-Clares, Ana Garcia-Serrano
- A Deep Learning-Based System for the MEDDOCAN Task 761-767
  Dehuan Jiang, Yedan Shen, Shuai Chen, Buzhou Tang, Xiaolong Wang, Qingcai Chen, Ruifeng Xu, Jun Yan, Yi Zhou

2019-07-26: submitted by Soto Montalvo, metadata incl. bibliographic data published under Creative Commons CC0
2019-08-01: published on CEUR-WS.org |valid HTML5|