IberLEF 2024
Iberian Languages Evaluation Forum 2024

Table of Contents

• Preface
  Summary: There were 84 papers submitted for the 12 shared tasks. All 84 submissions were accepted. These papers describe the participation of around 289 research groups from 23 countries, in 12 different NLP tasks.

• Organization
  

• Overview of IberLEF 2024: Natural Language Processing Challenges for Spanish and other Iberian Languages
  Luis Chiruzzo, Salud María Jiménez-Zafra, Francisco Rangel

AUTOMATICALLY GENERATED TEXTS IDENTIFICATION

Automated Text Identification on Languages of the Iberian Peninsula Shared Task (Iber AuTexTification)

• SINAI at IberAuTexTification in IberLEF 2024: Perplexity Metrics and Text Features for Classifying Automatically Generated Text
  César Espin-Riofrio, Jenny Ortiz-Zambrano, Arturo Montejo-Ráez
• KaramiTeam at IberAuTexTification: Soft Voting Ensemble for Distinguishing AI-Generated Texts
  Mohammad Karami Sheykhlan, Saleh Kheiri Abdoljabbar, Mona Nouri Mahmoudabad
• Multidimensional Text Feature Analysis: Unveiling the Veil of Automatically Generated Text
  Mingcan Guo, Zhongyuan Han, Xintian Wang, Jiangao Peng
• Human After All: Using Transformer Based Models to Identify Automatically Generated Text
  Jorge Fernández García, Isabel Segura-Bedmar
• Telescope: Discovering Multilingual LLM Generated Texts with Small Specialized Language Models
  Héctor Cerezo-Costas, Pedro Alonso-Doval, Maximiliano Hormazábal-Lagos, Aldan Creo
• Automated Text Identification on Languages of the Iberian Peninsula: LLM and BERT-based Models Aggregation
  German Gritsai, Andrey Grabovoy
• The iimasNLP team at IberAuTexTification 2024: Integrating Graph Neural Networks, Multilingual LLMs, and Stylometry for Automatic Text Identification
  Andric Valdez-Valenzuela, Ricardo Loth Zavala-Reyes, Victor Giovanni Morales-Murillo, Helena Goméz-Adorno

BIOMEDICAL NLP

NER in Genomic Variants and related Diseases in Spanish (GenoVarDis)

• FRE at GenoVarDis: A sane approach to Disease and Genomic Variant NER
  Ander Martínez
• GenoVarDis@IberLEF2024: Automatic Genomic Variants and Related Diseases using Named Entity Recognition with Large Language Models
  Víctor Manuel Oliveros
• ELiRF at GenoVarDis Task: NER in Genomic Variants and related Diseases
  Pere Marco, Encarna Segarra, Lluís-Felip Hurtado
• Effectiveness of Cross-linguistic Extraction of Genetic Information using Generative Large Language Models
  Milindi Kodikara, Karin Verspoor
• IIMASnlp at GenoVarDis Task: Exploring Zero-shot and CRF Approaches to NER Task in Genomic Variants and Related Diseases
  Orlando Ramos-Flores, Helena Gómez-Adorno, Edgardo Galán-Vásquez
• Named Entity Recognition in Scientific Texts Using Long Short-Term Memory Networks
  Ana Laura Lezama-Sánchez, Mireya Tovar Vidal

COUNTER SPEECH

Automatic Generation of Counter Speech in Spanish (RefutES)

• Ixa at RefutES 2024: Leveraging Language Models for Counter Narrative Generation
  Irune Zubiaga, Aitor Soroa, Rodrigo Agerri

EARLY RISK PREDICTION ON THE INTERNET

Early detection of mental disorders risk in Spanish (MentalRiskES)

• Mental Disorder Detection in Spanish: Hands on Skewed Class Distribution to Leverage Training
  Xabier Larrayoz, Arantza Casillas, Maite Oronoz, Alicia Pérez
• UNED-GELP at MentalRiskES 2024: Transformer-Based Encoders and Similarity Techniques for Early Risk Prediction of Mental Disorders
  Jorge Fernandez-Hernandez, Hermenegildo Fabregat, Andres Duque, Lourdes Araujo, Juan Martinez-Romo
• ELiRF-VRAIN at MentalRiskES 2024: Using LongFormer for Early Detection of Mental Disorders Risk
  Andreu Casamayor, Vicent Ahuir, Antonio Molina, Lluís-Felip Hurtado
• UMUTeam at MentalRiskES@IberLEF 2024: Using the Fine-Tuning Approach of Transformer-Based Models with Sentiment Feature for Early Detection of Mental Disorders
  Ronghao Pan, José Antonio García-Díaz, Rafael Valencia-García
• BUAP_01 at MentalRiskES 2024: Detection of Depression and Anxiety Using Features Based on Tagging
  Erick Barrios González, Mireya Tovar Vidal
• Early Risk Detection for Mental Health Disorders: UnibucAI at MentalRiskES 2024
  Cristian Daniel Păduraru, Ion Marian Anghelina
• UNED_MRES Team at MentalRiskES2024: Exploring Hybrid Approaches to Detect Mental Disorder Risks in Social Media
  Modesto Sierra-Callau, Miguel Ángel Rodríguez-García, Soto Montalvo-Herranz, Raquel Martínez-Unanue
• Automated Detection of Depression and Anxiety Using Lexical and Phonestheme Features in Spanish Texts
  Elizabeth Martinez, Juan Cuadrado, Juan Carlos Martinez-Santos, Edwin Puertas
• Participation of UC3M-DAD on MentalRiskES Task at IberLEF 2024
  Dario Muñoz-Muñoz, Alvaro Marco-Perez, David Ramirez
• Comparative Analysis of Machine Learning and Transformer Models for Detecting Suicidal Ideation in Social Media Texts
  Viankail Cedillo-Castelán

HARMFUL AND INCLUSIVE CONTENT

DETEction and classification of racial STereotypes in Spanish - Learning with Disagreement (DETESTS-Dis)

• I2C-Huelva at IberLEF-2024 DETESTS-Dis: Learning from Divergence to Identify Explicit and Implicit Racial Stereotypes in Spanish Texts
  Manuel Cerrejón-Naranjo, Manuel Guerrero-García, Jacinto Mata-Vázquez, Victoria Pachón-Álvarez
• UC3M-sas at IberLEF2024 DETESTS-Dis tasks
  Adrián Gónzalez Sánchez, David Santiago García-Chicangana, Santiago Rondón Galvis
• TaiDepZai999_UIT_AIC at IberLEF 2024 DETEST-Dis task: Classification of racial stereotypes in Spanish With Ensemble Learning Methods and BERT-based Adapter Head
  Le Duc Tai

Detection of Inappropriate Memes from Mexico (DIMEMEX)

• CLTL at DIMEMEX Shared Task: Fine-Grained Detection of Hate Speech in Memes
  Yeshan Wang, Ilia Markov
• DIMEMEX-2024: CyT at DIMEMEX: Leveraging Data Augmentation for the Detection of Hate Speech in Memes
  Mario García-Hidalgo, Mario García-Rodríguez, Jorge Payno, María Fernanda Salerno Isabel Segura-Bedmar
• Multimodal Hate Speech Detection in Memes from Mexico using BLIP
  Fariha Maqbool, Elisabetta Fersini
• ITC at DIMEMEX: When hate goes Viral: Detection of Hate Speech in Mexican Memes Using Transformers
  Ramón Zatarain Cabada, María Lucía Barrón Estrada, Ramón Alberto Camacho Sapien, Víctor Manuel Bátiz Beltrán, Néstor Leyva López, Manuel Alberto Sotelo Rivas
• UCM’s Participation to the 2024 DIMEMEX Task: Automatic Detection of Inappropriate Memes in Mexico
  Aisha Aman Parveen

Hate speech detection towards the Mexican Spanish speaking LGBT+ population (HOMO-MEX)

• UC-CUJAE at HOMO-MEX 2024: Detecting Hate Speech Against the LGTB+ Community using Transformers on Imbalanced Datasets
  Anibal Hernández-González, Julio Madera-Quintana, Alfredo Simón-Cuevas
• VEL at HOMO-MEX 2024: Detecting LGBT+phobia in Mexican Spanish Social Media
  Devendra Deepak Kayande, Kishore Kumar Ponnusamy, Prasanna Kumar Kumaresan, Paul Buitelaar, Bharathi Raja Chakravarthi
• The LaboCIC at HOMO-MEX 2024: Using BERT to Classify Hate-LGTB Speech
  Daniel Yacob Espinosa, Grigori Sidorov, Eusebio Ricárdez Vázquez
• CANTeam at HOMO-MEX 2024: Hate Speech Detection Towards the Mexican Spanish Speaking LGBT+ Population with Large Language Model
  Le Minh Quan, Bui Hong Son, Dang Van Thin
• HomoCIC at HOMO-MEX 2024: Deep Learning Approaches for Classifying Homophobic Content in Tweets and Songs: Leveraging LLM and NL
  Omar Garcia Vazquez, Marco Cardoso-Moreno, José Alberto Torres-León, Diana Jiménez
• I2C-UHU at HOMO-MEX 2024: Leveraging Large Language Models and Ensembling Transformers to Identify and Classify Hate Messages Towards the LGBTQ+ Community
  Javier Román-Pásaro, Alvaro Carrillo-Casado, Jacinto Mata-Vázquez, Victoria Pachón-Álvarez
• VerbaNexAI Lab at HOMO-MEX 2024: Multiclass and Multilabel Detection of LGBTQ+ Phobic Content Using Transformers
  Roger David Gonzalez-Henao, Duvan Andres Marrugo-Tobon, Juan Carlos Martinez-Santos, Edwin Puertas
• LabTL-INAOE at HOMO-MEX 2024: Distance-based Representations for LGBT+ Phobia Detection
  Metztli Ramírez-González, Delia Irazú Hernández-Farías, Manuel Montes-y-Gómez
• DSVS at HOMO-MEX24: Multi-Class and Multi-Label Hate Speech Detection using Transformer-Based Models
  Sergio Damián, David Vázquez, Edgardo Felipe-Riverón, Cornelio Yáñez-Márquez
• IntelliLeksika at HOMO-MEX 2024: Detection of Homophobic Content in Spanish Lyrics with Machine Learning
  Luis Ramos, Carolina Palma-Preciado, Olga Kolesnikova, Magdalena Saldana-Perez, Grigori Sidorov, Moein Shahiki-Tash
• ColPos at HOMO-MEX 2024: Weighted Naive Bayes for LGBTQ+Phobia Detection in Spanish Text
  Daniel Ayala Niño, Manuel Montes y Gómez, Ciro Velasco Cruz

Approaching Hope Speech Detection in Social Media from Two Perspectives, for Equality, Diversity and Inclussion and as Expectations (HOPE)

• ABCD Team at HOPE 2024: Hope Detection with BERTology Models and Data Augmentation
  Bui Hong Son, Le Minh Quan, Dang Van Thin
• An Empirical Study of Prompt Engineering with Large Language Models for Hope Detection in English and Spanish
  Nguyen Thi Thuy, Dang Van Thin
• Choosing the Right Language Model for the Right Task
  Chau Pham Quoc Hung, Dang Van Thin
• Enhancing Hope Speech Detection on Twitter Using Machine Learning and Transformer Models
  Lemlem Eyob, Tsadkan Yitbarek, Amna Naseeb, Grigori Sidorov, Ildar Batyrshin
• Hope on the Horizon: Experiments with Learning Models for Hope Speech Detection in Spanish and English
  Sonith Divakaran, Kavya Girish, Hosahalli Lakshmaiah Shashirekha
• Hope Speech in Social Media Texts using Transformer
  Girma Yohannis Bade, Olga Kolesnikova, José Luis Oropeza, Grigori Sidorov, Kidist Feleke Bergene
• HOPE: A Multilingual Approach to Identifying Positive Communication in Social Media
  Fida Ullah, Muhammad Tayyab Zamir, Muhammad Ahmad, Grigori Sidorov, Alexander Gelbukh
• HOPE@IberLEF 2024: Beyond Binary Bounds—Classifying Hope in Online Discourse
  Amna Naseeb, Kawo Lemlem Eyob, Grigori Sidorov, Olga Kolesnikova
• HOPE2024@IberLEF: A Cross-Linguistic Exploration of Hope Speech Detection in Social Media
  Mikhail Krasitskii, Olga Kolesnikova, Liliana Chanona Hernandez, Grigori Sidorov, Alexander Gelbukh
• Machine Learning Based Approach For Hope Speech Detection
  S ArunaDevi, B Bharathi
• Multiclass Hope Speech Detection Through Transformer Methods
  Zahra Ahani, Moein Shahiki Tash, Majid Tash, Alexander Gelbukh, Irna Gelbukh
• Ometeotl at HOPE2024@IberLEF: Custom BERT Models for Hope Speech Detection
  Jesús Armenta-Segura, Grigori Sidorov
• Parameter-Free Spanish Hope Speech Detection
  Michael Ibrahim
• UMUTeam at HOPE@IberLEF 2024: Fine-Tuning Approach with Sentiment and Emotion Features for Hope Speech Detection
  Ronghao Pan, Ángela Almela, Gema Alcaraz-Mármol
• UniOfGalway@IberLEF 2024:Hope Speech Recognition in Spanish: A Comparative Analysis of Transformer-Based Models
  Arunraj Subburaj, Amirthagadeshwaran Kathiresan, Rahul Ponnusamy, Paul Butilaar, Bharathi Raja Chakravarthi
• VEL@IberLEF 2024:Hope Speech Detection in Spanish Social Media Comments using BERT Pre-trained Model
  Kishore Kumar Ponnusamy, Mani Vegupatti, Prasanna Kumar Kumaresan, Ruba Priyadharshini, Paul Buitelaar, Bharathi Raja Chakravarthi3

LANGUAGE RELIABILITY

Fine-Grained Language-based Reliability Detection in Spanish News (FLARES)

• K-Flares: A K-Adapter Based Approach for the FLARES Challenge
  Joel Pardo, Jiayun Liu, Virginia Ramón-Ferrer, Elvira Amador-Domínguez, Pablo Calleja
• UMUTeam at FLARES@IberLEF 2024: Enhancing Disinformation Detection with 5W1H Techniques and Transformer Models
  Ronghao Pan, José Antonio García-Díaz, Francisco García-Sánchez, Rafael Valencia-García
• Syntax Savants-UA at IberLEF 2024: Leveraging FLAN-T5-XXL for Automatic 5W1H Identification in Texts
  Eduardo Grande, Ahmed Begga
• Fine-Grained Language-based Reliability Detection in Spanish New with Fine-Tuned Llama-3 Model
  Michael Ibrahim

POLITICAL IDEOLOGY AND PROPAGANDA

Automatic Detection and Characterization of Propaganda Techniques and Narratives from Diplomats of World Powers (DIPROMATS)

• Bilingual Propaganda Detection in Diplomats’ Tweets Using Language Models and Linguistic Features
  Arkadiusz Modzelewski, Paweł Goli, Adam Wierzbicki
• LLM-Based Multi-Agent Models for Multiclass Classification of Strategic Narratives
  Alberto Caballero, Roberto Centeno, Álvaro Rodrigo
• A Transformer and Data Augmentation-based Approach for Propaganda Identification and Classification
  Paula Sanchez-Checa, Lucía Gallego-Torres, Marco Antonio Sanchez-Escudero, Cosmin Petre, Isabel Segura-Bedmar
• Geopolitically-Informed MultiModal BERT for Propaganda Detection in Political Tweets
  Antoni Valls, Björn Komander, Jesús Cerquides
• UMUTEAM at DIPROMATS 2024: Feature Integration for Detecting Fine-grained Propaganda and Narrative
  José Antonio García-Díaz, Ronghao Pan, Andreu Rodilla Lázaro, Camilo Cristancho, Rafael Valencia-García
• VerbaNex AI at DIPROMATS 2024: Enhancing Propaganda Detection in Diplomatic Tweets with Fine-Tuned BERT and Integrated NLP Techniques
  Jose Cuadrado, Elizabeth Martinez, Juan Cuadrado, Juan Carlos Martinez-Santos, Edwin Puertas1
• PropaLTL at DIPROMATS 2024: Cross-lingual Data Augmentation for Propaganda Detection on Tweets
  Marco Casavantes, Manuel Montes-y-Gómez, Delia Irazú Hernández-Farías, Luis Carlos González, Alberto Barrón-Cedeño
• VICTOR VECTORS @ DIPROMATS 2024: Propaganda Detection with LLM Paraphrasing and Machine Translation
  Miguel Fernández, Maximiliano Ojeda, Lilly Guevara, Diego Varela, Marcelo Mendoza, Alberto Barrón-Cedeño

SENTIMENT AND EMOTION

Aspect-Based Sentiment Analysis in Portuguese 2024 (ABSAPT)

• ABCD Team at ABSAPT 2024: Classification-Based versus Generation-Based Approach for Aspect-Based Sentiment Analysis in Portuguese
  Dang Van Thin, Nguyen Tuan Kiet, Duong Ngoc Hao, Ngan Luu-Thuy Nguyen
• TeamUFPR at ABSAPT 2024: Improving Sentiment Polarity Classification with Data Augmentation using ChatGPT
  Bruno Dal Pontte, Anderson Aparecido do Carmo Frasão, Marcus Vinícius Reisdoefer Pereira, Tiago Heinrich, Vinicius Fulber-Garcia

Multimodal Speech-text Emotion Recognition in Spanish (EmoSPeech)

• BSC-UPC at EmoSPeech-IberLEF2024: Attention Pooling for Emotion Recognition
  Marc Casals-Salvador, Federico Costa, Miquel India, Javier Hernando
• CogniCIC at EmoSPeech-IberLEF2024: Exploring Multimodal Emotion Recognition in Spanish: Deep Learning Approaches for Speech-Text Analysis
  Miguel Soto, Cesar Macias, Marco Cardoso-Moreno, Tania Alcántara, Omar García, Hiram Calvo
• Team ITST at EmoSPeech-IberLEF2024: Multimodal Speech-text Emotion Recognition in Spanish Forum
  Mario Andrés Paredes-Valverde, María del Pilar Salas-Zárate
• LACELL at EmoSPeech-IberLEF2024: Combining Linguistic Features and Contextual Sentence Embeddings for Detecting Emotions from Audio Transcriptions
  Ángela Almela, Pascual Cantos-Gómez, Daniel Granados-Meroño, Gema Alcaraz-Mármol
• SINAI at EmoSPeech-IberLEF2024: Evaluating Popular Tools and Transformers Models for Multimodal Speech-Text Emotion Recognition in Spanish
  Daniel García-Baena, Miguel Ángel García-Cumbreras, Salud María Jiménez-Zafra
• THAU-UPM at EmoSPeech-IberLEF2024: Efficient Adaptation of Mono-modal and Multi-modal Large Language Models for Automatic Speech Emotion Recognition
  Sergio Esteban-Romero, Jaime Bellver-Soler, Iván Martín-Fernández, Manuel Gil-Martín, Luis Fernando D’Haro, Fernando Fernández-Martínez
• UAE at EmoSPeech–IberLEF2024: Integrating Text and Audio Features with SVM for Emotion Detection
  Katty Lagos-Ortiz, José Medina-Moreira, Oscar Apolinario-Arzube
• UAH-UVA in EmoSpeech-IberLEF2024: A Transfer Learning Approach for Emotion Recognition in Spanish Texts based on a Pre-trained DistilBERT Model
  Andrea Chaves-Villota, Ana Jimenez, Alfonso Bahillo
• UKR at EmoSPeech–IberLEF2024: Using Fine-tuning with BERT and MFCC Features for Emotion Detection
  Anatoly Gladun, Julia Rogushina, Rodrigo Martínez-Béjar
• UNED-UNIOVI at EmoSPeech-IberLEF2024: Emotion Identification in Spanish by Combining Multimodal Textual Analysis and Machine Learning Methods
  Juan Martinez-Romo, José Farnesio Huesca Barril, Lourdes Araujo, Enrique de La Cal Marin
• UTP at EmoSPeech–IberLEF2024: Using Random Forest with FastText and Wav2Vec 2.0 for Emotion Detection
  Denis Cedeño-Moreno, Miguel Vargas-Lombardo, Alan Delgado-Herrera, Camilo Caparrós-Láiz, Tomás Bernal-Beltrán