| Vol-3953 urn:nbn:de:0074-3953-X Copyright © 2025 for the individual papers by the papers' authors. Copyright © 2025 for the volume as a collection by its editors. This volume and its papers are published under the Creative Commons License Attribution 4.0 International (CC BY 4.0).

# HGAIS 2024
Harmonising Generative AI and Semantic Web Technologies 2024

### Proceedings of the Special Session on Harmonising Generative AI and Semantic Web Technologies (HGAIS 2024)
co-located with the 23rd International Semantic Web Conference (ISWC 2024)

### Baltimore, Maryland, November 13, 2024.

Edited by

### Reham Alharbi *
Jacopo de Berardinis *
Paul Groth **
Albert Meroño Peñuela ***
Elena Simperl ***
Valentina Tamma *

* University of Liverpool, Department of Computer Science, Liverpool, UK
** University of Amsterdam, Informatics Institute, Netherlands, NL
*** King's College London, Department of Informatics, London, UK

## Table of Contents

- Preface
  Summary: There were 16 papers submitted for peer-review to this special session. Out of these, 14 papers were accepted for this volume, 14 as short papers.

### Session 1. Benchmarking & Reproducibility in Generative AI for Knowledge Engineering

- Characteristics and Desiderata for Competency Question Benchmarks
  Reham Alharbi, Jacopo de Berardinis, Floriana Grasso, Terry Payne, Valentina Tamma
- Ontology Corpora for LLM-based Knowledge Engineering Research
  Guntur Budi Herwanto, Stefani Tsaneva, Marta Sabou
- LLMs for Ontology Engineering: A landscape of Tasks and Benchmarking challenges
  Daniel Garijo, María Poveda-Villalón, Elvira Amador-Domínguez, Ziyuan Wang, Raúl García-Castro, Oscar Corcho
- Benchmarking Ontology Validation Capabilities of LLMs
  Stefani Tsaneva, Guntur Budi Herwanto, Marta Sabou
- Benchmarking LLM-based Ontology Conceptualization: A Proposal
  Youssra Rebboud, Pasquale Lisena, Lionel Tailhardat, Raphaël Troncy

### Session 2. Bridging the Gap: Building Knowledge-Enhanced Generative AI

- LLM-based SPARQL Query Generation from Natural Language over Federated Knowledge Graphs
  Vincent Emonet, Jerven Bolleman, Severine Duvaud, Tarcisio Mendes de Farias, Ana Claudia Sima
- A Benchmark for the Detection of Metalinguistic Disagreements between LLMs and Knowledge Graphs
  Bradley Allen, Paul Groth
- OAEI-LLM: A Benchmark Dataset for Understanding Large Language Model Hallucinations in Ontology Matching
  Zhangcheng Qiang, Kerry Taylor, Teresa Wang, Jing Jiang
- A Comprehensive Benchmark for Evaluating LLM-Generated Ontologies
  Julien Plu, Oscar Moreno Escobar, Edouard Trouillez, Axelle Gapin, Raphaël Troncy
- Explainable LLM-powered RAG To Tackle Tasks In The Unstructured-structured Data Spectrum
  Darío Garigliotti

### Session 3. Spotlight on Applications and Success Stories in Generative AI and the Semantic Web

- Assessing Large Language Models for SPARQL Query Generation in Scientific Question Answering
  Antonello Meloni, Diego Reforgiato Recupero, Francesco Osborne, Angelo Salatino, Enrico Motta, Sahar Vahadati, Jens Lehmann
- Information for Conversation Generation: Proposals Utilising Knowledge Graphs
  Alex Clay, Ernesto Jiménez-Ruiz
- Hybrid Evaluation of Socratic Dialogue for Teaching
  Eleni Ilkou, Stephan Linzbach, Jonas Wallat
- ARCLIGHT: Automated Clustering and Curriculum Learning Guided by Human Training
  Jamie McCusker, Henrique Santos, Rishi Singh, Sabbir Rashid, Abraham Sanders, Grace Roessling, Hongji Guo, Bashirul Biswas, Deborah McGuinness, Tomek Strzalkowski, Qiang Ji, Jay Miller

2025-02-26: submitted by Jacopo de Berardinis, metadata incl. bibliographic data published under Creative Commons CC0
2025-04-23: published on CEUR Workshop Proceedings (CEUR-WS.org, ISSN 1613-0073) |valid HTML5|