HGAIS 2024
Harmonising Generative AI and Semantic Web Technologies 2024

Table of Contents

• Preface
  Summary: There were 16 papers submitted for peer-review to this special session. Out of these, 14 papers were accepted for this volume, 14 as short papers.

Session 1. Benchmarking & Reproducibility in Generative AI for Knowledge Engineering

• Characteristics and Desiderata for Competency Question Benchmarks
  Reham Alharbi, Jacopo de Berardinis, Floriana Grasso, Terry Payne, Valentina Tamma
• Ontology Corpora for LLM-based Knowledge Engineering Research
  Guntur Budi Herwanto, Stefani Tsaneva, Marta Sabou
• LLMs for Ontology Engineering: A landscape of Tasks and Benchmarking challenges
  Daniel Garijo, María Poveda-Villalón, Elvira Amador-Domínguez, Ziyuan Wang, Raúl García-Castro, Oscar Corcho
• Benchmarking Ontology Validation Capabilities of LLMs
  Stefani Tsaneva, Guntur Budi Herwanto, Marta Sabou
• Benchmarking LLM-based Ontology Conceptualization: A Proposal
  Youssra Rebboud, Pasquale Lisena, Lionel Tailhardat, Raphaël Troncy

Session 2. Bridging the Gap: Building Knowledge-Enhanced Generative AI

• LLM-based SPARQL Query Generation from Natural Language over Federated Knowledge Graphs
  Vincent Emonet, Jerven Bolleman, Severine Duvaud, Tarcisio Mendes de Farias, Ana Claudia Sima
• A Benchmark for the Detection of Metalinguistic Disagreements between LLMs and Knowledge Graphs
  Bradley Allen, Paul Groth
• OAEI-LLM: A Benchmark Dataset for Understanding Large Language Model Hallucinations in Ontology Matching
  Zhangcheng Qiang, Kerry Taylor, Teresa Wang, Jing Jiang
• A Comprehensive Benchmark for Evaluating LLM-Generated Ontologies
  Julien Plu, Oscar Moreno Escobar, Edouard Trouillez, Axelle Gapin, Raphaël Troncy
• Explainable LLM-powered RAG To Tackle Tasks In The Unstructured-structured Data Spectrum
  Darío Garigliotti

Session 3. Spotlight on Applications and Success Stories in Generative AI and the Semantic Web

• Assessing Large Language Models for SPARQL Query Generation in Scientific Question Answering
  Antonello Meloni, Diego Reforgiato Recupero, Francesco Osborne, Angelo Salatino, Enrico Motta, Sahar Vahadati, Jens Lehmann
• Information for Conversation Generation: Proposals Utilising Knowledge Graphs
  Alex Clay, Ernesto Jiménez-Ruiz
• Hybrid Evaluation of Socratic Dialogue for Teaching
  Eleni Ilkou, Stephan Linzbach, Jonas Wallat
• ARCLIGHT: Automated Clustering and Curriculum Learning Guided by Human Training
  Jamie McCusker, Henrique Santos, Rishi Singh, Sabbir Rashid, Abraham Sanders, Grace Roessling, Hongji Guo, Bashirul Biswas, Deborah McGuinness, Tomek Strzalkowski, Qiang Ji, Jay Miller