LLMS4KGOE 2026 & ELMKE 2026
LLMS4KGOE and ELMKE Workshops at ESWC 2026

Table of Contents

• Preface
  Summary: There were 19 papers submitted for peer review. Out of these 16 papers were accepted for this volume.

First Workshop on LLM-driven Knowledge Graph and Ontology Engineering (LLMS4KGOE 2026)

• Ground-truth Construction and Evaluation of LLM Contribution to Life Sciences Tool Annotation 1-10
  Ulysse Le Clanche, Melvin Selim Atay, Elise Bannier, Anaïs Baudot, Lea Bellenger, Alexandrina Bodrug, Samuel Chaffron, Eric Charpentier, Erwan Corre, Clémence Frioux, Aurélie Lardenois, Frédéric Lemoine, Camille Maumet, Cyril Noël, Perrine Paul-Gilloteaux, Paul Simion, Morgane Térézol, Olivier Dameron, Alban Gaignard
• Benchmarking Resource-Efficient LLMs for Research Topic Ontology Generation in the Biomedical Field 11-22
  Tanay Aggarwal, Angelo Salatino, Francesco Osborne, Enrico Motta
• Automating AI Risk Profiling with LLM-Engineered OWL Axioms and Reasoning 23-31
  Manas Goyal, Yogesh Kamath, Swathi Shyam Sunder
• Pitfalls in AI-Generated Ontologies: Strategies for Detection and Mitigation 32-44
  Pasquale Lisena, Julien Plu, Oscar Moreno Escobar, Edouard Trouillez, Raphaël Troncy
• PERSEUS: Reducing LLM Hallucinations in Multimodal Knowledge Graph Construction and Ontology Learning 45-51
  Aryan Singh Dalal, Hande Küçük McGinty
• OG-NSD: Neuro-Symbolic Ontology Drafting from Natural-Language Requirements 52-66
  Efstratios Skaperdas, Kristi Cami, Nick Bassiliades
• MASEO: A Multi-Agent System for Explainable Ontology Generation 67-87
  Jiayi Li, Ziyuan Wang, Daniel Garijo, María Poveda-Villalón
• IDEA2: Expert-in-the-loop Competency Question Elicitation for Collaborative Ontology Engineering 88-102
  Elliott Watkiss-Leek, Reham Alharbi, Harry Rostron, Andrew Ng, Ewan Johnson, Andrew Mitchell, Terry R. Payne, Valentina Tamma, Jacopo de Berardinis
• Towards Automated Ontology Generation from Unstructured Text: A Multi-Agent LLM Approach 103-122
  Abid Talukder, Maruf Ahmed Mridul, Oshani Seneviratne

Third Workshop on Evaluation of Language Models in Knowledge Engineering (ELMKE 2026)

• Understanding the gap in evaluation frameworks and metrics for RAG-based question-answering system 123-137
  Nakul Mehta, Adegboyega Ojo, Edward Curry
• T2S-Metrics: Unified Library for Evaluating SPARQL Queries Generated From Natural Language 138-147
  Yousouf Taghzouti, Tao Jiang, Camille Juigné, Benjamin Navet, Fabien Gandon, Franck Michel, Louis Felix Nothias
• A Benchmark and Field Study on the Use of LLMs and RAG for Harmonizing Job Descriptions in the Austrian Federal Administration 148-162
  Nicolas Ferranti, Andreas Mild, Stefan Sobernig
• Ontology Reuse in LLM-Generated Ontologies: A Comparative Evaluation Framework 163-176
  Henon Mengistu Lamboro, Amel Bouzeghoub, Cécile Rabrait, Antonio Kung, Olivier Genest, Amelie Gyrard
• Towards an Evaluation Framework for Generated Formal Knowledge 177-191
  Maxime Haurel, Armelle Brun, Mathieu D'Aquin
• Evaluating LLMs in Ontology Transformation: Study on Property Chain Shortcutting 192-199
  Kateřina Haniková, Vojtěch Svátek, Ondřej Zamazal
• LLM Driven Justified Ontology Alignment 200-212
  Diego Conde Herreros, George Hannah, Terry R. Payne, Jacopo de Berardinis, Valentina Tamma, David Chaves-Fraga, Oscar Corcho