| Vol-666 urn:nbn:de:0074-666-1 Copyright © 2010 for the individual papers by the papers' authors. Copying permitted only for private and academic purposes. This volume is published and copyrighted by its editors.

# IWEST-2010
International Workshop on Evaluation of Semantic Technologies

### Proceedings of the International Workshop on Evaluation of Semantic Technologies (IWEST 2010)

#### Workshop at the 9th International Semantic Web Conference (ISWC2010) - ISWC 2010 Workshops Volume III

### Shanghai, China, November 8, 2010.

Edited by

### Asunción Gómez-Pérez *
Fabio Ciravegna **
Frank van Harmelen ***
Jeff Hefflin ****

* Ontology Engineering Group, Universidad Politécnica de Madrid (UPM), Madrid, Spain.
** Department of Computer Science, University of Sheffield, Sheffield, UK.
*** VU University, Amsterdam, Netherlands.
**** Department of Computer Science and Engineering, Lehigh University, USA.

## Table of Contents

### Regular papers

1. Towards the evaluation of the LarKC Reasoner Plug-ins
   Zhisheng Huang
2. Beazley: a new storage systems evaluation
   Mikalai Yatskevich, Ian Horrocks, Graham Klyne
3. A framework for performance study of semantic databases
   Xianwei Shen, Vincent Huang
4. Evaluating semantic data infrastructure components for small devices
   Andriy Nikolov, Ning Li, Mathieu d'Aquin, Enrico Motta
5. A Multi-ontology synthetic benchmark for the semantic web
   Yingjie Li, Yang Yu, Jeff Heflin
6. How to benchmark RDF engines and not die trying
   Tomas Lampo, Amadis Martinez, Edna Ruckhaus, Maria Esther Vidal
7. Information system analysis
   Jasmin Opitz, Bijan Parsia, Ulrike Sattler
8. Ontology summarization: an analysis and an evaluation
   Ning Li, Enrico Motta, Mathieu d'Aquin
9. Evaluating ad-hoc object retrieval
   Harry Halpin, Daniel Herzig, Peter Mika, Roi Blanco, Jeffrey Pound, Henry Thompon, Thanh Tran Duc
10. Executing evaluations over semantic technologies using the SEALS Platform
    Miguel Esteban Gutiérrez, Raúl García-Castro, Asunción Gómez-Pérez
11. Evaluating semantic search tools using the SEALS Platform
    Stuart Wrigley, Khadija Elbedweihy, Dorothee Reinhard, Abraham Bernstein, Fabio Ciravegna
12. Evaluating semantic web service tools using the SEALS Platform
    Liliana Cabral, Ioan Toma
13. Automating OAEI campaigns (first report)
    Cássia Trojahn, Christian Meilicke, Jérôme Euzenat, Heiner Stuckenschmidt

### Poster papers

1. Storage and reasoning systems evaluation campaign 2010
   Mikalai Yatskevich, Ian Horrocks, Francisco Martin-Recuerda, Giorgos Stoilos
2. The SEALS yardsticks for ontology management
   Raúl García-Castro, Stephan Grimm, Ioan Toma, Michael Schneider, Adrian Marte

01-Nov-2010: submitted by Fabio Ciravegna, Philippe Cudre-Mauroux
02-Nov-2010: published on CEUR-WS.org