| Vol-3476 urn:nbn:de:0074-3476-4 Copyright © 2023 for the individual papers by the papers' authors. Copyright © 2023 for the volume as a collection by its editors. This volume and its papers are published under the Creative Commons License Attribution 4.0 International (CC BY 4.0).

# PERSPECTIVES 2023
Perspectives on the Evaluation of Recommender Systems 2023

### Proceedings of the 3rd Workshop Perspectives on the Evaluation of Recommender Systems 2023
co-located with the 17th ACM Conference on Recommender Systems (RecSys 2023)

### Singapore, Singapore, September 19, 2023.

Edited by

### Alan Said, Department of Applied Information Technology, University of Gothenburg, Sweden
Eva Zangerle, Department of Computer Science, University of Innsbruck, Austria
Christine Bauer, Department of Artificial Intelligence and Human Interfaces, Paris Lodron University Salzburg, Austria

## Table of Contents

- Preface
  Summary: There were 8 papers submitted for peer-review to this workshop. Out of these, 5 papers were accepted for this volume. Furthermore, one out of three submitted abstracts was accepted.
- Annotation Practices in Societally Impactful Machine Learning Applications: What are Popular Recommender Systems Models Actually Trained On?
  Andra-Georgiana Sav, Andrew M. Demetriou, Cynthia C. S. Liem
- Exploring Effect-Size-Based Meta-Analysis for Multi-Dataset Evaluation
  Mete Sertkan, Sophia Althammer, Sebastian Hofstätter, Peter Knees, Julia Neidhardt
- Multiobjective Hyperparameter Optimization of Recommender Systems
  Marta Moscati, Yashar Deldjoo, Giulio Davide Carparelli, Markus Schedl
- The Effect of Random Seeds for Data Splitting on Recommendation Accuracy
  Lukas Wegmeth, Tobias Vente, Lennart Purucker, Joeran Beel
- Unveiling Challenging Cases in Text-based Recommender Systems
  Ghazaleh Haratinezhad Torbati, Anna Tigunova, Gerhard Weikum
- Abstract: A Common Misassumption in Online Experiments with Machine Learning Models
  Olivier Jeunen

2023-09-04: submitted Eva Zangerle, metadata incl. bibliographic data published under Creative Commons CC0
2023-09-09: published on CEUR Workshop Proceedings (CEUR-WS.org, ISSN 1613-0073) |valid HTML5|