| Vol-2419 urn:nbn:de:0074-2419-5 Copyright © 2019 for the individual papers by the papers' authors. Copying permitted for private and academic purposes. This volume is published and copyrighted by its editors.

# AISafety 2019
Artificial Intelligence Safety 2019

### Proceedings of the Workshop on Artificial Intelligence Safety 2019
co-located with the 28th International Joint Conference on Artificial Intelligence (IJCAI-19)

### Macao, China, August 11-12, 2019.

Edited by

### Huáscar Espinoza *
Han Yu **
Xiaowei Huang ***
Freddy Lecue ****
Cynthia Chen *****
José Hernández-Orallo ******
Seán Ó hÉigeartaigh *******
Richard Mallah ********

* Commissariat à l´Energie Atomique, France
** Nanyang Technological University, Singapore
*** University of Liverpool, United Kingdom
**** Thales, Canada
***** University of Hong Kong, China
****** Universitat Politècnica de València, Spain
******* University of Cambridge, United Kingdom
******** Future of Life Institute, USA

## Table of Contents

- Preface

### Frontmatter

- Author Index
- Keyword Index
- Table of Contents

### Invited Talk

- Towards a Framework for Safety Assurance of Autonomous Systems
  John McDermid, Yan Jia, Ibrahim Habli

### Session 1: Safe Learning

- Learning Modular Safe Policies in the Bandit Setting with Application to Adaptive Clinical Trials
  Hossein Aboutalebi, Doina Precup, Tibor Schuster
- Metric Learning for Value Alignment
  Andrea Loreggia, Nicholas Mattei, Francesca Rossi, Kristen Brent Venable

### Session 2: Reinforcement Learning Safety

- Penalizing Side Effects using Stepwise Relative Reachability
  Victoria Krakovna, Laurent Orseau, Miljan Martic, Shane Legg
- Conservative Agency
  Alexander Turner, Dylan Hadfield-Menell, Prasad Tadepalli
- Detecting Spiky Corruption in Markov Decision Processes
  Jason Mancuso, Tomasz Kisielewski, David Lindner, Alok Singh
- Modeling AGI Safety Frameworks with Causal Influence Diagrams
  Tom Everitt, Ramana Kumar, Victoria Krakovna, Shane Legg

### Session 3: Safe Autonomous Vehicles

- On the Susceptibility of Deep Neural Networks to Natural Perturbations
  Mesut Ozdag, Sunny Raj, Steven L. Fernandes, Alvaro Velasquez, Laura Pullum, Sumit Kumar Jha
- Managing Uncertainty of AI-based Perception for Autonomous Systems
  Maximilian Henne, Adrian Schwaiger, Gereon Weiss
- A Framework for Safety Violation Identification and Assessment in Autonomous Driving
  Lukas Heinzmann, Sina Shafaei, Mohd Hafeez Osman, Christoph Segler, Alois Knoll

### Session 4: AI Value Alignment, Ethics and Bias

- The Glass Box Approach: Verifying Contextual Adherence to Values
  Andrea Aler Tubella, Virginia Dignum
- Requisite Variety in Ethical Utility Functions for AI Value Alignment
  Nadisha-Marie Aliman, Leon Kester
- Slam the Brakes: Perceptions of Moral Decisions in Driving Dilemmas
  Holly Wilson, Andreas Theodorou
- Understanding Bias in Datasets using Topological Data Analysis
  Ramya Srinivasan, Ajay Chander

### Poster Papers

- Computational Strategies for the Trustworthy Pursuit and the Safe Modeling of Probabilistic Maintenance Commitments
  Qi Zhang, Edmund Durfee, Satinder Singh
- Categorizing Wireheading in Partially Embedded Agents
  Arushi Majha, Sayan Sarkar, Davide Zagami
- Adversarial Exploitation of Policy Imitation
  Vahid Behzadan, William Hsu
- The Challenge of Imputation in Explainable Artificial Intelligence Models
  Muhammad Ahmad, Carly Eckert, Ankur Teredesai
- On the Importance of System Testing for Assuring Safety of AI Systems
  Franz Wotawa
- Towards Empathic Deep Q-Learning
  Bart Bussmann, Jacqueline Heinerman, Joel Lehman
- Watermarking of DRL Policies with Sequential Triggers
  Vahid Behzadan, William Hsu

2019-07-23: submitted by José Hernández-Orallo, metadata incl. bibliographic data published under Creative Commons CC0
2019-07-30: published on CEUR-WS.org |valid HTML5|