| Vol-2670 urn:nbn:de:0074-2670-7 Copyright © 2019 for the individual papers by the papers' authors. Copyright © 2019 for the volume as a collection by its editors. This volume and its papers are published under the Creative Commons License Attribution 4.0 International (CC BY 4.0).

# MediaEval 2019
Multimedia Benchmark Workshop

### Working Notes Proceedings of the MediaEval 2019 Workshop

### Sophia Antipolis, France, 27-30 October 2019.

Edited by

### Martha Larson (1)
Steven Hicks (2)
Mihai Gabriel Constantin (3)
Benjamin Bischke (4)
Alastair Porter (5)
Peijian Zhao (6)
Mathias Lux (7)
Laura Cabrera Quiros (8)
Jordan Calandre (9)
Gareth Jones (10)

(1) Radboud University and Delft University of Technology, Netherlands
(2) SimulaMet and OsloMet, Norway
(3) University Politehnica of Bucharest, Romania
(4) German Research Center for Artificial Intelligence (DFKI) and TU Kaiserslautern, Germany
(5) Music Technology Group, Universitat Pompeu Fabra, Spain
(6) National Institute of Information and Communications Technology (NICT), Japan
(7) Alpen-Adria-Universität Klagenfurt, Austria
(8) Eindhoven University of Technology, Netherlands
(9) La Rochelle University, France
(10) Dublin City University, Ireland

## Table of Contents

### Multimedia Satellite Task Flood Severity Estimation

#### Overview paper:

- The Multimedia Satellite Task at MediaEval 2019
  Benjamin Bischke, Patrick Helber, Simon Brugman, Erkan Basar, Zhengyu Zhao, Martha Larson, Konstantin Pogorelov

#### Working notes papers:

- Ensemble and Inference based Methods for Flood Severity Estimation Using Visual Data
  Mir Murtaza, Muhammad Hanif, Muhammad Atif Tahir, Muhammad Rafi

- Flood Event Analysis Base on Pose Estimation and Water-Related Scene Recognition
  Khanh-An Quan-Chi, Tan-Cong Nguyen, Vinh-Tiep Nguyen, Minh-Triet Tran

- Multimedia Analysis Techniques for Flood Detection Using Images, Articles and Satellite Imagery
  Stelios Andreadis, Marios Bakratsas, Panagiotis Giannakeris, Anastasia Moumtzidou, Ilias Gialampoukidis, Stefanos Vrochidis, Ioannis Kompatsiaris

- AI-Based Flood Event Understanding and Quantifying Using Online Media and Satellite Data
  Mirko Zaffaroni, Laura López Fuentes, Alessandro Farasin, Paolo Garza, Harald Skinnemoen

- Transfer Learning and Mixed Input Deep Neural Networks for Estimating Flood Severity in News Content
  Pierrick Bruneau, Thomas Tamisier

- Deep Learning Models for Estimation of Flood Severity Using Multimodal and Satellite Images
  Hariny Ganapathy, Geetika Bandlamudi, Yamini L, Bhuvana J, T.T. Mirnalinee

- Multi-Modal Machine Learning for Floods Detection in News, Social Media and Satellite Sequences
  Kashif Ahmad, Konstantin Pogorelov, Mohib Ullah, Michael Riegler, Nicola Conci, Johannes Langguth, Ala Al-Fuqaha

- Flood Level Estimation from News Articles and Flood Detection from Satellite Image Sequences
  Yu Feng, Shumin Tang, Hao Cheng, Monika Sester

- Flood Severity Estimation in News Articles Using Deep Learning Approaches
  Dan Bînă, George-Alexandru Vlad, Cristian Onose, Dumitru-Clementin Cercel

- Estimation of Flood Level from Social Media Images
  Julia Strebl, Djordje Slijepcevic, Armin Kirchknopf, Muntaha Sakeena, Markus Seidl, Matthias Zeppelzauer

- MediaEval2019: Flood Detection in Time Sequence Satellite Images
  Pallavi Jain, Bianca Schoen-Phelan, Robert Ross

- Flood Severity Estimation from Online News Images and Multi-Temporal Satellite Images Using Deep Neural Networks
  Benjamin Bischke, Simon Brugman, Patrick Helber

### Predicting Media Memorability

#### Overview paper:

- The Predicting Media Memorability Task at MediaEval 2019
  Mihai Gabriel Constantin, Bogdan Ionescu, Claire-Hélène Demarty, Ngoc Q. K. Duong, Xavier Alameda-Pineda, Mats Sjöberg

#### Working notes papers:

- Predicting Media Memorability Using Ensemble Models
  David Azcona, Enric Moreu, Feiyan Hu, Tomás E. Ward, Alan F. Smeaton

- Predicting Media Memorability Using Deep Features with Attention and Recurrent Network
  Le-Vu Tran, Vinh-Loc Huynh, Minh-Triet Tran

- Combining Textual and Visual Modeling for Predicting Media Memorability
  Alison Reboud, Ismail Harrando, Jorma Laaksonen, Danny Francis, Raphaël Troncy, Héctor Laria Mantecón

- GIBIS at MediaEval 2019: Predicting Media Memorability Task
  Samuel Felipe dos Santos, Jurandy Almeida

- A Hybrid Approach for Video Memorability Prediction
  Alexander Viola, Sejong Yoon

- RUC at MediaEval 2019: Video Memorability Prediction Based on Visual Textual and Concept Related Features
  Shuai Wang, Linli Yao, Jieting Chen, Qin Jin

- Multimodal Deep Features Fusion for Video Memorability Prediction
  Roberto Leyva, Faiyaz Doctor, Alba G. Seco de Herrera, Sohail Sahab

- Using Aesthetics and Action Recognition-Based Networks for the Prediction of Media Memorability
  Mihai Gabriel Constantin, Chen Kang, Gabriela Dinu, Frédéric Dufaux, Giuseppe Valenzise, Bogdan Ionescu

### Emotion and Theme Recognition in Music Using Jamendo

#### Overview paper:

- Emotion and Theme Recognition of Music Using Convolutional Neural Networks
  Shengzhou Yi, Xueting Wang, Toshihiko Yamasaki

#### Working notes papers:

- Emotion and Themes Recognition in Music Utilising Convolutional and Recurrent Neural Networks
  Shahin Amiriparian, Maurice Gerczuk, Eduardo Coutinho, Alice Baird, Sandra Ottl, Manuel Milling, Björn Schuller

- MediaEval 2019 Emotion and Theme Recognition task: A VQ-VAE Based Approach
  Hsiao-Tzu Hung, Yu-Hua Chen, Maximilian Mayerl, Michael Vötter, Eva Zangerle, Yi-Hsuan Yang

- MediaEval 2019: Emotion and Theme Recognition in Music Using Jamendo
  Dmitry Bogdanov, Alastair Porter, Philip Tovstogan, Minz Won

- Recognizing Song Mood and Theme Using Convolutional Recurrent Neural Networks
  Maximilian Mayerl, Michael Vötter, Hsiao-Tzu Hung, Boyu Chen, Yi-Hsuan Yang, Eva Zangerle

- Emotion and Theme Recognition in Music with Frequency-Aware RF-Regularized CNNs
  Khaled Koutini, Shreyan Chowdhury, Verena Haunschmid, Hamid Eghbal-Zadeh, Gerhard Widmer

- Music Theme Recognition Using CNN and Self-Attention
  Manoj Sukhavasi, Sainath Adapa

### Medico Medical Multimedia

#### Overview paper:

- Medico Multimedia Task at MediaEval 2019
  Steven Hicks, Pål Halvorsen, Trine B. Haugen, Jorunn M. Andersen, Oliwia Witczak, Konstantin Pogorelov, Hugo L. Hammer, Duc-Tien Dang-Nguyen, Mathias Lux, Michael Riegler

#### Working notes papers:

- Predicting Sperm Motility and Morphology Using Deep Learning and Handcrafted Features
  Steven Hicks, Pål Halvorsen, Trine B. Haugen, Jorunn M. Andersen, Oliwia Witczak, Konstantin Pogorelov, Hugo L. Hammer, Duc-Tien Dang-Nguyen, Mathias Lux, Michael Riegler

- Using Deep Learning to Predict Motility and Morphology of Human Sperm
  Steven Hicks, Trine B. Haugen, Pål Halvorsen, Michael Riegler

- Stacked Dense Optical Flows and Dropout Layers to Predict Sperm Motility and Morphology
  Vajira Thambawita, Pål Halvorsen, Hugo Hammer, Michael Riegler, Trine B. Haugen

- Extracting Temporal Features into a Spatial Domain Using Autoencoders for Sperm Video Analysis
  Vajira Thambawita, Pål Halvorsen, Hugo Hammer, Michael Riegler, Trine B. Haugen

- Using 2D and 3D Convolutional Neural Networks to Predict Semen Quality
  Jon-Magnus Rosenblad, Steven Hicks, Håkon Kvale Stensland, Trine B. Haugen, Pål Halvorsen, Michael Riegler

### Insight for Wellbeing Multimodal personal health lifelog data analysis

#### Overview paper:

- Overview of MediaEval 2019: Insights for Wellbeing TaskMultimodal Personal Health Lifelog Data Analysis
  Minh-Son Dao, Peijiang Zhao, Tomohiro Sato,Koji Zettsu, Duc-Tien Dang-Nguyen, Cathal Gurrin, Ngoc-Thanh Nguyen

#### Working notes papers:

- DCU Team at the 2019 Insight for Wellbeing Task: Multimodal Personal Health Lifelog Data Analysis
  Tu-Khiem Le, Van-Tu Ninh, Liting Zhou, Duc-Tien Dang-Nguyen, Cathal Gurrin

- HCMUS at Insight for Wellbeing Task 2019: Multimodal Personal Health Lifelog Data Analysis with Inference from Multiple Sources and Attributes
  Hoang-Anh Le, Thang-Long Nguyen-Ho, Minh-Triet Tran

- Healthism@MediaEval 2019 - Insights for Wellbeing Task: Factors Related to Subjective and Objective Health
  Qi Huang, Ailin Sheng, Lei Pang, Xiaoyong Wei, Ramesh Jain

- Predicting Missing Data by Using Multimodal Data Analytics
  Loc Tai Nguyen Tan, Minh-Tam Nguyen, Dang-Hieu Nguyen

- Leveraging Egocentric and Surrounding Environment Data to Adaptively Measure a Personal Air Qality Index
  Dang-Hieu Nguyen, Minh-Tam Nguyen, Loc Tai Nguyen Tan

### Pixel Privacy

#### Overview paper:

- Pixel Privacy 2019: Protecting Sensitive Scene Information in Images
  Zhuoran Liu, Zhengyu Zhao, Martha Larson

#### Working notes papers:

- MediaEval 2019: Concealed FGSM Perturbations for Privacy Preservation
  Panagiotis Linardos, Suzanne Little, Kevin McGuinness

- HCMUS at Pixel Privacy 2019: Scene Category Protection with Back Propagation and Image Enhancement
  Hung Vinh Tran, Trong-Thang Pham, Hai-Tuan Ho-Nguyen, Hoai-Lam Nguyen-Hy, Xuan-Vy Nguyen, Thang-Long Nguyen-Ho, Minh-Triet Tran

- Adversarial Photo Frame: Concealing Sensitive Scene Information of Social Images in a User-Acceptable Manner
  Zhuoran Liu, Zhengyu Zhao

- Maintaining Perceptual Faithfulness of Adversarial Image Examples by Leveraging Color Variance
  Sam Sweere, Zhuoran Liu, Martha Larson

- Image Enhancement and Adversarial Attack Pipeline for Scene Privacy Protection
  Muhammad Bilal Sakha

### GameStory Video Game Analytics Challenge

#### Overview paper:

- GameStory Task at MediaEval 2019
  Mathias Lux, Michael Riegler, Duc-Tien Dang-Nguyen, Johanna Pirker, Martin Potthast, Pål Halvorsen

#### Working notes papers:

- Replay Detection and Multi-stream Synchronization in CS:GO Game Streams Using Content-Based Image Retrieval and Image Signature Matching
  Van-Tu Ninh, Tu-Khiem Le, Duc-Tien Dang-Nguyen, Cathal Gurrin

- DCU-ADAPT at MediaEval 2019: GameStory
  Yasufumi Moriya, Gareth J.F. Jones

- Automated Replay Detection and Multi-Stream Synchronization
  Kevin Mekul

### No-audio Multimodal Speech Detection

#### Overview paper:

- No-Audio Multimodal Speech Detection Task at MediaEval 2019
  Ekin Gedik, Laura Cabrera-Quiros, Hayley Hung

#### Working notes papers:

- Multimodal Fusion of Appearance Features, Optical Flow and Accelerometer Data for Speech Detection.
  Panagiotis Giannakeris, Stefanos Vrochidis, Ioannis Kompatsiaris

- CNNs and Fisher Vectors for No-Audio Multimodal Speech Detection
  Jose Vargas, Hayley Hung

- Combining Visual and Movement Modalities for No-audio Speech Setection
  Liandong Li, Zhuo Hao, Bo Sun

### Sports Video Annotation Detection of Strokes in Table Tennis

#### Overview paper:

- Sports Video Annotation: Detection of Strokes in Table Tennis Task for MediaEval 2019
  Pierre-Etienne Martin, Jenny Benois-Pineau, Boris Mansencal, Renaud Peteri, Laurent Mascarilla, Jordan Calandre, Julien Morlier

#### Working notes papers:

- MediaEval 2019: LRCNs for Stroke Detection in Table Tennis
  Siddharth Sriraman, Srinath Srinivasan, Vishnu K Krishnan, Bhuvana J, T.T. Mirnalinee

- Optical Flow Singularities for Sports Video Annotation: Detection of Strokes in Table Tennis
  Jordan Calandre, Renaud Péteri, Laurent Mascarilla

- Siamese Spatio-Temporal Convolutional Neural Network for Stroke Classification in Table Tennis Games
  Pierre-Etienne Martin, Jenny Benois-Pineau, Boris Mansencal, Renaud Péteri, Julien Morlier

### Eyes and Ears Together

#### Overview paper:

- MediaEval 2019: Eyes and Ears Together
  Yasufumi Moriya, Ramon Sanabria, Florian Metze, Gareth J.F. Jones

#### Working notes papers:

- HCMUS at Eyes and Ears Together 2019: Entity Localization with Guided Word Embedding and Human Pose Estimation Approach
  Gia-Han Diep, Duc-Tuan Luu, Son-Thanh Tran-Nguyen, Minh-Triet Tran

- DCU-ADAPT at MediaEval 2019: Eyes and Ears Together
  Yasufumi Moriya, Gareth J.F. Jones

### Multimedia Recommender Systems

#### Overview paper:

- The 2019 Multimedia for Recommender System Task: MovieREC and NewsREEL at MediaEval
  Yashar Deldjoo, Benny Kille, Markus Schedl, Andreas Lommatzsch, Jialie Shen

#### Working notes paper:

- A Regression Approach to Movie Rating Prediction Using Multimedia Content and Metadata
  Hossein A. Rahmani, Yashar Deldjoo, Markus Schedl

### MediaEval Letters

- Scene Change Task: Take me to Paris
  Simon Brugman, Martha Larson

2020-09-11: submitted by Steven Hicks, metadata incl. bibliographic data published under Creative Commons CC0
2020-09-13: published on CEUR Workshop Proceedings (CEUR-WS.org, ISSN 1613-0073) |valid HTML5|