MediaEval 2019
Multimedia Benchmark Workshop

Table of Contents

Multimedia Satellite Task Flood Severity Estimation

Overview paper:

• The Multimedia Satellite Task at MediaEval 2019
  Benjamin Bischke, Patrick Helber, Simon Brugman, Erkan Basar, Zhengyu Zhao, Martha Larson, Konstantin Pogorelov

Working notes papers:

• Ensemble and Inference based Methods for Flood Severity Estimation Using Visual Data
  Mir Murtaza, Muhammad Hanif, Muhammad Atif Tahir, Muhammad Rafi

• Flood Event Analysis Base on Pose Estimation and Water-Related Scene Recognition
  Khanh-An Quan-Chi, Tan-Cong Nguyen, Vinh-Tiep Nguyen, Minh-Triet Tran

• Multimedia Analysis Techniques for Flood Detection Using Images, Articles and Satellite Imagery
  Stelios Andreadis, Marios Bakratsas, Panagiotis Giannakeris, Anastasia Moumtzidou, Ilias Gialampoukidis, Stefanos Vrochidis, Ioannis Kompatsiaris

• AI-Based Flood Event Understanding and Quantifying Using Online Media and Satellite Data
  Mirko Zaffaroni, Laura López Fuentes, Alessandro Farasin, Paolo Garza, Harald Skinnemoen

• Transfer Learning and Mixed Input Deep Neural Networks for Estimating Flood Severity in News Content
  Pierrick Bruneau, Thomas Tamisier

• Deep Learning Models for Estimation of Flood Severity Using Multimodal and Satellite Images
  Hariny Ganapathy, Geetika Bandlamudi, Yamini L, Bhuvana J, T.T. Mirnalinee

• Multi-Modal Machine Learning for Floods Detection in News, Social Media and Satellite Sequences
  Kashif Ahmad, Konstantin Pogorelov, Mohib Ullah, Michael Riegler, Nicola Conci, Johannes Langguth, Ala Al-Fuqaha

• Flood Level Estimation from News Articles and Flood Detection from Satellite Image Sequences
  Yu Feng, Shumin Tang, Hao Cheng, Monika Sester

• Flood Severity Estimation in News Articles Using Deep Learning Approaches
  Dan Bînă, George-Alexandru Vlad, Cristian Onose, Dumitru-Clementin Cercel

• Estimation of Flood Level from Social Media Images
  Julia Strebl, Djordje Slijepcevic, Armin Kirchknopf, Muntaha Sakeena, Markus Seidl, Matthias Zeppelzauer

• MediaEval2019: Flood Detection in Time Sequence Satellite Images
  Pallavi Jain, Bianca Schoen-Phelan, Robert Ross

• Flood Severity Estimation from Online News Images and Multi-Temporal Satellite Images Using Deep Neural Networks
  Benjamin Bischke, Simon Brugman, Patrick Helber

Predicting Media Memorability

Overview paper:

• The Predicting Media Memorability Task at MediaEval 2019
  Mihai Gabriel Constantin, Bogdan Ionescu, Claire-Hélène Demarty, Ngoc Q. K. Duong, Xavier Alameda-Pineda, Mats Sjöberg

Working notes papers:

• Predicting Media Memorability Using Ensemble Models
  David Azcona, Enric Moreu, Feiyan Hu, Tomás E. Ward, Alan F. Smeaton

• Predicting Media Memorability Using Deep Features with Attention and Recurrent Network
  Le-Vu Tran, Vinh-Loc Huynh, Minh-Triet Tran

• Combining Textual and Visual Modeling for Predicting Media Memorability
  Alison Reboud, Ismail Harrando, Jorma Laaksonen, Danny Francis, Raphaël Troncy, Héctor Laria Mantecón

• GIBIS at MediaEval 2019: Predicting Media Memorability Task
  Samuel Felipe dos Santos, Jurandy Almeida

• A Hybrid Approach for Video Memorability Prediction
  Alexander Viola, Sejong Yoon

• RUC at MediaEval 2019: Video Memorability Prediction Based on Visual Textual and Concept Related Features
  Shuai Wang, Linli Yao, Jieting Chen, Qin Jin

• Multimodal Deep Features Fusion for Video Memorability Prediction
  Roberto Leyva, Faiyaz Doctor, Alba G. Seco de Herrera, Sohail Sahab

• Using Aesthetics and Action Recognition-Based Networks for the Prediction of Media Memorability
  Mihai Gabriel Constantin, Chen Kang, Gabriela Dinu, Frédéric Dufaux, Giuseppe Valenzise, Bogdan Ionescu

Emotion and Theme Recognition in Music Using Jamendo

Overview paper:

• Emotion and Theme Recognition of Music Using Convolutional Neural Networks
  Shengzhou Yi, Xueting Wang, Toshihiko Yamasaki

Working notes papers:

• Emotion and Themes Recognition in Music Utilising Convolutional and Recurrent Neural Networks
  Shahin Amiriparian, Maurice Gerczuk, Eduardo Coutinho, Alice Baird, Sandra Ottl, Manuel Milling, Björn Schuller

• MediaEval 2019 Emotion and Theme Recognition task: A VQ-VAE Based Approach
  Hsiao-Tzu Hung, Yu-Hua Chen, Maximilian Mayerl, Michael Vötter, Eva Zangerle, Yi-Hsuan Yang

• MediaEval 2019: Emotion and Theme Recognition in Music Using Jamendo
  Dmitry Bogdanov, Alastair Porter, Philip Tovstogan, Minz Won

• Recognizing Song Mood and Theme Using Convolutional Recurrent Neural Networks
  Maximilian Mayerl, Michael Vötter, Hsiao-Tzu Hung, Boyu Chen, Yi-Hsuan Yang, Eva Zangerle

• Emotion and Theme Recognition in Music with Frequency-Aware RF-Regularized CNNs
  Khaled Koutini, Shreyan Chowdhury, Verena Haunschmid, Hamid Eghbal-Zadeh, Gerhard Widmer

• Music Theme Recognition Using CNN and Self-Attention
  Manoj Sukhavasi, Sainath Adapa

Medico Medical Multimedia

Overview paper:

• Medico Multimedia Task at MediaEval 2019
  Steven Hicks, Pål Halvorsen, Trine B. Haugen, Jorunn M. Andersen, Oliwia Witczak, Konstantin Pogorelov, Hugo L. Hammer, Duc-Tien Dang-Nguyen, Mathias Lux, Michael Riegler

Working notes papers:

• Predicting Sperm Motility and Morphology Using Deep Learning and Handcrafted Features
  Steven Hicks, Pål Halvorsen, Trine B. Haugen, Jorunn M. Andersen, Oliwia Witczak, Konstantin Pogorelov, Hugo L. Hammer, Duc-Tien Dang-Nguyen, Mathias Lux, Michael Riegler

• Using Deep Learning to Predict Motility and Morphology of Human Sperm
  Steven Hicks, Trine B. Haugen, Pål Halvorsen, Michael Riegler

• Stacked Dense Optical Flows and Dropout Layers to Predict Sperm Motility and Morphology
  Vajira Thambawita, Pål Halvorsen, Hugo Hammer, Michael Riegler, Trine B. Haugen

• Extracting Temporal Features into a Spatial Domain Using Autoencoders for Sperm Video Analysis
  Vajira Thambawita, Pål Halvorsen, Hugo Hammer, Michael Riegler, Trine B. Haugen

• Using 2D and 3D Convolutional Neural Networks to Predict Semen Quality
  Jon-Magnus Rosenblad, Steven Hicks, Håkon Kvale Stensland, Trine B. Haugen, Pål Halvorsen, Michael Riegler

Insight for Wellbeing Multimodal personal health lifelog data analysis

Overview paper:

• Overview of MediaEval 2019: Insights for Wellbeing TaskMultimodal Personal Health Lifelog Data Analysis
  Minh-Son Dao, Peijiang Zhao, Tomohiro Sato,Koji Zettsu, Duc-Tien Dang-Nguyen, Cathal Gurrin, Ngoc-Thanh Nguyen

Working notes papers:

• DCU Team at the 2019 Insight for Wellbeing Task: Multimodal Personal Health Lifelog Data Analysis
  Tu-Khiem Le, Van-Tu Ninh, Liting Zhou, Duc-Tien Dang-Nguyen, Cathal Gurrin

• HCMUS at Insight for Wellbeing Task 2019: Multimodal Personal Health Lifelog Data Analysis with Inference from Multiple Sources and Attributes
  Hoang-Anh Le, Thang-Long Nguyen-Ho, Minh-Triet Tran

• Healthism@MediaEval 2019 - Insights for Wellbeing Task: Factors Related to Subjective and Objective Health
  Qi Huang, Ailin Sheng, Lei Pang, Xiaoyong Wei, Ramesh Jain

• Predicting Missing Data by Using Multimodal Data Analytics
  Loc Tai Nguyen Tan, Minh-Tam Nguyen, Dang-Hieu Nguyen

• Leveraging Egocentric and Surrounding Environment Data to Adaptively Measure a Personal Air Qality Index
  Dang-Hieu Nguyen, Minh-Tam Nguyen, Loc Tai Nguyen Tan

Pixel Privacy

Overview paper:

• Pixel Privacy 2019: Protecting Sensitive Scene Information in Images
  Zhuoran Liu, Zhengyu Zhao, Martha Larson

Working notes papers:

• MediaEval 2019: Concealed FGSM Perturbations for Privacy Preservation
  Panagiotis Linardos, Suzanne Little, Kevin McGuinness

• HCMUS at Pixel Privacy 2019: Scene Category Protection with Back Propagation and Image Enhancement
  Hung Vinh Tran, Trong-Thang Pham, Hai-Tuan Ho-Nguyen, Hoai-Lam Nguyen-Hy, Xuan-Vy Nguyen, Thang-Long Nguyen-Ho, Minh-Triet Tran

• Adversarial Photo Frame: Concealing Sensitive Scene Information of Social Images in a User-Acceptable Manner
  Zhuoran Liu, Zhengyu Zhao

• Maintaining Perceptual Faithfulness of Adversarial Image Examples by Leveraging Color Variance
  Sam Sweere, Zhuoran Liu, Martha Larson

• Image Enhancement and Adversarial Attack Pipeline for Scene Privacy Protection
  Muhammad Bilal Sakha

GameStory Video Game Analytics Challenge

Overview paper:

• GameStory Task at MediaEval 2019
  Mathias Lux, Michael Riegler, Duc-Tien Dang-Nguyen, Johanna Pirker, Martin Potthast, Pål Halvorsen

Working notes papers:

• Replay Detection and Multi-stream Synchronization in CS:GO Game Streams Using Content-Based Image Retrieval and Image Signature Matching
  Van-Tu Ninh, Tu-Khiem Le, Duc-Tien Dang-Nguyen, Cathal Gurrin

• DCU-ADAPT at MediaEval 2019: GameStory
  Yasufumi Moriya, Gareth J.F. Jones

• Automated Replay Detection and Multi-Stream Synchronization
  Kevin Mekul

No-audio Multimodal Speech Detection

Overview paper:

• No-Audio Multimodal Speech Detection Task at MediaEval 2019
  Ekin Gedik, Laura Cabrera-Quiros, Hayley Hung

Working notes papers:

• Multimodal Fusion of Appearance Features, Optical Flow and Accelerometer Data for Speech Detection.
  Panagiotis Giannakeris, Stefanos Vrochidis, Ioannis Kompatsiaris

• CNNs and Fisher Vectors for No-Audio Multimodal Speech Detection
  Jose Vargas, Hayley Hung

• Combining Visual and Movement Modalities for No-audio Speech Setection
  Liandong Li, Zhuo Hao, Bo Sun

Sports Video Annotation Detection of Strokes in Table Tennis

Overview paper:

• Sports Video Annotation: Detection of Strokes in Table Tennis Task for MediaEval 2019
  Pierre-Etienne Martin, Jenny Benois-Pineau, Boris Mansencal, Renaud Peteri, Laurent Mascarilla, Jordan Calandre, Julien Morlier

Working notes papers:

• MediaEval 2019: LRCNs for Stroke Detection in Table Tennis
  Siddharth Sriraman, Srinath Srinivasan, Vishnu K Krishnan, Bhuvana J, T.T. Mirnalinee

• Optical Flow Singularities for Sports Video Annotation: Detection of Strokes in Table Tennis
  Jordan Calandre, Renaud Péteri, Laurent Mascarilla

• Siamese Spatio-Temporal Convolutional Neural Network for Stroke Classification in Table Tennis Games
  Pierre-Etienne Martin, Jenny Benois-Pineau, Boris Mansencal, Renaud Péteri, Julien Morlier

Eyes and Ears Together

Overview paper:

• MediaEval 2019: Eyes and Ears Together
  Yasufumi Moriya, Ramon Sanabria, Florian Metze, Gareth J.F. Jones

Working notes papers:

• HCMUS at Eyes and Ears Together 2019: Entity Localization with Guided Word Embedding and Human Pose Estimation Approach
  Gia-Han Diep, Duc-Tuan Luu, Son-Thanh Tran-Nguyen, Minh-Triet Tran

• DCU-ADAPT at MediaEval 2019: Eyes and Ears Together
  Yasufumi Moriya, Gareth J.F. Jones

Multimedia Recommender Systems

Overview paper:

• The 2019 Multimedia for Recommender System Task: MovieREC and NewsREEL at MediaEval
  Yashar Deldjoo, Benny Kille, Markus Schedl, Andreas Lommatzsch, Jialie Shen

Working notes paper:

• A Regression Approach to Movie Rating Prediction Using Multimedia Content and Metadata
  Hossein A. Rahmani, Yashar Deldjoo, Markus Schedl

MediaEval Letters

• Scene Change Task: Take me to Paris
  Simon Brugman, Martha Larson