MediaEval 2021
Multimedia Benchmark 2021

Table of Contents

• Summary: There were 140 teams registered to participate in the MediaEval 2022 benchmark. This volume contains 72 peer-reviewed short poster-length papers, 10 are task overview papers and 62 are participant papers.

FakeNews

Overview paper:

• FakeNews: Corona Virus and Conspiracies Multimedia Analysis Task at MediaEval 2021
  Konstantin Pogorelov, Daniel Thilo Schroeder, Stefan Brenner, Johannes Langguth

Working notes papers:

• Don’t Just Drop Them: Function Words as Features in COVID-19 Related Fake News Classification on Twitter
  Pascal Schröder

• Classifying COVID-19 Conspiracy Tweets with Word Embedding and BERT
  Yuta Yanagi, Ryouhei Orihara, Yasuyuki Tahara, Yuichi Sei, Akihiko Ohsuga

• Short Text Classification using TF-IDF Features and Fast Text Learner
  Zeshan Khan, Umar Naseer, Muhammad Atif Tahir

• On The Pursuit of Fake News : Graph Neural Network meets NLP
  Zeynep Pehlivan

• DL-TXST Fake News: Enhancing Tweet Content Classification with Adapted Language Models
  Muhieddine Shebaro, Jason Oliver, Tomiwa Olarewaju, Jelena Tesic

• HCMUS MediaEval 2021: Multi-Model Decision Method Applied on Data Augmentation for COVID-19 Conspiracy Theories Classification
  Tuan-An To, Nham-Tan Nguyen, Dinh-Khoi Vo, Nhat-Quynh Le-Pham, Hai-Dang Nguyen, Minh-Triet Tran

• Detecting COVID-19-Related Conspiracy Theories in Tweets
  Youri Peskine, Giulio Alfarano, Ismail Harrando, Paolo Papotti, Raphaël Troncy

• On the Performance of Different Text Classification Strategies on Conspiracy Classification in Social Media
  Manfred Moosleitner, Bernjamin Murauer

• Detecting Fake News Conspiracies with Multitask and Prompt-Based Learning
  Cheikh Brahim El Vaigh, Thomas Girault, Cyrielle Mallart, Duc Hau Nguyen

• MeVer team tackling Corona virus and Conspiracies using Ensemble Classification
  Olga Papadopoulou, Symeon Papadopoulos

• Detecting COVID-19 Conspiracy Theories with Transformers and TF-IDF
  Haoming Guo, Tianyi Huang, Huixuan Huang, Mingyue Fan, Gerald Friedland

• HCMUS at MediaEval2021: Content-Based Misinformation Detection Using Contextualized Word Embedding from BERT
  Tuan Luc Huynh, Nhat-Khang Ngo, Phu-Van Nguyen, Thien Tri Cao, Thanh-Danh Le, Hai-Dang Nguyen, Minh-Triet Tran

NewsImages

Overview paper:

• News Images in MediaEval 2021
  Benjamin Kille, Andreas Lommatzsch, Özlem Özgöbek, Mehdi Elahi, Duc-Tien Dang-Nguyen

Working notes papers:

• Image-Text Rematching for News Items using Optimized Embeddings and CNNs in MediaEval NewsImages 2021
  Tom Sühr, Ajay Madhavanr, Nasim Jamshidi Avanaki, René Berk, Andreas Lommatzsch

• Image-Text Re-Matching Using Swin Transformer and DistilBERT
  Yuta Fukatsu, Masaki Aono

• Exploring a Pre-trained Model for Re-Matching News Texts and Images
  Mingliang Liang, Martha Larson

• Visual Topic Modelling for NewsImage Task at MediaEval 2021
  Lidia Pivovarova, Elaine Zosa

• NewsSeek-NOVA at MediaEval 2021: Context-enriched Multimodal Transformers For News Images Re-matching
  Cláudio Bartolomeu, Rui Nóbrega, David Semedo

• Methods for Text-Image-Rematching using Pair-wise Similarity and Canonical Similarity Analysis
  Kani Abdul, Kiran Kiran, Max Rudat, Alexandros Vasileiou, Andreas Lommatzsch

• HCMUS at MediaEval 2021: Fine-tuning CLIP for Automatic News-Images Re-Matching
  Thien Tri Cao, Nhat Khang Ngô, Thanh Danh Le, Tuan Luc Huynh, Ngoc Thien Nguyen, Hai Dang Nguyen, Minh-Triet Tran

• DL-TXST NewsImages: Contextual Feature Enrichment for Image-Text Re-matching
  Yuxiao Zhou, Andres Gonzalez, Parisa Tabassum, Jelena Tesic

• Deep Embedding-based Multimodal Matching for News Articles: Exploring the Effects of Transfer Learning & Data Augmentation
  Martin Ludwig Zehetner, Mohamed Amine Dhiab

Medico

Overview paper:

• Medico Multimedia Task at MediaEval 2021: Transparency in Medical Image Segmentation
  Steven Hicks, Debesh Jha, Vajira Thambawita, Hugo Hammer, Thomas de Lange, Sravanthi Parasa, Michael Riegler, Pål Halvorsen

Working notes papers:

• Unsupervised Image Segmentation via Self-Supervised Learning Image Classification
  Andrea Storås

• Predictive Uncertainty Masks from Deep Ensembles in Automated Polyp Segmentation
  Felicia Ly Jacobsen

• HCMUS-Juniors at Medico Polyp Segmentation Task 2021: Efficient U-Net for Polyps Segmentation
  Quoc-Huy Trinh, Trong-Hieu Nguyen Mau, Minh-Van Nguyen, Van-Son Ho, Tan-Cong Nguyen, Hai-Dang Nguyen, Minh-Triet Tran

• Medico 2021: Medical Image Augmentation and Segmentation using Combination of Segmentation Neural Networks
  Zeshan Khan, Mubasher Khan, Mubashir Yasin, Muhammad Hassan, Muhammad Atif Tahir

• Automated Polyp Segmentation in Colonoscopy using MSRFNet
  Saurab Rauniyar, Abhishek Srivastava, Vabesh Kumar Jha, Ritika Kumari Jha, Debesh Jha, Ashish Rauniyar

• A Study on Test-Time Augmentation and Attention Mechanism in DeepLabv3+ for Deep Learning-Based Segmentation
  Sy-Phuc Pham, Hyung-Jeong Yang, Duy-Phuong Dao, Soo-Hyung Kim, Guee-Sang Lee

• HCMUS at MediaEval2021: Polyps Segmentation using TransFuse with Focal Tversky Loss
  Nhat-Khang Ngo, Tuan-Luc Huynh, Thanh-Danh Le, Hai-Dang Nguyen, Minh-Triet Tran

• HCMUS at MediaEval2021: PointRend with Attention Fusion Refinement for Polyps Segmentation
  E-Ro Nguyen, Hai-Dang Nguyen, Minh-Triet Tran

Predicting Media Memorability

Overview paper:

• Overview of The MediaEval 2021 Predicting Media Memorability Task
  Rukiye Savran Kızıltepe, Mihai Gabriel Constantin, Claire-Helene Demarty, Graham Healy, Camilo Fosco, Alba García Seco De Herrera, Sebastian Halder, Bogdan Ionescu, Ana Matran-Fernandez, Alan F. Smeaton, Lorin Sweeney

Working notes papers:

• Overview of the EEG Pilot Subtask at MediaEval 2021: Predicting Media Memorability
  Lorin Sweeney, Ana Matran-Fernandez, Sebastian Halder, Alba Garcia Seco de Herrera, Alan Smeaton, Graham Healy

• Cross-modal Interaction for Video Memorability Prediction
  Youwei Lu, Xiaoyu Wu

• HCMUS at MediaEval2021: Attention-based Hierarchical Fusion Network for Predicting Media Memorability
  E-Ro Nguyen, Hai-Dang Huynh-Lam, Hai-Dang Nguyen, Minh-Triet Tran

• Predicting Media Memorability: Comparing Visual, Textual, and Auditory Features
  Lorin Sweeney, Graham Healy, Alan Smeaton

• THAU-UPM at MediaEval 2021: From Video Semantics To Memorability Using Pretrained Transformers
  Ricardo Kleinlein, Cristina Luna-Jiménez, Fernando Fernández-Martínez

• Exploring Multimodality, Perplexity and Explainability for Memorability Prediction
  Alison Reboud, Ismail Harrando, Jorma Laaksonen, Raphaël Troncy

• Using Vision Transformers and Memorable Moments for the Prediction of Video Memorability
  Mihai Gabriel Constantin, Bogdan Ionescu

Sports Video

Overview paper:

• Sports Video: Fine-Grained Action Detection and Classification of Table Tennis Strokes from videos for MediaEval 2021
  Pierre-Etienne Martin, Jordan Calandre, Boris Mansencal, Jenny Benois-Pineau, Renaud Péteri, Laurent Mascarilla, Julien Morlier

Working notes papers:

• Spatio-Temporal CNN Baseline Method for the Sports Video Task of MediaEval 2021 Benchmark
  Pierre-Etienne Martin

• HCMUS at MediaEval 2021: Ensembles of Action Recognition Networks with Prior Knowledge for Table Tennis Strokes Classification Task
  Trong-Tung Nguyen, Thanh-Son Nguyen, Gia-Bao Dinh Ho, Hai-Dang Nguyen, Minh-Triet Tran

• YOLOV5 for Stroke Detection and Classification in Table Tennis
  Bhuvana J, Mirnalinee T T, Bharathi B, Jayasooryan S, Lokesh N N

• Learning Unbiased Transformer for Long-Tail Sports Action Classification
  Yijun Qian, Lijun Yu, Wenhe Liu, Alexander Hauptmann

• Two Stream Network for Stroke Detection in Table Tennis
  Anam Zahra, Pierre-Etienne Martin

Visual Sentiment Analysis

Overview paper:

• Visual Sentiment Analysis: A Natural Disaster Use-case Task at MediaEval 2021
  Syed Zohaib Hassan, Kashif Ahmad, Michael Riegler, Steven Hicks, Nicola Conci, Pål Halvorsen, Ala Al-Fuqaha

Working notes papers:

• Combining Multiple Deep-learning-based Image Features for Visual Sentiment Analysis
  Alexandros Pournaras, Nikolaos Gkalelis, Damianos Galanopoulos, Vasileios Mezaris

• Deep Models for Visual Sentiment Analysis of Disaster-related Multimedia Content
  Khubaib Ahmad, Muhammad Asif Ayub, Kashif Ahmad, Ala Al-Fuqaha, Nasir Ahmad

• Visual Sentiment Analysis Multiplying Deep learning and Vision Transformers
  Tetsuya Asakawa, Riku Tsuneda, Masaki Aono

• Disaster based Visual Sentiment Analysis using Deep Learning
  Mohsin Ali, Muhammad Hanif, Muhammad Atif Tahir, Muhammad Nouman Durrani, Muhammad Rafi

• HCMUS at MediaEval 2021: Efficient methods of Metadata Embedding and Augmentation for Visual Sentiment Analysis
  Bang-Dang Pham, Nhat-Tan Bui, Minh-Khoi Pham, Pham Van Ngoan, Truong-Hai Nguyen, Thang-Long Nguyen-Ho, Hai-Dang Nguyen, Minh-Triet Tran

Emotions and Themes in Music

Overview paper:

• MediaEval 2021: Emotion and Theme Recognition in Music Using Jamendo
  Philip Tovstogan, Dmitry Bogdanov, Alastair Porter

Working notes papers:

• Recognizing Song Mood and Theme: Clustering-based Ensembles
  Maximilian Mayerl, Michael Vötter, Andreas Peintner, Günther Specht, Eva Zangerle

• Semi-Supervised Music Emotion Recognition using Noisy Student Training and Harmonic Pitch Class Profiles
  Hao Hao Tan

• Frequency Dependent Convolutions for Music Tagging
  Vincent Bour

• SELAB-HCMUS at MediaEval 2021: Music Theme and Emotion Classification with Co-teaching Training Strategy
  Phu-Thinh Pham, Minh-Hieu Huynh, Hai-Dang Nguyen, Minh-Triet Tran

Insight for Wellbeing

Overview paper:

• Overview of Insight for Wellbeing Task at MediaEval 2021: Cross-Data Analytics for Transboundary Haze Prediction
  Asem Kasem, Minh-Son Dao, Effa Nabilla Aziz, Duc-Tien Dang-Nguyen, Cathal Gurrin, Minh-Triet Tran, Thanh-Binh Nguyen, Wida Suhaili

Working notes papers:

• Air Quality Estimation Using LSTM and An Approach for Data Processing Techniques
  Minh-Anh Ton-Thien, Chuong Thi Nguyen, Quang Le, Dat Duong

• Towards Time Series Forecasting of Cross-Data Analytics for Haze Prediction
  Ali Akbar, Muhammad Atif Tahir, Muhammad Rafi

• Insights for Wellbeing: Predicting PM10 Values Using Stacking Ensemble Model
  Huu-Vinh Nguyen, Thi Thuy Nga Duong

• Multimodal Deep Learning for Transboundary Haze Prediction
  Thinh Nguyen, Nazmudeen Mohamed Saleem

WaterMM

Overview paper:

• WaterMM: Water Quality in Social Multimedia Task at MediaEval 2021
  Stelios Andreadis, Ilias Gialampoukidis, Aristeidis Bozas, Anastasia Moumtzidou, Roberto Fiorin, Francesca Lombardo, Anastasios Karakostas, Daniele Norbiato, Stefanos Vrochidis, Michele Ferri, Ioannis Kompatsiaris

Working notes papers:

• NLP Techniques for Water Quality Analysis in Social Media Content
  Muhammad Asif Ayub, Khubaib Ahmad, Kashif Ahmad, Nasir Ahmad, Ala Al-Fuqaha

• Deep Learning Based Framework for Classification of Water Quality in Social Media Data
  Muhammad Hanif, Ammar Khawer, Muhammad Atif Tahir, Muhammad Rafi

Emotional Mario

Overview paper:

• Emotional Mario Task at MediaEval 2021
  Mathias Lux, Michael Riegler, Steven Hicks, Duc Tien Dang Nguyen, Kristine Jorgensen, Vajira Thambawita, Pål Halvorsen

Working notes papers:

• Emotional Mario: A Games Analytics Challenge: MediaEval 2021
  Mutaz Alshaer, Kseniia Harshina, Veit Isopp

• A Preliminary Assessment of Game Event Detection in Emotional Mario Task at MediaEval 2021
  Van-Tu Ninh, Tu-Khiem Le, Manh-Duy Nguyen, Sinéad Smyth, Graham Healy, Cathal Gurrin

Emerging News

Overview paper:

• Emerging News task: Detecting emerging events from social media and news feeds
  Marc Gallofré Ocaña, Andreas L Opdahl, Duc Tien Dang Nguyen

Working notes papers:

• Mediaeval 2021 Emerging News: Detection of Emerging News from Live News Stream Based on Categorization of News Annotations
  Omar Meriwani

Video Data Privacy

Overview paper:

• Overview Paper for Driving Road Safety Forward: Video Data Privacy Task at MediaEval 2021
  Alex Liu, Andrew Boka, Asal Baragchizadeh, Chandini Muthukumar, Victoria Huang, Arjun Sarup, Regina Ferrell, Gerald Friedland, Thomas Karnowski, Meredith Lee, Alice O'Toole

Working notes papers:

• HCMUS at MediaEval 2021: Facial Data De-identification with Adversarial Generation and Perturbation Methods
  Minh-Khoi Pham, Thang-Long Nguyen-Ho, Trong-Thang Pham, Hai-Tuan Ho-Nguyen, Hai-Dang Nguyen, Minh-Triet Tran