Paper Detail

MusiQAl: A Dataset for Music Question-Answering through Audio-Video Fusion

Paper ID: https://openalex.org/W44127804512025Citations: 0core

Source

Transactions of the International Society for Music Information Retrieval

Slug: tismir

Abstract

Music question-answering (MQA) is a machine learning task where a computational system analyzes and answers questions about music‑related data. Traditional methods prioritize audio, overlooking visual and embodied aspects crucial to music performance understanding. We introduce MusiQAl, a multimodal dataset of 310 music performance videos and 11,793 human‑annotated question-answer pairs, spanning diverse musical traditions and styles. Grounded in musicology and music psychology, MusiQAl emphasizes multimodal reasoning, causal inference, and cross‑cultural understanding of performer-music interaction. We benchmark AVST and LAVISH architectures on MusiQAI, revealing strengths and limitations, underscoring the importance of integrating multimodal learning and domain expertise to advance MQA and music information retrieval.

Authors

  • Anna-Maria Christodoulou
  • Kyrre Glette
  • Olivier Lartillot
  • Alexander Refsum Jensenius

Topics

Music and Audio ProcessingSpeech and Audio ProcessingMusic Technology and Sound Studies

Similar papers

Next explainability step

This page now serves real metadata from Postgres. Next, attach ranking run context and per-signal contributions.