Paper dossier

ConvM2D2: Improving Generative Music Evaluation using Self-Supervised Alternative to CLAP

Detail viewSimilarity handoff

Review source metadata, abstract, authors, topics, and local similarity context before moving into explanation and ranking views.

Paper year

2025

Citations

0

Authors

0

Topic labels

0

Paper ID: W4413574551edge sliceunknown source slug

Source readout

Source and corpus status

Venue

Unknown venue

Source slug

unknown

Corpus placement

Controlled edge slice

Similarity rows

Not available yet

Ranking readout

Where this paper lands in the current run

Ranking details could not be loaded (API 503).

Abstract

Evaluating the perceptual quality of AI-generative music remains a challenge in music information retrieval and computational creativity applications. Approaches such as those adopted in the MusicEval and AudioMOS challenges primarily rely on CLAP, a contrastive audio-text model to extract embeddings for Mean Opinion Score (MOS) prediction. While CLAP excels at coarse audio-text alignment, it struggles to capture finegrained musical attributes such as timbral richness, rhythmic precision, and structural coherence, leading to suboptimal alignment with expert human evaluations. We introduce ConvM2D2, a novel dual-branch neural architecture that leverages M2D2, a second-generation masked modeling framework, as the upstream audio encoder for MOS prediction. M2D2 is trained to reconstruct masked audio segments, enabling it to capture temporallyand acoustically-detailed features that more closely reflect human perceptual criteria. The ConvM2D2 model processes audio and text embeddings jointly through specialized convolutional and multi-layer perceptron pathways to predict both Overall Musical Quality and Textual Alignment scores. We evaluate ConvM2D2 on the MusicEval benchmark, comparing its performance against other models and achieve improvements across all evaluation metrics (MSE, LCC, SRCC, and KTAU) at both utterance-and system-level evaluation. ConvM2D2 reaches a system-level LCC of 0.964 and reduces MSE by 88% compared to the baseline, demonstrating strong alignment with human judgments across both overall musical quality and textual alignment tasks. This big improvement indicates ConvM2D2 can judge AI-generated music much more like a musical expert, making it easier to find, improve, and recommend better-sounding music.

Authors

No authors available.

Neighborhood labels

Topics

0 labels

Topic labels are imported metadata and can be noisy; use them as coarse navigation hints, not authoritative classifications.

Neighbor surface

Similar papers

Similar papers use a separately configured neighbor embedding; it may differ from the embedding version used by the current ranked run.

No embedding-backed neighbors available for this paper/version yet.

Next handoff

Best next moves from here

01

Check recommendation families

Use Recommended to see whether this paper behaves like an emerging or undercited signal in the current ranked feed, or how it appears on the bridge preview / diagnostics view.

02

Inspect nearby topics

Use Trends to understand whether its attached labels are heating up or cooling down inside the curated corpus.

03

Cross-check evaluation baselines

Use Evaluation to compare the dossier readout against citation and recency baselines for the same resolved family run.