Paper year
2025
Paper dossier
Multi-Class-Token Transformer for Multitask Self-supervised Music Information Retrieval
Detail viewSimilarity handoff
Review source metadata, abstract, authors, topics, and local similarity context before moving into explanation and ranking views.
Citations
0
Authors
0
Topic labels
0
Source readout
Source and corpus status
Venue
Unknown venue
Source slug
unknown
Corpus placement
Controlled edge slice
Similarity rows
Not available yet
Ranking readout
Where this paper lands in the current run
Run shadow-generalization-product-candidate-ranking-v1Top 50 surfaced
This block uses the same resolved ranking run as Recommended. Ranks here are materialized paper_scores ranks; live Emerging may be reordered by the bounded ML scorer. Family rank is global within each family, but rank is only shown when this paper lands inside the surfaced top 50.
Families present
2
Top 50
0
Run label
shadow-generalization-product-candidate-ranking-v1
Snapshot
source-snapshot-shadow-generalization-v1-20260521
Scope: family global | run rank-83787b91ef
Emerging
Present in run, outside top 50
Emerging: embedding slice fit vs included-corpus centroid (title+abstract), plus citation velocity and topic growth; not universal relevance. Bridge signal not used here.
Signals: semantic=0.8429, citation_velocity=0.0000, topic_growth=0.0000, diversity_penalty=0.0000
Why this surfaced | 3 used | 1 penalty | 1 not computed
Embedding slice fit (corpus centroid)used
Embedding slice fit (corpus centroid): high; used in final ranking (contribution to score: 0.1686)
Recent attentionused
Recent attention: low; used in final ranking (contribution to score: 0.0000)
Topic momentumused
Topic momentum: low; used in final ranking (contribution to score: 0.0000)
Cross-cluster signalnot computed
Cross-cluster signal: not computed for this run
Similarity penaltypenalty
Similarity penalty: reduces score when non-zero (contribution to score: 0.0000)
Bridge
Present in run, outside top 50
Multi-topic paper in active topics; no cluster_version on this run so bridge_score was not computed.
Signals: citation_velocity=0.0000, topic_growth=0.0000, diversity_penalty=1.0000
Why this surfaced | 2 used | 1 penalty | 2 not computed
Semantic matchnot computed
Semantic match: not computed for this run
Recent attentionused
Recent attention: low; used in final ranking (contribution to score: 0.0000)
Topic momentumused
Topic momentum: low; used in final ranking (contribution to score: 0.0000)
Cross-cluster signalnot computed
Cross-cluster signal: not computed for this run
Topic breadth penaltypenalty
Topic breadth penalty: reduces score when non-zero (contribution to score: -0.2000)
Under-cited
No materialized row for this family in the resolved run
This paper did not surface into the current materialized family row set.
Abstract
Contrastive learning and equivariant learning are effective methods for self-supervised learning (SSL) for audio content analysis. Yet, their application to music information retrieval (MIR) faces a dilemma: the former is more effective on tagging (e.g., instrument recognition) but less effective on structured prediction (e.g., tonality estimation); The latter can match supervised methods on the specific task it is designed for, but it does not generalize well to other tasks. In this article, we adopt a best-of-both-worlds approach by training a deep neural network on both kinds of pretext tasks at once. The proposed new architecture is a Vision Transformer with 1-D spectrogram patches (ViT-1D), equipped with two class tokens, which are specialized to different self-supervised pretext tasks but optimized through the same model: hence the qualification of self-supervised multi-class-token multitask (MT2). The former class token optimizes cross-power spectral density (CPSD) for equivariant learning over the circle of fifths, while the latter optimizes normalized temperature-scaled cross-entropy (NT-Xent) for contrastive learning. MT2 combines the strengths of both pretext tasks and outperforms consistently both single-class-token ViT-1D models trained with either contrastive or equivariant learning. Averaging the two class tokens further improves performance on several tasks, highlighting the complementary nature of the representations learned by each class token. Furthermore, using the same single-linear-layer probing method on the features of last layer, MT2 outperforms MERT on all tasks except for beat tracking; achieving this with 18x fewer parameters thanks to its multitasking capabilities. Our SSL benchmark demonstrates the versatility of our multi-class-token multitask learning approach for MIR applications.
Authors
No authors available.
Neighborhood labels
Topics
0 labels
Topic labels are imported metadata and can be noisy; use them as coarse navigation hints, not authoritative classifications.
Neighbor surface
Similar papers
Similar papers use a separately configured neighbor embedding; it may differ from the embedding version used by the current ranked run.
No embedding-backed neighbors available for this paper/version yet.
Next handoff
Best next moves from here
01
Check recommendation families
Use Recommended to see whether this paper behaves like an emerging or undercited signal in the current ranked feed, or how it appears on the bridge preview / diagnostics view.
02
Inspect nearby topics
Use Trends to understand whether its attached labels are heating up or cooling down inside the curated corpus.
03
Cross-check evaluation baselines
Use Evaluation to compare the dossier readout against citation and recency baselines for the same resolved family run.