Paper year
2020
Paper dossier
Investigating the Perceptual Validity of Evaluation Metrics for Automatic Piano Music Transcription
Detail viewSimilarity handoff
Review source metadata, abstract, authors, topics, and local similarity context before moving into explanation and ranking views.
Citations
12
Authors
4
Topic labels
3
Source readout
Source and corpus status
Venue
Transactions of the International Society for Music Information Retrieval
Source slug
tismir
Corpus placement
Core corpus
Similarity rows
6
Ranking readout
Where this paper lands in the current run
Run shadow-generalization-product-candidate-ranking-v1Top 50 surfaced
This block uses the same resolved ranking run as Recommended. Ranks here are materialized paper_scores ranks; live Emerging may be reordered by the bounded ML scorer. Family rank is global within each family, but rank is only shown when this paper lands inside the surfaced top 50.
Families present
0
Top 50
0
Run label
shadow-generalization-product-candidate-ranking-v1
Snapshot
source-snapshot-shadow-generalization-v1-20260521
Scope: family global | run rank-83787b91ef
Emerging
No materialized row for this family in the resolved run
This paper did not surface into the current materialized family row set.
Bridge
No materialized row for this family in the resolved run
This paper did not surface into the current materialized family row set.
Under-cited
No materialized row for this family in the resolved run
This paper did not surface into the current materialized family row set.
Abstract
Automatic Music Transcription (AMT) is usually evaluated using low-level criteria, typically by counting the number of errors, with equal weighting. Yet, some errors (e.g. out-of-key notes) are more salient than others. In this study, we design an online listening test to gather judgements about AMT quality. These judgements take the form of pairwise comparisons of transcriptions of the same music by pairs of different AMT systems. We investigate how these judgements correlate with benchmark metrics, and find that although they match in many cases, agreement drops when comparing pairs with similar scores, or pairs of poor transcriptions. We show that onset-only notewise F-measure is the benchmark metric that correlates best with human judgement, all the more so with higher onset tolerance thresholds. We define a set of features related to various musical attributes, and use them to design a new metric that correlates significantly better with listeners' quality judgements. We examine which musical aspects were important to raters by conducting an ablation study on the defined metric, highlighting the importance of the rhythmic dimension (tempo, meter). We make the collected data entirely available for further study, in particular to evaluate the perceptual relevance of new AMT metrics.
Authors
Neighborhood labels
Topics
3 labels
Topic labels are imported metadata and can be noisy; use them as coarse navigation hints, not authoritative classifications.
Music and Audio ProcessingMusic Technology and Sound StudiesSpeech and Audio Processing
Neighbor surface
Similar papers
6 total neighborsEmbedding v1-title-abstract-1536-cleantext-r3
Similar papers use a separately configured neighbor embedding; it may differ from the embedding version used by the current ranked run.
- Music and Audio ProcessingMusic Technology and Sound StudiesDiverse Musicological Studies
- Music and Audio ProcessingNeuroscience and Music PerceptionSpeech and Audio Processing
- Music and Audio ProcessingMusic Technology and Sound StudiesDiverse Musicological Studies
- Music and Audio ProcessingDiverse Musicological StudiesMusic Technology and Sound Studies
- Music and Audio ProcessingMusic Technology and Sound StudiesNeuroscience and Music Perception
- Music and Audio ProcessingMusic Technology and Sound StudiesMusicology and Musical Analysis
Next handoff
Best next moves from here
01
Check recommendation families
Use Recommended to see whether this paper behaves like an emerging or undercited signal in the current ranked feed, or how it appears on the bridge preview / diagnostics view.
02
Inspect nearby topics
Use Trends to understand whether its attached labels are heating up or cooling down inside the curated corpus.
03
Cross-check evaluation baselines
Use Evaluation to compare the dossier readout against citation and recency baselines for the same resolved family run.