From a musicological perspective, the dataset enables the systematic study of Schubert’s musical language and style in Winterreise and the comparison of annotations regarding different annotators and granularities. From a technical perspective, the dataset allows for evaluating algorithmic approaches to tasks such as automated music transcription, cross-modal music alignment, or tonal analysis, and for testing these algorithms’ robustness across songs, performances, and modalities. This metadata comprises chord annotations in different granularities, local and global annotations of musical keys, and segmentations into structural parts.

Using these alignments, we provide for the different versions various musicological annotations describing tonal and structural characteristics. By means of explicit musical measure positions, we establish a temporal alignment between the different representations, thus enabling a detailed comparison across different performances and modalities. The multimodal representations comprise the singer’s lyrics, sheet music in different machine-readable formats, and audio recordings of nine performances, two of which are freely accessible for research purposes. Our dataset unifies several public sources and annotations carefully created by music experts, compiled in a comprehensive and consistent way.

Schubert’s seminal work constitutes an outstanding example of the Romantic song cycle-a central genre within Western classical music. This article presents a multimodal dataset comprising various representations and annotations of Franz Schubert’s song cycle Winterreise.

Syncplay value error time data