Lyric alignment in popular songs Luong Minh Thang WING group meeting 12 Oct, 2007

Outline Recap Repetition Global alignment Local alignment Song model & Segmentation

Recap Given: textual transcription of lyrics acoustic musical signal of a song Purpose: find the timestamps for the beginning and ending points for each line of the song.

Recap (cont.) i j Lyric self- similarity matrix Chroma self- similarity matrix Lyric-chroma similarity matrix i j How to generate lyric- chroma similarity matrix?

Repetition self-similarity matrix j vjvj Linear sequence: v 1, v 2,.., v m + 2 units I, j will have v i, v j approximately equal + count how many times v i are repeated + count how many times v i v i+1..v i+k are repeated + average across length Repetition sequence: r 1, r 2,.., r m

Repetition (cont.) Chroma repetition contains noise Need to be improved here

Local alignment Use non-overlapped local alignment Chorus 1 Chorus 2 Chorus 3 Chorus 4 Chorus 2 vs. Chorus 1

Global alignment Scoring matrix to restrict skip on lyric side Free-end versions

Local alignment (cont.) Looking at a specific window Use local alignment to detect other segments

Some figures …

Song model Divide dataset into 2 categories: I-V1- C1-V2-C2-O & I-V1-C1-v2-C2-V3-C3-O Model for each category to tell the estimated positions of a particular

Segmentation Align the same segments in lyric and chroma together. Use perfect knowledge to set an aim

Some figures …

To be done Incorporate segmentation on chroma side Continue writing thesis Improving repetition values

Thank you !