1. Lyric alignment in popular songs Luong Minh Thang WING group meeting 12 Oct, 2007

2. Outline Recap Repetition Global alignment Local alignment Song model & Segmentation

3. Recap Given: textual transcription of lyrics acoustic musical signal of a song Purpose: find the timestamps for the beginning and ending points for each line of the song.

4. Recap (cont.) i j Lyric self- similarity matrix Chroma self- similarity matrix Lyric-chroma similarity matrix i j How to generate lyric- chroma similarity matrix?

5. Repetition self-similarity matrix j vjvj Linear sequence: v 1, v 2,.., v m + 2 units I, j will have v i, v j approximately equal + count how many times v i are repeated + count how many times v i v i+1..v i+k are repeated + average across length Repetition sequence: r 1, r 2,.., r m

6. Repetition (cont.) Chroma repetition contains noise Need to be improved here

7. Local alignment Use non-overlapped local alignment Chorus 1 Chorus 2 Chorus 3 Chorus 4 Chorus 2 vs. Chorus 1

8. Global alignment Scoring matrix to restrict skip on lyric side Free-end versions

9. Local alignment (cont.) Looking at a specific window Use local alignment to detect other segments

10. Some figures …

11. Song model Divide dataset into 2 categories: I-V1- C1-V2-C2-O & I-V1-C1-v2-C2-V3-C3-O Model for each category to tell the estimated positions of a particular

12. Segmentation Align the same segments in lyric and chroma together. Use perfect knowledge to set an aim

13. Some figures …

14. To be done Incorporate segmentation on chroma side Continue writing thesis Improving repetition values

15. Thank you !