1. Computer Application and Resources in Music Scholarship Ichiro Fujinaga McGill University

2. 2 / 73 Summer 2004 Fujinaga Outline Introduction Introduction Notation Software Notation Software Optical Music Recognition Optical Music Recognition Databases Databases Computer Applications Computer Applications Music Information Retrieval Music Information Retrieval Conclusions Conclusions

3. 3 / 73 Summer 2004 Fujinaga Introduction Internet / Email Internet / Email Mailing lists Mailing lists American Musicological Society American Musicological Society Society of Music Theory Society of Music Theory Online journals Online journals Three types of music information Three types of music information Audio Audio Symbolic Symbolic Metadata Metadata

4. 4 / 73 Summer 2004 Fujinaga MIDI and MP3 MIDI MIDI Advantages (standard, small) Advantages (standard, small) Disadvantages (gesture-based, incomplete) Disadvantages (gesture-based, incomplete) MP3 (audio file) MP3 (audio file) P2P (Napster, Gnutella, KaZaa, eDonkey, BitTorrent) P2P (Napster, Gnutella, KaZaa, eDonkey, BitTorrent) mp3.com ($9.99/month) mp3.com ($9.99/month) pressplay.com ($9.95/month; $1/song; US only) pressplay.com ($9.95/month; $1/song; US only) apple.com ($1/song, US only) apple.com ($1/song, US only) Microsoft (€0.99/song, UK, France, Germany ) Microsoft (€0.99/song, UK, France, Germany )

5. 5 / 73 Summer 2004 Fujinaga Notation Software Commercial software Commercial software Finale Finale Sibelius Sibelius No standard file format other than MIDI No standard file format other than MIDI MusicXML (Recordare) MusicXML (Recordare) Guido Guido

6. 6 / 73 Summer 2004 Fujinaga Optical Music Recognition (OMR) Commercial software Commercial software SmartScore SmartScore SharpEye SharpEye Finale & Sibelius Finale & Sibelius Shareware software Shareware software OMeR OMeR Open-source software Open-source software Gamera Gamera

7. 7 / 73 Summer 2004 Fujinaga Gamera: Interface (screenshot in Linux)

8. 8 / 73 Summer 2004 Fujinaga Gamera: Interface (screenshot in Linux)

9. 9 / 73 Summer 2004 Fujinaga Histogram (screenshot in Linux)

10. 10 / 73 Summer 2004 Fujinaga Thresholding (screenshot in Linux)

11. 11 / 73 Summer 2004 Fujinaga Thresholding (screenshot in Linux)

12. 12 / 73 Summer 2004 Fujinaga Staff removal: Lute tablature

13. 13 / 73 Summer 2004 Fujinaga Staff removal: Lute tablature (detail)

14. 14 / 73 Summer 2004 Fujinaga Classifier: Lute tablature

15. 15 / 73 Summer 2004 Fujinaga Staff removal: Neumes

16. 16 / 73 Summer 2004 Fujinaga Classifier: Neumes

17. 17 / 73 Summer 2004 Fujinaga Greek example

18. 18 / 73 Summer 2004 Fujinaga Databases General references General references Specialized metadata Specialized metadata Music databases Music databases Sheet music Sheet music

19. 19 / 73 Summer 2004 Fujinaga General references Grove Music Online Grove Music Online

20. 20 / 73 Summer 2004 Fujinaga New Grove Dictionary (2nd ed., opera, jazz) 45000 articles, 6000 contributors, 500 sounds, 5000 links

21. 21 / 73 Summer 2004 Fujinaga General references Grove Music Online Grove Music Online RILM ( RILM (Répertoire International des Littérature Musicales)

22. 22 / 73 Summer 2004 Fujinaga RILM: Music abstracts after 1996 (329,000 items from 6200 journals)

23. 23 / 73 Summer 2004 Fujinaga General references Grove Music Online Grove Music Online RILM ( RILM (Répertoire International des Littérature Musicales) RISM ( RISM (Répertoire International des Sources Musicales)

24. 24 / 73 Summer 2004 Fujinaga RISM: Music manuscripts after 1600 456,000 items by 18,000 composers

25. 25 / 73 Summer 2004 Fujinaga General references Grove Music Online Grove Music Online RILM ( RILM (Répertoire International des Littérature Musicales) RISM ( RISM (Répertoire International des Sources Musicales) RIPM ( RIPM (Répertoire International de la Presse Musicales)

26. 26 / 73 Summer 2004 Fujinaga General references Grove Music Online Grove Music Online RILM ( RILM (Répertoire International des Littérature Musicales) RISM ( RISM (Répertoire International des Sources Musicales) RIPM ( RIPM (Répertoire International de la Presse Musicales) Music Index Music Index

27. 27 / 73 Summer 2004 Fujinaga Music Index: 700 journals

28. 28 / 73 Summer 2004 Fujinaga General references Grove Music Online Grove Music Online RILM ( RILM (Répertoire International des Littérature Musicales) RISM ( RISM (Répertoire International des Sources Musicales) RIPM ( RIPM (Répertoire International de la Presse Musicales) Music Index Music Index International Index to the Performing Arts International Index to the Performing Arts

29. 29 / 73 Summer 2004 Fujinaga International Index to the Performing Arts 400 journals (60 full text)

30. 30 / 73 Summer 2004 Fujinaga General references Grove Music Online Grove Music Online RILM ( RILM (Répertoire International des Littérature Musicales) RISM ( RISM (Répertoire International des Sources Musicales) RIPM ( RIPM (Répertoire International de la Presse Musicales) Music Index Music Index International Index to the Performing Arts International Index to the Performing Arts Canadian Music Periodical Index Canadian Music Periodical Index

31. 31 / 73 Summer 2004 Fujinaga Canadian Music Periodical Index (free!) 3,000 entries from 500 journals

32. 32 / 73 Summer 2004 Fujinaga Index des Périodiques de Musique Canadiens (gratuit!) 30,000 entrées de 500 journaux

33. 33 / 73 Summer 2004 Fujinaga General references Grove Music Online Grove Music Online RILM ( RILM (Répertoire International des Littérature Musicales) RISM ( RISM (Répertoire International des Sources Musicales) RIPM ( RIPM (Répertoire International de la Presse Musicales) Music Index Music Index International Index to the Performing Arts International Index to the Performing Arts Canadian Music Periodical Index Canadian Music Periodical Index JSTOR (major music periodicals) JSTOR (major music periodicals) JSTOR (major music periodicals) JSTOR (major music periodicals)

34. 34 / 73 Summer 2004 Fujinaga Specialized metadata Composers Composers Bach bibliography Bach bibliography Beethoven bibliography Beethoven bibliography

35. 35 / 73 Summer 2004 Fujinaga Specialized metadata Composers Composers Bach bibliography Bach bibliography Beethoven bibliography Beethoven bibliography

36. 36 / 73 Summer 2004 Fujinaga Beethoven bibliography (San José State U)

37. 37 / 73 Summer 2004 Fujinaga Specialized metadata Composers Composers Bach bibliography Bach bibliography Beethoven bibliography Beethoven bibliography Sound recordings Sound recordings WorldCat (OCLC: 1.7M recordings, 1.2M scores) WorldCat (OCLC: 1.7M recordings, 1.2M scores) SONIC (LC: 2.5M recordings) SONIC (LC: 2.5M recordings) National Sound Archives (BL: 3M recordings) National Sound Archives (BL: 3M recordings)

38. 38 / 73 Summer 2004 Fujinaga Specialized metadata Composers Composers Bach bibliography Bach bibliography Beethoven bibliography Beethoven bibliography Sound recordings Sound recordings WorldCat (OCLC: 1.7M recordings, 1.2M scores) WorldCat (OCLC: 1.7M recordings, 1.2M scores) SONIC (LC: 2.5M recordings) SONIC (LC: 2.5M recordings) National Sound Archives (BL: 3M recordings) National Sound Archives (BL: 3M recordings)

39. 39 / 73 Summer 2004 Fujinaga National Sound Archives

40. 40 / 73 Summer 2004 Fujinaga Specialized metadata Composers Composers Bach bibliography Bach bibliography Beethoven bibliography Beethoven bibliography Sound recordings Sound recordings WorldCat (OCLC: 1.7M recordings, 1.2M scores) WorldCat (OCLC: 1.7M recordings, 1.2M scores) SONIC (LC: 2.5M recordings) SONIC (LC: 2.5M recordings) National Sound Archives (BL: 3M recordings) National Sound Archives (BL: 3M recordings) allclassical.com, amazon.com allclassical.com, amazon.com

41. 41 / 73 Summer 2004 Fujinaga Specialized metadata Composers Composers Bach bibliography Bach bibliography Beethoven bibliography Beethoven bibliography Sound recordings Sound recordings WorldCat (OCLC: 1.7M recordings, 1.2M scores) WorldCat (OCLC: 1.7M recordings, 1.2M scores) SONIC (LC: 2.5M recordings) SONIC (LC: 2.5M recordings) National Sound Archives (BL: 3M recordings) National Sound Archives (BL: 3M recordings) allclassical.com, amazon.com allclassical.com, amazon.com Music portals Music portals Classical Music Resources (Duke University) Classical Music Resources (Duke University) Ufficio Ricerca Fondi Musicali di Milano Ufficio Ricerca Fondi Musicali di Milano Cecilia (UK and Ireland) Cecilia (UK and Ireland)

42. 42 / 73 Summer 2004 Fujinaga Specialized metadata Composers Composers Bach bibliography Bach bibliography Beethoven bibliography Beethoven bibliography Sound recordings Sound recordings WorldCat (OCLC: 1.7M recordings, 1.2M scores) WorldCat (OCLC: 1.7M recordings, 1.2M scores) SONIC (LC: 2.5M recordings) SONIC (LC: 2.5M recordings) National Sound Archives (BL: 3M recordings) National Sound Archives (BL: 3M recordings) allclassical.com, amazon.com allclassical.com, amazon.com Music portals Music portals Classical Music Resources (Duke University) Classical Music Resources (Duke University) Ufficio Ricerca Fondi Musicali di Milano Ufficio Ricerca Fondi Musicali di Milano Cecilia (UK and Ireland) Cecilia (UK and Ireland)

43. 43 / 73 Summer 2004 Fujinaga Classical Music Resources (Duke University)

44. 44 / 73 Summer 2004 Fujinaga Specialized metadata Composers Composers Bach bibliography Bach bibliography Beethoven bibliography Beethoven bibliography Sound recordings (index only) Sound recordings (index only) WorldCat (OCLC: 1.7M recordings, 1.2M scores) WorldCat (OCLC: 1.7M recordings, 1.2M scores) SONIC (LC: 2.5M recordings) SONIC (LC: 2.5M recordings) National Sound Archives (BL: 3M recordings) National Sound Archives (BL: 3M recordings) allclassical.com, amazon.com allclassical.com, amazon.com Music portals Music portals Classical Music Resources (Duke University) Classical Music Resources (Duke University) Cecilia (UK and Ireland) Cecilia (UK and Ireland) Ufficio Ricerca Fondi Musicali di Milano Ufficio Ricerca Fondi Musicali di Milano

45. 45 / 73 Summer 2004 Fujinaga Ufficio Ricerca Fondi Musicali di Milano

46. 46 / 73 Summer 2004 Fujinaga Music databases (indices) CANTUS (U. of Western Ontario, Canada) CANTUS (U. of Western Ontario, Canada) MELDEX (U. of Waikato, New Zealand) MELDEX (U. of Waikato, New Zealand) Themefinder (Stanford and Ohio State) Themefinder (Stanford and Ohio State) Instrument databases: Instrument databases: Baroque flute database (1,700 instruments) Baroque flute database (1,700 instruments) “The Way Famous String Instrument Went” “The Way Famous String Instrument Went”

47. 47 / 73 Summer 2004 Fujinaga CANTUS (200K entries from 50 sources)

48. 48 / 73 Summer 2004 Fujinaga Music databases (indices) CANTUS (U. of Western Ontario, Canada) CANTUS (U. of Western Ontario, Canada) MELDEX (U. of Waikato, New Zealand) MELDEX (U. of Waikato, New Zealand) Themefinder (Stanford and Ohio State) Themefinder (Stanford and Ohio State) Instrument databases: Instrument databases: Baroque flute database (1,700 instruments) Baroque flute database (1,700 instruments) “The Way Famous String Instrument Went” “The Way Famous String Instrument Went”

49. 49 / 73 Summer 2004 Fujinaga Music databases (indices) CANTUS (U. of Western Ontario, Canada) CANTUS (U. of Western Ontario, Canada) MELDEX (U. of Waikato, New Zealand) MELDEX (U. of Waikato, New Zealand) Themefinder (Stanford and Ohio State) Themefinder (Stanford and Ohio State) Instrument databases: Instrument databases: Baroque flute database (1,700 instruments) Baroque flute database (1,700 instruments) “The Way Famous String Instrument Went” “The Way Famous String Instrument Went”

50. 50 / 73 Summer 2004 Fujinaga Themefinder

51. 51 / 73 Summer 2004 Fujinaga Music databases (indices) CANTUS (U. of Western Ontario, Canada) CANTUS (U. of Western Ontario, Canada) MELDEX (U. of Waikato, New Zealand) MELDEX (U. of Waikato, New Zealand) Themefinder (Stanford and Ohio State) Themefinder (Stanford and Ohio State) Instrument databases: Instrument databases: Baroque flute database (1,700 instruments) Baroque flute database (1,700 instruments) The Way Famous String Instrument Went The Way Famous String Instrument Went

52. 52 / 73 Summer 2004 Fujinaga Music databases (indices) CANTUS (U. of Western Ontario, Canada) CANTUS (U. of Western Ontario, Canada) MELDEX (U. of Waikato, New Zealand) MELDEX (U. of Waikato, New Zealand) Themefinder (Stanford and Ohio State) Themefinder (Stanford and Ohio State) Instrument databases: Instrument databases: Baroque flute database (1,700 instruments) Baroque flute database (1,700 instruments) The Way Famous String Instrument Went The Way Famous String Instrument Went The Way Famous String Instrument Went The Way Famous String Instrument Went

53. 53 / 73 Summer 2004 Fujinaga Music databases (text) Cyber Hymnal (4,300 hymns & gospel songs: lyrics, MIDI, score) Cyber Hymnal (4,300 hymns & gospel songs: lyrics, MIDI, score) Aria database (1,300 opera arias) Aria database (1,300 opera arias) Aria database Aria database Lied and Art Song database (23,000 songs) Lied and Art Song database (23,000 songs) Gramophone magazine record reviews (23,000 since 1983) Gramophone magazine record reviews (23,000 since 1983) Thesaurus Musicarum Latinarum (Indiana) Thesaurus Musicarum Latinarum (Indiana) MuseData (Stanford) MuseData (Stanford) MuseData

54. 54 / 73 Summer 2004 Fujinaga Music databases (facsimile) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia)

55. 55 / 73 Summer 2004 Fujinaga Music databases (facsimile) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Digital Image Archive of Medieval Music (Oxford) Digital Image Archive of Medieval Music (Oxford) (Oxford)

56. 56 / 73 Summer 2004 Fujinaga DIAMM (Oxford, Royal Holloway) DIAMM (Oxford, Royal Holloway)

57. 57 / 73 Summer 2004 Fujinaga Music databases (facsimile) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Digital Image Archive of Medieval Music (Oxford) Digital Image Archive of Medieval Music (Oxford) (Oxford) Early English Books Online Early English Books Online Early English Books Online Early English Books Online

58. 58 / 73 Summer 2004 Fujinaga Music databases (facsimile) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Digital Image Archive of Medieval Music (Oxford) Digital Image Archive of Medieval Music (Oxford) (Oxford) Early English Books Online Early English Books Online Early Chopin (University of Chicago) Chopin (University of Chicago) Chopin (University of Chicago) Chopin (University of Chicago)

59. 59 / 73 Summer 2004 Fujinaga Music databases (facsimile) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Digital Image Archive of Medieval Music (Oxford) Digital Image Archive of Medieval Music (Oxford) (Oxford) Early English Books Online Early English Books Online Early Chopin (University of Chicago) Chopin (University of Chicago) Chopin (University of Chicago) Chopin (University of Chicago) Schoenberg Schoenberg Schoenberg

60. 60 / 73 Summer 2004 Fujinaga Sheet music Library of Congress 1820-85 (62,500) Library of Congress 1820-85 (62,500) Johns Hopkins 1780-1960 (29,000) Johns Hopkins 1780-1960 (29,000) Mississippi State (22,000) Mississippi State (22,000) Duke University 1850-1920 (3,042) Duke University 1850-1920 (3,042) UC Berkeley 1852-1900 (2,000) UC Berkeley 1852-1900 (2,000) Brown University 1850-1920 (1,305) Brown University 1850-1920 (1,305)

61. 61 / 73 Summer 2004 Fujinaga Levy sheet music collection Levy sheet music collection (Johns Hopkins) Levy sheet music collection

62. 62 / 73 Summer 2004 Fujinaga Sheet Music Consortium Sheet Music Consortium

63. 63 / 73 Summer 2004 Fujinaga Sheet Music Consortium

64. 64 / 73 Summer 2004 Fujinaga Library of Congress

65. 65 / 73 Summer 2004 Fujinaga Maine Music Box Maine Music Box

66. 66 / 73 Summer 2004 Fujinaga Computer Applications Compositions Compositions Instruments Instruments Interactive performances Interactive performances Pitch recognition Pitch recognition Tempo / beat induction Tempo / beat induction Expressive performance Expressive performance Music cognition Music cognition Music analysis: melodic, harmonic, key, motivic, graphic tools Music analysis: melodic, harmonic, key, motivic, graphic tools

67. 67 / 73 Summer 2004 Fujinaga Examples of Computer Applications in Musicology (1) Analysis of notational signs in 12th C. manuscripts Analysis of notational signs in 12th C. manuscripts Comparison of motets with questionable attributions Comparison of motets with questionable attributions Analyze modality vs tonality in Bach’ s four-part chorales Analyze modality vs tonality in Bach’ s four-part chorales Statistical analysis of Bach’s Well-Tempered Clavier using spreadsheet software Statistical analysis of Bach’s Well-Tempered Clavier using spreadsheet software Study of authorship of portions of Mozart’s Requiem Study of authorship of portions of Mozart’s Requiem

68. 68 / 73 Summer 2004 Fujinaga Examples of Computer Applications in Musicology (2) Transcription of tablatures Transcription of tablatures Automatic fingering of English keyboard music Automatic fingering of English keyboard music Sketch study of Alban Berg’s Wozzeck Sketch study of Alban Berg’s Wozzeck Mapping of European folksong Mapping of European folksong Divergence study by superimposing scanned images of printed music Divergence study by superimposing scanned images of printed music Watermark study using digital image processing Watermark study using digital image processing Virtual restoration of manuscripts Virtual restoration of manuscripts

69. 69 / 73 Summer 2004 Fujinaga Palimpsest: Digital restoration Corpus Christi College, Oxford MS 144

70. 70 / 73 Summer 2004 Fujinaga Digital restoration: Corpus Christi College, Oxford MS 144

71. 71 / 73 Summer 2004 Fujinaga Palimpsest: Digital restoration Corpus Christi College, Oxford MS 144

72. 72 / 73 Summer 2004 Fujinaga Music Information Retrieval (MIR) Genre / style identification Genre / style identification Timbre / instrument recognition Timbre / instrument recognition Search by humming and by examples Search by humming and by examples Audio transcription Audio transcription Fingerprinting Fingerprinting Watermarking Watermarking...... ISMIR 2004 (10-14 Oct. 2004; Barcelona) ISMIR 2004 (10-14 Oct. 2004; Barcelona)

73. 73 / 73 Summer 2004 Fujinaga Conclusions Future Future Full-text, full-search scores Full-text, full-search scores Public-domain recordings Public-domain recordings Music portals with search Music portals with search Harvesting Harvesting Web Services Web Services P2P audio distribution P2P audio distribution