1. Computer Application and Resources in Music Scholarship the Present and the Future Susan Forscher Weiss Johns Hopkins University Ichiro Fujinaga McGill University

2. 2 DRH 2003 Weiss / Fujinaga Outline Introduction Introduction Notation Software Notation Software Optical Music Recognition Optical Music Recognition MIDI and MP3 MIDI and MP3 Databases Databases Computer Applications Computer Applications Music Information Retrieval Music Information Retrieval Conclusions Conclusions

3. 3 DRH 2003 Weiss / Fujinaga Introduction Internet Internet Email Email Mailing lists Mailing lists American Musicological Society American Musicological Society Society of Music Theory Society of Music Theory Three types of music information Three types of music information Audio Audio Symbolic Symbolic Metadata Metadata

4. 4 DRH 2003 Weiss / Fujinaga Notation Software Commercial software Commercial software Finale Finale Sibelius Sibelius Lack of standard file format Lack of standard file format Recordare: MusicXML Recordare: MusicXML Guido Guido

5. 5 DRH 2003 Weiss / Fujinaga Optical Music Recognition Commercial software Commercial software SmartScore SmartScore SharpEye SharpEye Finale & Sibelius Finale & Sibelius Shareware software Shareware software OMeR OMeR Open-source software Open-source software Gamera Gamera

6. 6 DRH 2003 Weiss / Fujinaga Thresholding (screenshot in Linux) OMR: Preprocessing

7. 7 DRH 2003 Weiss / Fujinaga Staff removal: Lute tablature

8. 8 DRH 2003 Weiss / Fujinaga Staff removal: Lute tablature (detail)

9. 9 DRH 2003 Weiss / Fujinaga Classifier: Lute tablature

10. 10 DRH 2003 Weiss / Fujinaga Staff removal: Neumes

11. 11 DRH 2003 Weiss / Fujinaga Classifier: Neums

12. 12 DRH 2003 Weiss / Fujinaga MIDI and MP3 MIDI MIDI Advantages (standard, small) Advantages (standard, small) Disadvantages (gesture-based, incomplete) Disadvantages (gesture-based, incomplete) MP3 (audio file) MP3 (audio file) P2P (Napster, Gnutella, KaZaa) P2P (Napster, Gnutella, KaZaa) mp3.com ($9.99/month) mp3.com ($9.99/month) pressplay.com ($9.95/month; $1/song; US only) pressplay.com ($9.95/month; $1/song; US only) apple.com ($1/song, US only) apple.com ($1/song, US only) Microsoft (€0.99/song, UK, France, Germany ) Microsoft (€0.99/song, UK, France, Germany )

13. 13 DRH 2003 Weiss / Fujinaga Databases General references General references Specialized metadata Specialized metadata Music databases Music databases Sheet music Sheet music

14. 14 DRH 2003 Weiss / Fujinaga General references Grove Music Online Grove Music Online

15. 15 DRH 2003 Weiss / Fujinaga New Grove Dictionary (2nd ed., opera, jazz) 29,000 articles, 6000 contributers

16. 16 DRH 2003 Weiss / Fujinaga General references Grove Music Online Grove Music Online RILM ( RILM (Répertoire International des Littérature Musicales)

17. 17 DRH 2003 Weiss / Fujinaga RILM: Music abstracts after 1996 (323,000 items from 5200 journals)

18. 18 DRH 2003 Weiss / Fujinaga General references Grove Music Online Grove Music Online RILM ( RILM (Répertoire International des Littérature Musicales) RISM ( RISM (Répertoire International des Sources Musicales)

19. 19 DRH 2003 Weiss / Fujinaga RISM: Music manuscripts after 1600 (412,000 items)

20. 20 DRH 2003 Weiss / Fujinaga General references Grove Music Online Grove Music Online RILM ( RILM (Répertoire International des Littérature Musicales) RISM ( RISM (Répertoire International des Sources Musicales) RIPM ( RIPM (Répertoire International de la Presse Musicales)

21. 21 DRH 2003 Weiss / Fujinaga General references Grove Music Online Grove Music Online RILM ( RILM (Répertoire International des Littérature Musicales) RISM ( RISM (Répertoire International des Sources Musicales) RIPM ( RIPM (Répertoire International de la Presse Musicales) Music Index Music Index

22. 22 DRH 2003 Weiss / Fujinaga Music Index: 690 journals

23. 23 DRH 2003 Weiss / Fujinaga General references Grove Music Online Grove Music Online RILM ( RILM (Répertoire International des Littérature Musicales) RISM ( RISM (Répertoire International des Sources Musicales) RIPM ( RIPM (Répertoire International de la Presse Musicales) Music Index Music Index International Index to the Performing Arts International Index to the Performing Arts

24. 24 DRH 2003 Weiss / Fujinaga International Index to the Performing Arts 400 journals (60 full text)

25. 25 DRH 2003 Weiss / Fujinaga General references Grove Music Online Grove Music Online RILM ( RILM (Répertoire International des Littérature Musicales) RISM ( RISM (Répertoire International des Sources Musicales) RIPM ( RIPM (Répertoire International de la Presse Musicales) Music Index Music Index International Index to the Performing Arts International Index to the Performing Arts Canadian Music Periodical Index Canadian Music Periodical Index

26. 26 DRH 2003 Weiss / Fujinaga Canadian Music Periodical Index (free!) 3,000 entries from 500 journals

27. 27 DRH 2003 Weiss / Fujinaga Index des Périodiques de Musique Canadiens (gratuit!) 30,000 entrées de 500 journaux

28. 28 DRH 2003 Weiss / Fujinaga Specialized metadata Composers Composers Bach bibliography Bach bibliography Beethoven bibliography Beethoven bibliography

29. 29 DRH 2003 Weiss / Fujinaga Specialized metadata Composers Composers Bach bibliography Bach bibliography Beethoven bibliography Beethoven bibliography

30. 30 DRH 2003 Weiss / Fujinaga Beethoven bibliography (San José State U)

31. 31 DRH 2003 Weiss / Fujinaga Specialized metadata Composers Composers Bach bibliography Bach bibliography Beethoven bibliography Beethoven bibliography Sound recordings Sound recordings WorldCat (OCLC: 1.7M recordings, 1.2M scores) WorldCat (OCLC: 1.7M recordings, 1.2M scores) SONIC (LC: 2.5M recordings) SONIC (LC: 2.5M recordings) National Sound Archives (BL: 3M recordings) National Sound Archives (BL: 3M recordings)

32. 32 DRH 2003 Weiss / Fujinaga Specialized metadata Composers Composers Bach bibliography Bach bibliography Beethoven bibliography Beethoven bibliography Sound recordings Sound recordings WorldCat (OCLC: 1.7M recordings, 1.2M scores) WorldCat (OCLC: 1.7M recordings, 1.2M scores) SONIC (LC: 2.5M recordings) SONIC (LC: 2.5M recordings) National Sound Archives (BL: 3M recordings) National Sound Archives (BL: 3M recordings)

33. 33 DRH 2003 Weiss / Fujinaga National Sound Archives

34. 34 DRH 2003 Weiss / Fujinaga Specialized metadata Composers Composers Bach bibliography Bach bibliography Beethoven bibliography Beethoven bibliography Sound recordings Sound recordings WorldCat (OCLC: 1.7M recordings, 1.2M scores) WorldCat (OCLC: 1.7M recordings, 1.2M scores) SONIC (LC: 2.5M recordings) SONIC (LC: 2.5M recordings) National Sound Archives (BL: 3M recordings) National Sound Archives (BL: 3M recordings) allclassical.com, amazon.com allclassical.com, amazon.com

35. 35 DRH 2003 Weiss / Fujinaga Specialized metadata Composers Composers Bach bibliography Bach bibliography Beethoven bibliography Beethoven bibliography Sound recordings Sound recordings WorldCat (OCLC: 1.7M recordings, 1.2M scores) WorldCat (OCLC: 1.7M recordings, 1.2M scores) SONIC (LC: 2.5M recordings) SONIC (LC: 2.5M recordings) National Sound Archives (BL: 3M recordings) National Sound Archives (BL: 3M recordings) allclassical.com, amazon.com allclassical.com, amazon.com Music portals Music portals Classical Music Resources (Duke University) Classical Music Resources (Duke University) Ufficio Ricerca Fondi Musicali di Milano Ufficio Ricerca Fondi Musicali di Milano Cecilia (UK and Ireland) Cecilia (UK and Ireland)

36. 36 DRH 2003 Weiss / Fujinaga Specialized metadata Composers Composers Bach bibliography Bach bibliography Beethoven bibliography Beethoven bibliography Sound recordings Sound recordings WorldCat (OCLC: 1.7M recordings, 1.2M scores) WorldCat (OCLC: 1.7M recordings, 1.2M scores) SONIC (LC: 2.5M recordings) SONIC (LC: 2.5M recordings) National Sound Archives (BL: 3M recordings) National Sound Archives (BL: 3M recordings) allclassical.com, amazon.com allclassical.com, amazon.com Music portals Music portals Classical Music Resources (Duke University) Classical Music Resources (Duke University) Ufficio Ricerca Fondi Musicali di Milano Ufficio Ricerca Fondi Musicali di Milano Cecilia (UK and Ireland) Cecilia (UK and Ireland)

37. 37 DRH 2003 Weiss / Fujinaga Classical Music Resources (Duke University)

38. 38 DRH 2003 Weiss / Fujinaga Specialized metadata Composers Composers Bach bibliography Bach bibliography Beethoven bibliography Beethoven bibliography Sound recordings Sound recordings WorldCat (OCLC: 1.7M recordings, 1.2M scores) WorldCat (OCLC: 1.7M recordings, 1.2M scores) SONIC (LC: 2.5M recordings) SONIC (LC: 2.5M recordings) National Sound Archives (BL: 3M recordings) National Sound Archives (BL: 3M recordings) allclassical.com, amazon.com allclassical.com, amazon.com Music portals Music portals Classical Music Resources (Duke University) Classical Music Resources (Duke University) Cecilia (UK and Ireland) Cecilia (UK and Ireland) Ufficio Ricerca Fondi Musicali di Milano Ufficio Ricerca Fondi Musicali di Milano

39. 39 DRH 2003 Weiss / Fujinaga Ufficio Ricerca Fondi Musicali di Milano

40. 40 DRH 2003 Weiss / Fujinaga Music databases (indices) CANTUS (U. of Western Ontario, Canada) CANTUS (U. of Western Ontario, Canada) MELDEX (U. of Waikato, New Zealand) MELDEX (U. of Waikato, New Zealand) Themefinder (Stanford and Ohio State) Themefinder (Stanford and Ohio State) Instrument databases: Instrument databases: Baroque flute database (1,700 instruments) Baroque flute database (1,700 instruments) “The Way Famous String Instrument Went” “The Way Famous String Instrument Went”

41. 41 DRH 2003 Weiss / Fujinaga Music databases (indices) CANTUS (U. of Western Ontario, Canada) CANTUS (U. of Western Ontario, Canada) MELDEX (U. of Waikato, New Zealand) MELDEX (U. of Waikato, New Zealand) Themefinder (Stanford and Ohio State) Themefinder (Stanford and Ohio State) Instrument databases: Instrument databases: Baroque flute database (1,700 instruments) Baroque flute database (1,700 instruments) “The Way Famous String Instrument Went” “The Way Famous String Instrument Went”

42. 42 DRH 2003 Weiss / Fujinaga CANTUS

43. 43 DRH 2003 Weiss / Fujinaga Music databases (indices) CANTUS (U. of Western Ontario, Canada) CANTUS (U. of Western Ontario, Canada) MELDEX (U. of Waikato, New Zealand) MELDEX (U. of Waikato, New Zealand) Themefinder (Stanford and Ohio State) Themefinder (Stanford and Ohio State) Instrument databases: Instrument databases: Baroque flute database (1,700 instruments) Baroque flute database (1,700 instruments) “The Way Famous String Instrument Went” “The Way Famous String Instrument Went”

44. 44 DRH 2003 Weiss / Fujinaga Music databases (indices) CANTUS (U. of Western Ontario, Canada) CANTUS (U. of Western Ontario, Canada) MELDEX (U. of Waikato, New Zealand) MELDEX (U. of Waikato, New Zealand) Themefinder (Stanford and Ohio State) Themefinder (Stanford and Ohio State) Instrument databases: Instrument databases: Baroque flute database (1,700 instruments) Baroque flute database (1,700 instruments) “The Way Famous String Instrument Went” “The Way Famous String Instrument Went”

45. 45 DRH 2003 Weiss / Fujinaga Themefinder

46. 46 DRH 2003 Weiss / Fujinaga Music databases (indices) CANTUS (U. of Western Ontario, Canada) CANTUS (U. of Western Ontario, Canada) MELDEX (U. of Waikato, New Zealand) MELDEX (U. of Waikato, New Zealand) Themefinder (Stanford and Ohio State) Themefinder (Stanford and Ohio State) Instrument databases: Instrument databases: Baroque flute database (1,700 instruments) Baroque flute database (1,700 instruments) The Way Famous String Instrument Went The Way Famous String Instrument Went

47. 47 DRH 2003 Weiss / Fujinaga Music databases (indices) CANTUS (U. of Western Ontario, Canada) CANTUS (U. of Western Ontario, Canada) MELDEX (U. of Waikato, New Zealand) MELDEX (U. of Waikato, New Zealand) Themefinder (Stanford and Ohio State) Themefinder (Stanford and Ohio State) Instrument databases: Instrument databases: Baroque flute database (1,700 instruments) Baroque flute database (1,700 instruments) The Way Famous String Instrument Went The Way Famous String Instrument Went The Way Famous String Instrument Went The Way Famous String Instrument Went

48. 48 DRH 2003 Weiss / Fujinaga Music databases (text) Cyber Hymnal (4,300 hymns & gospel songs: lyrics, MIDI, score) Cyber Hymnal (4,300 hymns & gospel songs: lyrics, MIDI, score) Aria database (1,300 opera arias) Aria database (1,300 opera arias) Aria database Aria database Lied and Art Song database (23,000 songs) Lied and Art Song database (23,000 songs) Gramophone magazine record reviews (23,000 since 1983) Gramophone magazine record reviews (23,000 since 1983) Thesaurus Musicarum Latinarum (Indiana) Thesaurus Musicarum Latinarum (Indiana) MuseData (Stanford) MuseData (Stanford) MuseData

49. 49 DRH 2003 Weiss / Fujinaga Music databases (facsimile) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Digital Image Archive of Medieval Music (Oxford) Digital Image Archive of Medieval Music (Oxford) (Oxford) Early English Books Online Early English Books Online Early Chopin (University of Chicago) Chopin (University of Chicago) Chopin (University of Chicago) Chopin (University of Chicago) Schoenberg Schoenberg Schoenberg

50. 50 DRH 2003 Weiss / Fujinaga Music databases (facsimile) Scribe (La Trobe University,Australia) Scribe (La Trobe University,Australia) Scribe (La Trobe University,Australia) Scribe (La Trobe University,Australia)

51. 51 DRH 2003 Weiss / Fujinaga Music databases (facsimile) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Digital Image Archive of Medieval Music (Oxford) Digital Image Archive of Medieval Music (Oxford) (Oxford)

52. 52 DRH 2003 Weiss / Fujinaga DIAMM (Oxford, Univercity of London)

53. 53 DRH 2003 Weiss / Fujinaga Music databases (facsimile) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Digital Image Archive of Medieval Music (Oxford) Digital Image Archive of Medieval Music (Oxford) (Oxford) Early English Books Online Early English Books Online Early English Books Online Early English Books Online

54. 54 DRH 2003 Weiss / Fujinaga Music databases (facsimile) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Digital Image Archive of Medieval Music (Oxford) Digital Image Archive of Medieval Music (Oxford) (Oxford) Early English Books Online Early English Books Online Early Chopin (University of Chicago) Chopin (University of Chicago) Chopin (University of Chicago) Chopin (University of Chicago)

55. 55 DRH 2003 Weiss / Fujinaga Music databases (facsimile) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Scribe (La Trobe University, Australia) Digital Image Archive of Medieval Music (Oxford) Digital Image Archive of Medieval Music (Oxford) (Oxford) Early English Books Online Early English Books Online Early Chopin (University of Chicago) Chopin (University of Chicago) Chopin (University of Chicago) Chopin (University of Chicago) Schoenberg Schoenberg Schoenberg

56. 56 DRH 2003 Weiss / Fujinaga Sheet music Library of Congress 1820-85 (62,500) Library of Congress 1820-85 (62,500) Johns Hopkins 1780-1960 (29,000) Johns Hopkins 1780-1960 (29,000) Mississippi State (22,000) Mississippi State (22,000) Duke University 1850-1920 (3,042) Duke University 1850-1920 (3,042) UC Berkeley 1852-1900 (2,000) UC Berkeley 1852-1900 (2,000) Brown University 1850-1920 (1,305) Brown University 1850-1920 (1,305)

57. 57 DRH 2003 Weiss / Fujinaga Levy sheet music collection (Johns Hopkins)

58. 58 DRH 2003 Weiss / Fujinaga Computer Applications Compositions Compositions Instruments Instruments Interactive performances Interactive performances Pitch recognition Pitch recognition Tempo / beat induction Tempo / beat induction Expressive performance Expressive performance Music cognition Music cognition Music analysis: Melodic, harmonic, key, motivic, graphic tools Music analysis: Melodic, harmonic, key, motivic, graphic tools

59. 59 DRH 2003 Weiss / Fujinaga Examples of Computer Applications in Musicology (1) Analysis of notational signs in 12th C. manuscripts Analysis of notational signs in 12th C. manuscripts Comparison of motets with questionable attributions Comparison of motets with questionable attributions Analyze modality vs tonality in Bach’ s four-part chorales Analyze modality vs tonality in Bach’ s four-part chorales Statistical analysis of Bach’s Well-Tempered Clavier using spreadsheet software Statistical analysis of Bach’s Well-Tempered Clavier using spreadsheet software Study of authorship of portions of Mozart’s Requiem Study of authorship of portions of Mozart’s Requiem

60. 60 DRH 2003 Weiss / Fujinaga Examples of Computer Applications in Musicology (2) Divergence study by superimposing scanned images of printed music Divergence study by superimposing scanned images of printed music Transcription of tablatures Transcription of tablatures Automatic fingering of English keyboard music Automatic fingering of English keyboard music Sketch study of Alban Berg’s Wozzeck Sketch study of Alban Berg’s Wozzeck Mapping of European folksong Mapping of European folksong Watermark study using digital image processing Watermark study using digital image processing Virtual restoration of manuscripts Virtual restoration of manuscripts

61. 61 DRH 2003 Weiss / Fujinaga Digital restoration: Corpus Christi College, Oxford MS 144

62. 62 DRH 2003 Weiss / Fujinaga Digital restoration: Corpus Christi College, Oxford MS 144

63. 63 DRH 2003 Weiss / Fujinaga Music Information Retrieval (MIR) Genre / style identification Genre / style identification Fingerprinting Fingerprinting Watermarking Watermarking Timbre / insttument recognition Timbre / insttument recognition Search by humming, by examples Search by humming, by examples Audio transcription Audio transcription...... ISMIR 2003 (26-30 Oct. 2003; Baltimore) ISMIR 2003 (26-30 Oct. 2003; Baltimore)

64. 64 DRH 2003 Weiss / Fujinaga Conclusions Future Future Full-text scores Full-text scores Public domain recordings Public domain recordings This presentation is available at: www.music.mcgill.ca/~ich/research/drh2003