2. CNBH, PDN, University of Cambridge Roy Patterson Centre for the Neural Basis of Hearing Department of Physiology, Development and Neuroscience University of Cambridge Part II: Lent Term 2015: ( 1 of 4) email rdp1@cam.ac.uk http://www.pdn.cam.ac.uk/groups/cnbh/teaching/lectures/ Lecture slides, sounds, videos and background papers on Central Auditory Processing Lecture slides on CamTools:

3. CNBH, PDN, University of Cambridge Act III: the processing of communication sounds: How (auditory signal processing) Act I: the information in communication sounds (animal calls, speech, musical notes) Contents/Progress Act IV: the processing of communication sounds: Where (auditory anatomy, physiology, brain imaging) [Tune7nCPHtone.mov] axial Act II: the perception of communication sounds (the robustness of perception)

4. CNBH, PDN, University of Cambridge Act I The form of communication sounds including speech and musical notes http://www.pdn.cam.ac.uk/groups/cnbh/teaching/lectures/PSDWshar08.pdf http://www.pdn.cam.ac.uk/groups/cnbh/teaching/lectures/PGW_SHAR_2010.pdf

5. CNBH, PDN, University of Cambridge The resonance provides distinctive information about the shape and size of resonators in the sender’s body. to declare territories and attract mates, are typically Pulse Resonance Time Amplitude Sounds used to communicate at a distance, Pulse-Resonance Sounds The pulse marks the start of the communication.

6. CNBH, PDN, University of Cambridge source-filter systems : pulse-resonance sounds sourcefilter The pulses are produced in streams, each with a resonance The streams have distinctive onsets and offsets, and a stream with its onset and offset is referred to as a syllable. http://www.pdn.cam.ac.uk/groups/cnbh/teaching/lectures/PSDWshar08.pdf

7. CNBH, PDN, University of Cambridge Communication ‘syllables’ of four different animals Fish Frog Human Macaque 400 ms Patterson, Smith, van Dinther and Walters (2008).

8. CNBH, PDN, University of Cambridge glottal folds vocal tract mammalian vocal apparatus filter source nose chin tongue lips

9. CNBH, PDN, University of Cambridge waveform and spectrum of a child’s /a/ fine structure pulse rate resonance shape envelope shape

10. CNBH, PDN, University of Cambridge What happens as a child grows up into an adult? http://www.pdn.cam.ac.uk/groups/cnbh/teaching/lectures/PSDWshar08.pdf At age 3, average height is about 85 cm When adult, average height is about 170 cm As we double in height, our vocal tracts double in length

11. CNBH, PDN, University of Cambridge Low High Pitch Long Short VTL Time Patterson, Smith, van Dinther and Walters (2008).

12. CNBH, PDN, University of Cambridge waveform and spectrum of a child’s /a/ Frequency on a logarithmic axis (octaves) position of the envelope pulse rate position of the fine-structure resonance rate SsSs SfSf

13. CNBH, PDN, University of Cambridge The role of S s and S f in speaker perception Decreasing VTL Increasing GPR Kawahara and Irino (2004). Principles of speech manipulation system STRAIGHT. In Speech separation by humans and machines, P. Divenyi (Ed.), Kluwer Academic, 167-179. ( S s ) (1/S f )

14. CNBH, PDN, University of Cambridge Decreasing VTL Increasing GPR Rana catesbeiana (1/S f ) ( S s )

15. CNBH, PDN, University of Cambridge Instrument Family Instrument Register Envelope Shape S s and S f The role of S s and S f in instrument perception http://www.pdn.cam.ac.uk/groups/cnbh/teaching/lectures/PGW_SHAR_2010.pdf

16. CNBH, PDN, University of Cambridge Instruments with same shape and construction, sound similar. violin viola cello Register S s and S f Acoustic scale in instrument perception Envelope Shape

17. CNBH, PDN, University of Cambridge The perception of musical notes and instruments Instrument Family Instrument Register Envelope Shape S s and S f

18. CNBH, PDN, University of Cambridge Waveforms for trumpet and trombone resonance Time van Dinther and Patterson (2004) pulses

19. CNBH, PDN, University of Cambridge The effect of S s and S f on instrument perception Pitch Decreasing Size French Horn (1/S f ) (Ss)(Ss) Kawahara and Irino (2004). Principles of speech manipulation system STRAIGHT. In Speech separation by humans and machines, P. Divenyi (Ed.), Kluwer Academic, 167-179.

20. CNBH, PDN, University of Cambridge The perception of musical notes and instruments Instrument Family Instrument Register Envelope Shape S s and S f

21. CNBH, PDN, University of Cambridge General conclusions: If we divide the information in the magnitude spectrum into (a) envelope shape, (b) position of the envelope, S f, and (c) position of the fine structure, S s, it provides us with a good way of understanding the information in communication sounds. http://www.pdn.cam.ac.uk/groups/cnbh/teaching/lectures/PGW_SHAR_2010.pdf

22. CNBH, PDN, University of Cambridge What and Who in vocal sounds The shape of the envelope largely determines vowel type. It determines the “What” aspect of the communication, in the sense of “What is being said” I: II: The acoustic scale variables, S s and S f, jointly determine the register of the voice, and whether the speaker sounds normal or unusual. They jointly determine much of the “Who” aspect of the communication in the sense of “Who is speaking”

23. CNBH, PDN, University of Cambridge Family and Register in musical sounds The shape of the envelope/resonance largely determines the sound of the instrument family, or the family aspect of instrument perception. I: II: The acoustic scale variables, S s and S f, jointly determine the register or size aspect of instrument perception. III: The relationship between the acoustic scale variables, S s and S f determines whether an instrument sounds good, or thin or muddy.

24. CNBH, PDN, University of Cambridge End of Act I Thank you Patterson, R. D., Gaudrain, E. and Walters, T. C. (2010). “The perception of family and register in musical tones,” In: Music Perception. Jones, M.R., Fay, R.R. and Popper, A.N., (eds). New York, Springer-Verlag. 13-50. Patterson, R. D., van Dinther, R. and Irino, T. (2007). “The robustness of bio- acoustic communication and the role of normalization,” Proc. 19th International Congress on Acoustics, Madrid, Sept, ppa-07-011. Patterson, R. D., Smith, D. R. R., van Dinther, R. and Walters, T. C. (2008). “Size Information in the Production and Perception of Communication Sounds,” In: Auditory Perception of Sound Sources. Yost, W. A., Popper, A. N., and Fay, R. R. (Eds). Springer, LLC, New York, 43-75. http://www.pdn.cam.ac.uk/groups/cnbh/teaching/lectures/PGW_SHAR_2010.pdf http://www.pdn.cam.ac.uk/groups/cnbh/teaching/lectures/PSDWshar08.pdf

25. CNBH, PDN, University of Cambridge pi pe ko kuuu ni ne mo muuu SsSs SfSf

26. CNBH, PDN, University of Cambridge pi pe ko kuuu ni ne mo muuu

27. CNBH, PDN, University of Cambridge 1/VTL (1/S f ) Position of the fine structure Position of the envelope

28. CNBH, PDN, University of Cambridge 1/VTL (1/S f )