1. ch 111 Sensation & Perception Ch. 11: Sound, The Auditory System, and Pitch Perception © Takashi Yamauchi (Dept. of Psychology, Texas A&M University) Main topics Sound stimuli, amplitude and frequency Sound quality (timbre) Ear (structure) Place theory Central auditory processing

2. ch 112 Sound Demonstration Different types of sound Many different types of sound Sound of lots of different types of texture

3. ch 113 Sound What is it? Something to do with air vibration? Why can we hear? –an object vibrates  the air changes its pressure  the air vibrates  we hear a sound.

4. ch 114 –sound is a wave ???? ???????????????

5. ch 115 What is a wave? A wave is something that goes back and forth, up and down, or ebbs and flows, comes and goes…

6. ch 116 When air vibrates, it doesn’t travel straight. The vibration propagates like a wave –Regular and organized manner. –Imagine when surface waves spread in a lake

7. ch 117 Sound wave Figure 1: Graphic representations of a sound wave. (A) Air at equilibrium, in the absence of a sound wave; (B) compressions and rarefactions that constitute a sound wave; (C) transverse representation of the wave, showing amplitude (A) and wavelength (taken from Britannica Online)

8. ch 118 A sound wave is determined by two factors Magnitude –Y axis Frequency –X axis

9. ch 119 Sound wave The perceptual quality of a sound is related to the characteristics of a sound wave.

10. ch 1110 Demonstration –A simple sound –Record my voice –Change amplitude –Change frequency

11. ch 1111 Specifying a sound stimulus Amplitude –Y axis –Decibel (dB) –Number of dB = 20 x log(P/P0) –(P: the sound pressure of the stimulus, P0: a standard pressure) –P0:=the pressure of a 1000Hz tone at threshold. Frequency –X axis – Hertz (Hz)  one cycle per second

12. ch 1112 dB: Decibel dB? With p=200, p0(standard pressure level)=20 dB=20 x log (200/20)= 20 x log (10) = 20 x 1= 20 with p = 2000 dB = 20 x log (2000/20)= 20 x log (100) = 20x 2 = 40 With p = 20000 dB = 20 x log (20000/20)= 20 x log (1000) = 20x 3 = 60

13. ch 1113

14. ch 1114

15. ch 1115 What does this tell? Remember a psychophysics experiment?

16. ch 1116 Do you remember a psychophysics experiment we talked about? Magnitude estimation

17. ch 1117 Complex sound

18. ch 1118 Synthesizer Kohei Nagayama (my cousin)

19. ch 1119 create a complex sound by combining simple sound waves  Additive synthesis reduce a complex sound wave into a collection of simple sound waves.  Fourier analysis

20. ch 1120 A sound wave from clarinet. Simple sound waves that make a sound of clarinet

21. ch 1121 Figure 11.9 The frequency spectrum for the tone in Figure 11.8d. The heights of the lines indicate the amplitude of each of the frequencies that make up the tone.

22. ch 1122 Figure 11.10 Frequency spectra for a guitar, a bassoon, and an alto saxophone playing a tone with a fundamental frequency of 196 Hz. The position of the lines on the horizontal axis indicates the frequencies of the harmonics and their height indicates their intensities.

23. ch 1123 Ear

24. ch 1124 Ear

25. ch 1125 What do they do? Sound  vibration of air  vibrate the eardrum, the malleus, the incus, and the stapes  the vibration spreads to the cochlea.  the vibration in the cochlea is captured by hair cells  transduction (physical vibration is transduced to neural energy)

26. ch 1126

27. ch 1127 Demonstration CD Rom Demonstration: Physiology of Behavior

28. ch 1128 From vibration to neural energy, how does it happen?

29. ch 1129 A quick review: Vision

30. ch 1130

31. ch 1131

32. ch 1132  the tectorial membrane vibrates  the hair cells’ cilia bend.  depending on how they bend, the hair cells release neurotransmitter

33. ch 1133

34. ch 1134 Transduction The neurotransmitters released in the hair cell are captured in nerve fibers.  The neural energy is sent to the brain.

35. ch 1135 Transduction The neurotransmitters released in the hair cell are captured in nerve fibers.  The neural energy is sent to the brain.

36. ch 1136 Perceiving sound How do we perceive sound? How do we represent different sound waves?

37. ch 1137 –sound is a wave ???? ???????????????

38. ch 1138 A sound wave is determined by two factors Amplitude –Y axis Frequency –X axis

39. ch 1139 Neurons sensitive to different frequencies?

40. ch 1140 Bekesy’s place theory

41. ch 1141 How does the basal membrane vibrate? Demonstration: Jumping rope

42. ch 1142 A wave spreads. The wave reached the peak at a particular location. The height of the wave reaches the peak at P, and then gradually subsides.

43. ch 1143 Different locations of vibration peak are produced by different spatial frequencies.

44. ch 1144 Different frequencies of sound waves activate hair cells in different locations

45. ch 1145 This wave bends hair cells of this area most. When hair cells bend most, they fire most. So, hair cells are tuned to different frequencies.

46. ch 1146 Some physiological and psychophysical findings that support the place theory Tonotopic map on the cochlea (Fig. 10.30) Different parts of the cochlea respond maximally to different frequencies (Fig 10.30)

47. ch 1147 The tuning curve of a single hair cell in the guinea pig cochlea. Frequency tuning curves of cat auditory nerve fibers What do these graphs tell you?

48. ch 1148 Auditory masking and psychopysical experiments. Ss listen to tones of various frequencies. Masking is placed at a particular frequency. Ss have difficulty in identifying the tone at which masking is placed.

49. ch 1149 Psychophysical tuning curve The sound level of masking tone necessary to mask a 2kHz tone. Note that the minimum masking intensity is needed to mask a tone of 2000Hz. The frequency of the masking and test tones. The intensity of the masking tone The frequency of the masking tone The intensity of the masking tone Dots: The frequency of the test tone

50. ch 1150 What does this tell you?  Tonotopic maps  A nice correspondence between the frequency of a sound wave and the cochlea location at which the sound is captured.

51. ch 1151 Remember retinotopic map? What is it?

52. ch 1152 Retinotopic map: the locational information of retina is preserved in the LGN cells.

53. ch 1153 How about a complex sound ( a mixture of sound waves with different frequencies?

54. ch 1154 A complex tone (440Hz, 880Hz, and 1320Hz).. The auditory system basically carry out a “Fourier analysis”  treat a complex sound as a composite of simple waves.

55. ch 1155 Central Auditory Processing

56. ch 1156 Hierarchical Processing: Core  belt  Parabelt Complex sounds are processed later What vs. Where system: Where: dorsal pathway  Sound localization What: ventral pathway  Identifying sounds

57. ch 1157 Tonotopic map in the cortex The Tonotopic relation is maintained in the auditory corcortex as well (A1) This figure indicate the locations of neurons that are responsive to particular frequencies (see the number -- kHz)

58. ch 1158 The effect of the missing fundamental Example http://en.wikipedia.org/wiki/Missing_fundamental

59. ch 1159 Figure 11.9 The frequency spectrum for the tone in Figure 11.8d. The heights of the lines indicate the amplitude of each of the frequencies that make up the tone.

60. ch 1160 Figure 11.10 Frequency spectra for a guitar, a bassoon, and an alto saxophone playing a tone with a fundamental frequency of 196 Hz. The position of the lines on the horizontal axis indicates the frequencies of the harmonics and their height indicates their intensities.

61. ch 1161 Removing fundamental frequencies change their timbre. But their pitch remains the same.  The perception of the pitch of complex tones cannot be explained by the place theory alone.