1. Understanding Spoken Speech ● Bottom up is minimal for humans, but crucial for computers – voice recognition

2. Understanding Spoken Speech ● Top down in crucial for humans because – dialectal differences in speech – individual differences

3. Understanding Spoken Speech ● Top down in crucial for humans because – dialectal differences in speech – individual differences – differences motivated by phonology allophony

4. Understanding Spoken Speech ● Top down in crucial for humans because – dialectal differences in speech – individual differences – differences motivated by phonology allophony sounds flow into each other inability to segment individual sounds

5. Understanding Spoken Speech ● Top down in crucial for humans because – dialectal differences in speech – individual differences – differences motivated by phonology allophony sounds flow into each other inability to segment individual sounds – noise, poor pronunciation make words incomprehensible, yet we fill in the blanks

6. Understanding Spoken Speech ● Top down in crucial for humans because – dialectal differences in speech – individual differences – differences motivated by phonology allophony sounds flow into each other inability to segment individual sounds – noise, poor pronunciation make words incomprehensible, yet we fill in the blanks – No boundary markers between words

7. Understanding Spoken Speech ● How does word recognition happen? – Theory: input turned into phonemes then matched to phonemically stored words – Theory: input matched analogically to phonetically stored items – Maybe both happen to some degree at the same time

8. Understanding Spoken Speech ● Cue to word segmentation – English alternates stress and unstressed syllables – Many words have initial stress – b d g merge with p t k word finally

9. Understanding Spoken Speech ● Cue to word segmentation – English alternates stress and unstressed syllables – Many words have initial stress – b d g merge with p t k word finally – p t k are strongly aspirated word initially

10. Understanding Spoken Speech ● Cue to word segmentation – English alternates stress and unstressed syllables – Many words have initial stress – b d g merge with p t k word finally – p t k are strongly aspirated word initially – some consonant clusters are not possible within words, but are OK across words rdst not in words, but words to

11. Frequency Effects ● Hi freq words recognized faster

12. Frequency Effects ● Hi freq words recognized faster – Are they stored separately and searched first?

13. Frequency Effects ● Hi freq words recognized faster – Are they stored separately and searched first? – Are they stored with more worn paths? (strength)

14. Word meanings ● How do you find the right meaning? – At first all meanings are activated

15. Word meanings ● How do you find the right meaning? – At first all meanings are activated – context helps – words in ambiguous contexts take longer to comprehend the right turn (ambiguous) the left turn (unambiguous)

16. Word meanings ● How do you find the right meaning? – At first all meanings are activated – context helps – words in ambiguous contexts take longer to comprehend the right turn (ambiguous) the left turn (unambiguous) They didn't like the bark (ambiguous) They didn't like the barking (unambiguous)

17. Word meanings ● All meanings are initially activated – Prime: “There were spiders, roaches, and other bugs in the room” – Target: immediately after sentence ANT recognized faster than SEW – This shows that bug activated ant also

18. Word meanings ● All meanings are initially activated – Prime: “There were spiders, roaches, and other bugs in the room” – Target: immediately after sentence ANT recognized faster than SEW – This shows that bug activated ant also ANT and SPY activated equally fast – This shows that both meanings of BUG were actived.

19. Word meanings ● LDT – Prime: “They all rose” – Target: STOOD faster response than unrelated LOOKED

20. Word meanings ● LDT – Prime: “They all rose” – Target: STOOD faster response than unrelated LOOKED – Prime: “He gave her a rose” – Target: FLOWER faster response than unrelated PICTURE

21. Word meanings ● LDT – Prime: “They all rose” – Target: STOOD faster response than unrelated LOOKED – Prime: “He gave her a rose” – Target: FLOWER faster response than unrelated PICTURE

22. Word meanings ● LDT – Prime: “They all rose” – Target: FLOWER faster response than unrelated word Prime: “He gave her a rose” Target: STOOD faster response than unrelated word So, all meanings activated initially

23. Word meanings ● LDT – Prime: auditory capt- – Target: BOAT or GUARD both recognized faster

24. Word meanings ● LDT – Prime: auditory capt- – Target: BOAT or GUARD both recognized faster – Prime: auditory capti- – Target: BOAT or GUARD guard recognized faster, but not boat

25. Word meanings ● LDT – Prime: auditory capt- – Target: BOAT or GUARD both recognized faster – Prime: auditory capti- – Target: BOAT or GUARD guard recognized faster, but not boat – Prime: auditory capta- – Target: BOAT or GUARD boat recognized faster, but not guard

26. Word meanings ● Cohort Model – As word is perceived it initially activates all possibilities s- activates all words with s- st- activates all words with st- (fewer words) sta- activates all words with sta- and so on until stand only activates stand

27. Synesthesia ● Overlap between different senses – shapes associated with tastes – numbers associated with colors

28. Synesthesia ● Overlap between different senses – shapes associated with tastes – numbers associated with colors

29. Synesthesia ● If 7 is yellow and nine is blue for a synesthete then math problems solved quicker is colors correspond ● For non synesthete colors won't affect time

30. Synesthesia ● A non synesthete will see panel on the left ● A synesthete will see the panel on the right

31. Synesthesia ● Why does it happen? – Overlap between brain areas

32. Synesthesia ● Why does it happen? – Overlap between brain areas green=grapheme recognition area red=color recognition area

33. Synesthesia ● Could other overlaps explain other things? – foot fetish

34. Synesthesia ● Could other overlaps explain other things? – perceiving vowels as colors? Which color corresponds to [i, u, a]?

35. Synesthesia ● Could other overlaps explain other things? – perceiving vowels as colors? Which color corresponds to [i, u, a]? [i]=yellow, [u]=blue/green, [a]=red

36. Synesthesia ● Could other overlaps explain other things? – which is bouba and which is kiki?

37. Synesthesia ● Could other overlaps explain other things? – which is bouba and which is kiki? – back vowels are round and front are jagged?

38. Synesthesia ● Could other overlaps explain other things? – which is bouba and which is kiki? – back vowels are round and front are jagged? – b is round and k is jagged?

39. Synesthesia ● Could other overlaps explain other things? – which is bouba and which is kiki? – back vowels are round and front are jagged? – b is round and k is jagged? – same results for English and Tamil speakers

40. Synesthesia ● Could other overlaps explain other things? – which is bigger teetee or tootoo?

41. Synesthesia ● Could other overlaps explain other things? – which is bigger teetee or tootoo? – which is smaller laylee or mowmoo?

42. Synesthesia ● Could other overlaps explain other things? – which is bigger teetee or tootoo? – which is smaller laylee or mowmoo? – Why? Look at F2