1. 1/28 Unit 3. Attention 3.1 Visual Locations 3.2 The Sperling Task 3.3 Visual Attention 3.4 Auditory Attention 3.5 Typing and Control 3.6 Declarative Finsts 3.7 Data Fitting 3.8 The Subitizing Task

2. 2/28 3. 1 Visual Locations > (print-visicon) Visicon Three steps to encode visual objects 1. Find the location of an objects 2. Shift attention to that location 3. Harvest the object encoded

3. 3/28 3.1.2 Attended tests Draw attention to the previously unattended objects Attended slot –Has the object at this location been attended to before –New, nil, or t Attended when +visual> isa move-attention completes 3. 1 Visual Locations

4. 4/28 Random selection among all unattended items (P attend-letter =goal> isa read-letters state find-location =visual-location> isa visual-location ==> +visual> isa visual-object screen-pos =visual-location =goal> state attending ) Feature (in visicon) tagged as attended 3. 1 Visual Locations 3.1.2 Attended tests (P find-random-letter =goal> isa read-letters state find tone nil ==> +visual> isa visual-object :attended nil =goal> state attending )

5. 5/28 Attentional tags - FINSTs (Finger Instantiation) –Zenon Pylyshyn Number of objects that can be tagged as :attended t Time limit on how long tag sticks Limited in number and time :VISUAL-NUM-FINSTS 4 default: 4 : Number of visual finsts. :VISUAL-FINST-SPAN 3.0 default: 3.0 : Lifespan of a visual finst 3. 1 Visual Locations 3.1.2 Attended tests

6. 6/28 3. 1 Visual Locations 3.1.2 Attended tests

7. 7/28 Slots that can be tested –distance –screen-x, screen-y –kind, value, color, size –attended, nearest If multiple matches, random choice 3.1.4 Visual-location request 3. 1 Visual Locations

8. 8/28 1. Exact values 3. 1 Visual Locations 2. General values +visual-location> isa visual-location > screen-x 50 <= screen-y 124 ※, >= +visual-location> isa visual-location > screen-x 10 < screen-x 100 > screen-y 10 < screen-y 150 3. Production variables 3.1.4 Visual-location request +visual-location> isa visual-location screen-x 50 screen-y 124 (p find-by-color =goal> isa find-goal target =color ==> +visual-location> isa visual-location color =color +visual-location> isa visual-location kind =kind < screen-x =x > screen-y =y

9. 9/28 4. Relative values 3. 1 Visual Locations 5. Current value +visual-location> isa visual-location > screen-x current <= screen-y current - color current +visual-location> isa visual-location width highest screen-x lowest color red 6. Request variables 3.1.4 Visual-location request +visual-location> isa visual-location height &height width &height

10. 10/28 Find the items the closest to the currently attended location, or some other location =some-location bound to a chunk of type visual-location Nearest is tested last 3. 1 Visual Locations 3.1.5 :nearest request parameter +visual-location> isa visual-location :nearest current +visual-location> isa visual-location :nearest =some-location

11. 11/28 (p read-next-word =goal> isa read-word state find ==> +visual-location> isa visual-location :attended nil screen-x lowest =goal> state attend) (p read-next-word =goal> isa read-word state find ==> +visual-location> isa visual-location > screen-x current screen-x lowest =goal> state attend) 3. 1 Visual Locations 3.1.6 Ordered Search Read words on the screen from left to right

12. 12/28 3.2 Sperling Task Partial report version –Rows of letters are displayed –After some interval (0,.15,.3, 1 sec), subjects are cued by beeping –Total display time - 1 sec –Report letters in cued row Crude approximation to the original –Display on for 0.9 - 1.1 seconds vs 50 ms. –Cue occurs while display is still on –Subjects in original experiment were extremely well practiced –Visual conditions very different –But this representation is adequate for our purposes

13. 13/28 3.2 Sperling Task Whole report condition –50 msec display then a mask –4.4 letters Partial report condition –Auditory cue (tone with different freq) indicating which row to report –3.3 letters in that row –As delay of cue get longer (1 sec) the # reported fell (1.5)

14. 14/28 3.2 Sperling Task Subjects' recall at a second's delay fell to about a third of the whole report level – able to report as many items from the cued row as they happened to encode without the cue Interpretation – subjects have access to all the letters in a visual buffer but they have difficulty in reporting them before they decay away. People seldom process 50 millisecond display How fast visual attention can move over entire display

15. 15/28 Human data 3.2 Sperling Task

16. 16/28 Buffer stuffing 3.3 Visual Attention Visual-location buffer empty -> automatically placed Default specification : Attended new, screen-x lowest Model can detect changes to the screen 0.000 VISION SET-BUFFER-CHUNK VISUAL-LOCATION LOC0 REQUESTED NIL Three steps to encode visual objects 1. Find the location of an objects 2. Shift attention to that location 3. Harvest the object encoded

17. 17/28 Testing and Requesting Locations Constraints passed from goal to RHS Check for range of screen-y Modifies chunk before writing to memory Clear done so that chunk enters declarative memory at this time 3.3 Visual Attention (p encode-row-and-find =goal> isa read-letters location =pos upper-y =uy lower-y =ly =visual> isa text status nil ==> =visual> status =pos -visual> ;; add this to make sure it flushes to DM =goal> location nil state attending +visual-location> isa visual-location attended nil screen-y (within =uy =ly) )

18. 18/28 3.4 Auditory attention Two steps to encode a sound –aural-location buffer -> aural buffer –Automatically but delayed Delay between initial onset of sound and being able to detect –Delaydepends on type of sound: tone or digit Sperling Model is assuming only one sound, therefore can rely on buffer stuffing

19. 19/28 :TONE-RECODE-DELAY 0.285 default: 0.285 : Recoding delay for tone sound content. :DIGIT-RECODE-DELAY 0.5 default: 0.5 : Recoding delay for digit sound content. :DIGIT-DURATION 0.6 default: 0.6 : Default duration for digit sounds. :DIGIT-DETECT-DELAY 0.3 default: 0.3 : Lag between onset and detectability for digits :TONE-DETECT-DELAY 0.05 default: 0.05 : Lag between sound onset and detectability for tones Audio Module Parameters 3.4 Auditory Attention

20. 20/28 3.4 Auditory Attention (p detected-sound =aural-location> isa audio-event ?aural> state free ==> +aural> isa sound event =aural-location) (p sound-respond-low =goal> isa read-letters tone nil =aural> isa sound content 500 ==> =goal> tone low upper-y 205 lower-y 215) 0.135 VISION SET-BUFFER-CHUNK VISUAL TEXT13 0.185 PROCEDURAL PRODUCTION-FIRED ENCODE-ROW-AND-FIND 0.185 VISION SET-BUFFER-CHUNK VISUAL-LOCATION LOC2 0.200 AUDIO SET-BUFFER-CHUNK AURAL-LOCATION AUDIO-EVENT0 REQUESTED NIL 0.235 PROCEDURAL PRODUCTION-FIRED ATTEND-HIGH 0.285 PROCEDURAL PRODUCTION-FIRED DETECTED-SOUND... 0.570 AUDIO SET-BUFFER-CHUNK AURAL TONE0 0.605 PROCEDURAL PRODUCTION-FIRED ATTEND-HIGH 0.655 PROCEDURAL PRODUCTION-FIRED SOUND-RESPOND-MEDIUM 0.690 VISION SET-BUFFER-CHUNK VISUAL TEXT12 0.740 PROCEDURAL PRODUCTION-FIRED ENCODE-ROW-AND-FIND 0.740 VISION SET-BUFFER-CHUNK VISUAL-LOCATION LOC8 0.790 PROCEDURAL PRODUCTION-FIRED ATTEND-MEDIUM

21. 21/28 3.5 Typing and Control (P start-report =goal> isa read-letters tone =tone ?visual> state free ==> +goal> isa report-row row =tone +retrieval> isa text status =tone) This production competes with several other productions Creates and switches to a new goal Issues retrieval constrained by tone

22. 22/28 Control Only want to fire when no more letters to perceive (spp start-report :c 2) (spp detected-sound :c 0) (spp sound-respond-low :c 0) (spp sound-respond-medium :c 0) (spp sound-respond-high :c 0) Default cost (:C) is 0.05sec 3.5 Typing and Control

23. 23/28 (P do-report =goal> isa report-row row =tone =retrieval> isa text status =tone value =val ?manual> state free ==> +manual> isa press-key key =val +retrieval> isa text status =tone :recently-retrieved nil ) To keep from retrieving same letter 1.160 PROCEDURAL PRODUCTION-FIRED DO-REPORT 1.160 MOTOR PRESS-KEY c 1.160 DECLARATIVE SET-BUFFER-CHUNK RETRIEVAL TEXT5-0 1.760 PROCEDURAL PRODUCTION-FIRED DO-REPORT 3.5 Typing and Control

24. 24/28 (p stop-report =goal> isa report-row row =row ?retrieval> state error ?manual> state free ==> +manual> isa press-key key space =goal> row nil) 3.5 Typing and Control

25. 25/28 3.6 Declarative FINSTS +retrieval> isa text status =tone :recently-retrieved nil :declararive-num-finsts default = 4 items :declarative-finst-span default = 3 sec

26. 26/28 3.7 Data Fitting ;(sgp :seed (100 0)) ; signifies a comment, so line it commented out Allows random generation > (repeat-experiment 100) CORRELATION: 0.997 MEAN DEVIATION: 0.115 Condition Current Participant Original Experiment 0.00 sec. 3.20 3.03 0.15 sec. 2.43 2.40 0.30 sec. 2.17 2.03 1.00 sec. 1.56 1.50

27. 27/28 3.8 Subitizing Task ? (experiment) CORRELATION: 0.956 MEAN DEVIATION: 0.367 Items Current Participant Original Experiment 1 0.80(T ) 0.60 2 0.93(T ) 0.65 3 0.91(T ) 0.70 4 1.16(T ) 0.86 5 1.46(T ) 1.12 6 1.84(T ) 1.50 7 1.75(T ) 1.79 8 2.85(T ) 2.13 9 2.73(T ) 2.15 10 2.58(T ) 2.58

28. 28/28 Vocal System (P do-report =goal> isa report-row row =tone =retrieval> isa text status =tone value =val ?vocal> state free ==> ;Need to add this to keep the buffer from clearing =goal> +vocal> isa speak string =val +retrieval> isa text :recently-retrieved nil status =tone) 3.8 Subitizing Task