1. Theoretical Approaches and questions in Operant Conditioning Psychology 3306

2. Responses and reinforcers How important are responses and reinforcers? How important are responses and reinforcers? Thorndike and Skinner would say that it is essential Thorndike and Skinner would say that it is essential Tolman said ‘umm, not completely Tolman said ‘umm, not completely Cognitive maps Cognitive maps Latent learning Latent learning

3. So you don’t need a reinforcer? Perhaps it strengthens the S-R bond, but is not necessary Perhaps it strengthens the S-R bond, but is not necessary Maybe it becomes part of a representation? Maybe it becomes part of a representation? Colwill and Rescorla, 1985 Colwill and Rescorla, 1985 Chain - > water Chain - > water Lever - > food Lever - > food Food - > poison Food - > poison

4. That sound you hear is Skinner spinning in his grave Rats won’t press the lever! Rats won’t press the lever! Therefore, the response and reinforcer have been connected, but not directly Therefore, the response and reinforcer have been connected, but not directly It seems that associations are made between all three parts of the three term contingency It seems that associations are made between all three parts of the three term contingency

5. Are there 2 types of learning? Yes, operant and classical Yes, operant and classical No, it is all associative learning No, it is all associative learning What a stupid question…. What a stupid question….

6. Pushing the limits Heart rate conditioning Heart rate conditioning Biofeedback Biofeedback Not always successful Not always successful

7. So what is a reinforcer? Some event that increases the likelihood of…. Some event that increases the likelihood of…. ENOUGH! ENOUGH! Maybe it is need or drive reduction? Maybe it is need or drive reduction? Premack’s ideas Premack’s ideas Is food the reinforcer, or is it the act of eating? Is food the reinforcer, or is it the act of eating?

8. Premack’s principle Given 2 responses arranged in an operant-conditioning procedure, more probable behaviors will reinforce less probable behaviors; less probable response will not reinforce more probable ones Given 2 responses arranged in an operant-conditioning procedure, more probable behaviors will reinforce less probable behaviors; less probable response will not reinforce more probable ones

9. Premack (1963) - study in Cebus monkeys Premack (1963) - study in Cebus monkeys Lever Pressing (L) : highest probability Lever Pressing (L) : highest probability Door Opening (D) : medium probability Door Opening (D) : medium probability Plunger Pulling (P) : lowest probability Plunger Pulling (P) : lowest probability reinforces D; L reinforces P; P does NOT reinforce either D or L, etc. reinforces D; L reinforces P; P does NOT reinforce either D or L, etc. “Premackian reinforcers”: activities that act as reinforcers (reading, playing) “Premackian reinforcers”: activities that act as reinforcers (reading, playing) Useful (and less costly) in token economies than object-based reinforcers Useful (and less costly) in token economies than object-based reinforcers

10. Applications Mitchell & Stoffelmayr (1973) use Premack’s principle in schizophrenics Mitchell & Stoffelmayr (1973) use Premack’s principle in schizophrenics Reinforcement items like candy, cigarettes, etc. usually not effective in schizophrenic patients Reinforcement items like candy, cigarettes, etc. usually not effective in schizophrenic patients Sitting is a highly probable behavior in negative- symptom schizophrenics (catatonia, social withdrawal) Sitting is a highly probable behavior in negative- symptom schizophrenics (catatonia, social withdrawal) therapists made sitting contingent on doing small amount of work or activity; improved their negative symptoms therapists made sitting contingent on doing small amount of work or activity; improved their negative symptoms In unruly nursery-school children, high probability behaviors (running around, screaming) made contingent on low probability behaviors (sitting quietly, paying attention) In unruly nursery-school children, high probability behaviors (running around, screaming) made contingent on low probability behaviors (sitting quietly, paying attention)

11. Behavioural economics Open economies Open economies Closed economies Closed economies Elasticity of demand Elasticity of demand And behavioural ecology And behavioural ecology

12. Stimulus Control Relationship between S and R Relationship between S and R Reynolds (1961) - Attention in the pigeon Reynolds (1961) - Attention in the pigeon 2 pigeons reinforced for pecking to compound stimulus of white triangle on red background projected on response key 2 pigeons reinforced for pecking to compound stimulus of white triangle on red background projected on response key rate of pecking was then observed in each subject to a white triangle and a red background singularly rate of pecking was then observed in each subject to a white triangle and a red background singularly

14. Why do you get a gradient? Sort of the study of generalization and discrimination Sort of the study of generalization and discrimination How do you get data? How do you get data? Probe trials Probe trials Test phases Test phases Both done in extinction Both done in extinction Is it a property of the nervous system? Is it a property of the nervous system? Pavlov Pavlov Hubel and Wiesel Hubel and Wiesel

15. Perhaps it is learning? Lashley and Wade figured it was how the animal was trained Lashley and Wade figured it was how the animal was trained Borne out by Jenkins and Harrison’s work Borne out by Jenkins and Harrison’s work Non differential Non differential Presence absence Presence absence Explicit training Explicit training Peterson (1960) and his ducklings, only saw yellow Peterson (1960) and his ducklings, only saw yellow

16. Duck you They did not show gradients with colour! They did not show gradients with colour! Oops Oops Probably depends on the modality and the species being tested really Probably depends on the modality and the species being tested really Or, could be relational Kohler and his chickens Or, could be relational Kohler and his chickens

17. Gonzalez, Gentry, & Bitterman (1954) - chimpanzee had to pick among 9 squares of varying sizes Gonzalez, Gentry, & Bitterman (1954) - chimpanzee had to pick among 9 squares of varying sizes Squares 1,5, & 9 presented, subject reinforced for choosing # 5 (intermediate size) Squares 1,5, & 9 presented, subject reinforced for choosing # 5 (intermediate size) on test trial chimp reinforced no matter which square chosen on test trial chimp reinforced no matter which square chosen if given 4, 7, & 9 relational theory says subject will choose # 7, absolute theory says subject will choose square closest # 5 ( # 4) if given 4, 7, & 9 relational theory says subject will choose # 7, absolute theory says subject will choose square closest # 5 ( # 4) subjects usually chose the intermediate size square of whichever three squares were presented subjects usually chose the intermediate size square of whichever three squares were presented

18. Peak Shift

19. OK, so that is odd Why does that happen? Why does that happen? Excitatory gradient Excitatory gradient Inhibitory grandient Inhibitory grandient As the Violent Femmes would say, you gotta add it up As the Violent Femmes would say, you gotta add it up

20. Bird brain is not an insult Concept learning Concept learning Natural needed? Natural needed? How long lasting How long lasting Delius (1982) Delius (1982) Honig and Stewart (1988) Honig and Stewart (1988) The field of comparative cognition really grew out of much of this stuff The field of comparative cognition really grew out of much of this stuff