1. Instrumental/Operant Conditioning

2. Thorndike’s Puzzle Box

3. Result

4. Thorndike’s Law of Effect “Of several responses made to the same situation, those which are accompanied or closely followed by satisfaction…will be more likely to recur” SituationResponseOutcome Puzzle BoxPull LoopMeat or Fish S  R association

5. Two Theories Thorndike –Stimulus associated with response (S-R), so the response is a “habit” triggered by the situation Grandmother –“Cat is working to get food” (R-O) SituationResponseOutcome Puzzle BoxPull LoopMeat or Fish R  O association

6. Test of Grandma’s Theory Stage 1: Train instrumental S-R-O Stage 2: Alter value of O (devalue) in the absence of R and S Stage 3: Test to determine if R is reduced

7. Responding

8. Shaping Shaping is a method for encouraging novel behavior –Reinforcing successive approximations to the target behavior

9. Types of Reinforcers Primary Reinforcers satisfy a need and reinforces behavior without any special experiences Secondary Reinforcers become valuable through association with primary reinforcers

10. Delay of Reinforcement Delayed reinforcers are steeply discounted Loss of self-control and implusivity Precommitment Reinforcer Potency Delay

11. Stimulus Discrimination

12. Stimulus Discrimination?

13. Positive and Negative Reinforcement

14. Shuttle Box Escape versus Avoidance Conditioning

15. Schedules of Reinforcement Continuous Reinforcement Schedule: Reinforcer is delivered every time a particular response occurs. Partial or Intermittent Reinforcement Schedule: Reinforcement is given only some of the time.

16. Partial Reinforcement Schedules Fixed Ratio (FR): Reinforcement occurs after a fixed number of responses. Variable Ratio (VR): Reinforcement occurs after a varied number of response. Fixed Interval (FI): Reinforcement occurs for the first response after a fixed time interval Variable Interval (VI): Reinforcement occurs for the first response after a variable time interval

17. Partial Reinforcement Schedules

18. Schedules and Extinction Failure to reinforce a response eventually extinguishes it. Partial reinforced responses are more difficult to distinguish. –“Partial reinforcement extinction effect” –“Superstitious behavior” is resistant to extinction for this reason

19. Why Reinforcers Work Deprived of the opportunity to engage in behavior (drink, eat, etc.), called the response deprivation hypothesis Physiological –James Olds and “pleasure centres” –Nucleus Accumbens and Dopamine

20. Punishment and Learning Punishers decrease of probability the immediately preceding response –Two kinds of punishment.Two kinds of punishment. Negative Reinforcement versus Punishment –Negative Reinforcement: Strengthens behavior –Punishment: Weakens behavior Continue

21. Figure 5.11: Two Kinds of Punishment Return

22. Drawbacks of Punishment Only suppresses unwanted behavior Unwanted side effects –target becomes aggressive, avoidance Often ineffective unless a strong punisher given immediately after every response (e.g., red light camera) Does not specify what should be done.

23. Guidelines for Effective Punishment Specify why punishment is being given Emphasize the behavior, not the person, being punished Without being abusive, make sure the punishment immediate and noticeable Identify and positively reinforce more appropriate responses.

24. Some Applications of Instrumental Conditioning Classroom Management Token Economies in Mentally Challenged Autism Self-Control

25. Other Specialized Forms of Learning Spatial Learning Knowledge Attribution Helplessness Observational Learning –Mirror neurons