2. Chapter 3 Learning (II) Operant (Instrumental) Conditioning

3. Definition — A form of learning in which a behavior becomes more or less probable, depending on its consequences  Respondent behavior  Operant behavior — behavior that operates on the environment, producing consequences.

4. Skinner’s Experiment  Law of effect  Skinner Box  Comparison of Classical C. & Operant C. Comparison of Classical C. & Operant C.

5. Principles of Reinforcement  Reinforcer  Positive reinforcer  Negative reinforcer Negative reinforcer Escape and Avoidance L.  Primary and secondary reinforcer (conditioned reinforcer)  Immediate and delayed reinforcer

6.  Delayed gratification  Learned helplessness  Overjustification  Functional autonomy

7. Why do behaviors have been positively reinforced not occur continually? 1. Behavior is controlled by discriminative stimuli, a process that Skinner calls Stimulus control (mooncake) 2. Because the individual has relative degree of satiation in regard to the reinforcer response deprivation

8. Shaping and Chaining  Successive approximations  Shaping a teacher  Forward chaining  Backward chaining

9. Schedules of Reinforcement  Continuous Schedules — is subjected to repaid extinction when reinforcement stops  Partial Schedules — because they produce less-predictable reinforcement, they are more resistance to extinction than are ~

10.  Fixed-ratio Schedules (FR)  Variable-ratio Schedules (VR)  Fixed-interval Schedules (FI)  Variable-interval Schedules (VI)

11.  Ratio schedules produce faster response rates than do interval schedules, because the number of responses, not the length of time, determines the onset of reinforcement  Variable schedules produce steadier response rates than do fixed schedules, because the individual does not know when reinforcement will occur

12. Punishment  Two kinds of punishment  The difference between Punishment and negative reinforcement  The effectiveness of punishment 1. Timing, consistency, intensity 2. Using punishment wisely 3. Side effects of punishment pp. 310-311

13. Application of Operant Conditioning  In parenting and education  In the market  Behavior modification (flooding, systematic desensitization …… )  A Clockwork Orange (1971)  ……  In daily life