1. Learning Operant Conditioning

2.  Operant Behavior  operates (acts) on environment  produces consequences  Respondent Behavior  occurs as an automatic response to stimulus  behavior learned through classical conditioning

3. Operant Conditioning  Operant Conditioning  type of learning in which behavior is strengthened if followed by reinforcement or diminished if followed by punishment  Law of Effect  Thorndike’s principle that behaviors followed by favorable consequences become more likely, and behaviors followed by unfavorable consequences become less likely

4. Operant Conditioning  B.F. Skinner (1904-1990)  elaborated Thorndike’s Law of Effect  developed behavioral technology

5. Operant Chamber  Skinner Box  chamber with a bar or key that an animal manipulates to obtain a food or water reinforcer  contains devices to record responses

6. Operant Conditioning  Reinforcer  any event that strengthens the behavior it follows  Shaping  operant conditioning procedure in which reinforcers guide behavior toward closer approximations of a desired goal

7. Operant Conditioning  Positive  Strengthens behavior by presenting a positive stimulus (something desired)  Negative  Strengthens behavior by removing an aversive (unpleasant) stimulus

8. Principles of Reinforcement  Primary Reinforcer  innately reinforcing stimulus  i.e., satisfies a biological need  Secondary Reinforcer  stimulus that gains its reinforcing power through its association with primary reinforcer  Learned reinforcement

9. Schedules of Reinforcement  Continuous Reinforcement  reinforcing the desired response each time it occurs  Partial (Intermittent) Reinforcement  reinforcing a response only part of the time  results in slower acquisition  greater resistance to extinction

10. Schedules of Reinforcement  Fixed Ratio (FR)  reinforces a response only after a specified number of responses  faster you respond the more rewards you get  very high rate of responding  like piecework pay

11. Schedules of Reinforcement  Variable Ratio (VR)  reinforces a response after an unpredictable number of responses  like gambling, fishing  very hard to extinguish because of unpredictability  High rate of response

12. Schedules of Reinforcement  Fixed Interval (FI)  reinforces a response only after a specified time has elapsed  response occurs more frequently as the anticipated time for reward draws near

13. Schedules of Reinforcement  Variable Interval (VI)  reinforces a response at unpredictable time intervals  produces slow steady responding  like pop quiz, busy phone

14. Schedules of Reinforcement Variable Interval Number of responses 1000 750 500 250 0 10203040506070 Time (minutes) Fixed Ratio Variable Ratio Fixed Interval Steady responding Rapid responding near time for reinforcement 80

15. Punishment  Punishment  aversive event that decreases the behavior that it follows  powerful controller of unwanted behavior

16. Drawbacks to Punishment zPunished behavior is suppressed, not forgotten. People will continue to perform the act of punishment is avoidable. zPunishment models behavior used to punish. zPunishment suppresses unwanted behavior, but does not teach desired behavior zWhen punishment is unpredictable and inescapable, helplessness and depression may occur.

17. Reinforcement vs. Punishment Something wantedSomething not wanted Given to you Positive Reinforcement Positive Punishment Taken from you Negative Punishment Negative Reinforcement

18. Cognition and Operant Conditioning  Cognitive Map  mental representation of the layout of one’s environment  Example: after exploring a maze, rats act as if they have learned a cognitive map of it  Latent Learning  learning that occurs, but is not apparent until there is an incentive to demonstrate it

19. Cognition and Operant Conditioning zCognitive Process: yOrganism is an information seeker using relations among events to form its own adaptive representation of the world. yHow much does the first event predict the second yPredictability yExpectancy

20. Cognition and Operant Conditioning  Overjustification Effect  the effect of promising a reward for doing what one already likes to do  the person may now see the reward, rather than intrinsic interest, as the motivation for performing the task

21. Cognition and Operant Conditioning  Intrinsic Motivation  Desire to perform a behavior for its own sake and to be effective  Extrinsic Motivation  Desire to perform a behavior due to promised rewards or threats of punishments

22. Operant vs Classical Conditioning