1. Thinking About Psychology: The Science of Mind and Behavior Charles T. Blair-Broeker Randal M. Ernst

2. Operant Conditioning Module 16

3. What is Operant Conditioning? Module 16: Operant Conditioning

4. Operant Conditioning A type of learning in which the frequency of a behavior depends on the consequence that follows that behavior The frequency will increase if the consequence is reinforcing to the subject. The frequency will decrease if the consequence is not reinforcing to the subject.

5. The Law of Effect Module 16: Operant Conditioning

6. Edward Thorndike (1874-1949) Author of the law of effect Behaviors with favorable consequences will occur more frequently. Behaviors with unfavorable consequences will occur less frequently. Created puzzle boxes for research on cats

7. Thorndike’s Puzzle Box

8. Insert “Thorndike’s Puzzle Box” Video #8 from Worth’s Digital Media Archive for Psychology. Instructions for importing the video file can be found in the ‘Readme’ file on the CD-ROM.

9. B.F. Skinner (1904-1990) Developed the fundamental principles and techniques of operant conditioning and devised ways to apply them in the real world Designed the Skinner Box, or operant chamber

10. B.F. Skinner Interview Insert “B.F. Skinner Interview” Video #9 from Worth’s Digital Media Archive for Psychology. Instructions for importing the video file can be found in the ‘Readme’ file on the CD-ROM.

11. Reinforcement/Punishment Reinforcement - Any consequence that increases the likelihood of the behavior it follows Punishment - Any consequence that decreases the likelihood of the behavior it follows The subject determines if a consequence is reinforcing or punishing

12. Reinforcement Module 16: Operant Conditioning

13. Positive Reinforcement Anything that increases the likelihood of a behavior by following it with a desirable event or state The subject receives something they want Will strengthen the behavior

14. Positive Reinforcement

15. Negative Reinforcement Anything that increases the likelihood of a behavior by following it with the removal of an undesirable event or state Something the subject doesn’t like is removed Will strengthen the behavior

16. Negative Reinforcement

17. Positive/Negative Reinforcement

18. Operant Conditioning Play “Operant Conditioning” (3:13) Segment #11 from Psychology: The Human Experience.

19. Reinforcement: Immediate Versus Delayed Reinforcement Module 16: Operant Conditioning

20. Immediate/Delayed Reinforcement Immediate reinforcement is more effective than delayed reinforcement Ability to delay gratification predicts higher achievement

21. Reinforcement: Primary Versus Secondary Reinforcement Module 16: Operant Conditioning

22. Primary Reinforcement Something that is naturally reinforcing Examples: food, warmth, water, etc. The item is reinforcing in and of itself

24. Secondary Reinforcement Something that a person has learned to value or finds rewarding because it is paired with a primary reinforcer Money is a good example

26. Punishment: The Process of Punishment Module 16: Operant Conditioning

27. Types of Punishment An undesirable event following a behavior A desirable state or event ends following a behavior

29. Punishment: Problems With Punishment Module 16: Operant Conditioning

30. Negative Effects of Punishment Doesn’t prevent the undesirable behavior when away from the punisher Can lead to fear, anxiety, and lower self- esteem Children who are punished physically may learn to use aggression as a means to solve problems.

31. Positive Effects of Punishment Punishment can effectively control certain behaviors. Especially useful if teaching a child not to do a dangerous behavior Most still suggest reinforcing an incompatible behavior rather than using punishment

32. Some Reinforcement Procedures: Shaping Module 16: Operant Conditioning

33. Shaping Reinforcement of behaviors that are more and more similar to the one you want to occur Technique used to establish a new behavior

34. Some Reinforcement Procedures: Discrimination and Extinction Module 16: Operant Conditioning

35. Discrimination The ability to distinguish between two similar stimuli Learning to respond to one stimuli but not to a similar stimuli

36. Extinction In operant conditioning, the loss of a conditioned behavior when consequences no longer follow it. The subject no longer responds since the reinforcement or punishment has stopped.

37. Schedules of Reinforcement: Continuous Reinforcement Module 16: Operant Conditioning

38. Continuous reinforcement A schedule of reinforcement in which a reward follows every correct response Most useful way to establish a behavior The behavior will extinguish quickly once the reinforcement stops.

39. Schedules of Reinforcement: Partial Reinforcement Module 16: Operant Conditioning

40. Partial Reinforcement A schedule of reinforcement in which a reward follows only some correct responses Includes the following types: –Fixed-interval and variable interval –Fixed-ratio and variable-ratio

41. Fixed-Interval Schedule A partial reinforcement schedule that rewards only the first correct response after some defined period of time i.e. weekly quiz in a class

42. Variable-Interval Schedule A partial reinforcement that rewards the first correct response after an unpredictable amount of time i.e. “pop” quiz in a class

43. Fixed-Ratio Schedule A partial reinforcement schedule that rewards a response only after some defined number of correct responses The faster the subject responds, the more reinforcements they will receive.

44. Variable-Ratio Schedule A partial reinforcement schedule that rewards an unpredictable number of correct responses This schedule is very resistant to extinction. Sometimes called the “gambler’s schedule”; similar to a slot machine

45. Schedules of Reinforcement

46. New Understandings of Operant Conditioning: The Role of Cognition Module 16: Operant Conditioning

47. Latent Learning Learning that takes place in absence of an apparent reward

48. Cognitive Map A mental representation of a place Experiments showed rats could learn a maze without any reinforcements

49. Latent Learning & Cognitive Maps Play “Cognitive Processes in Learning” (6:25) Segment #12 from Psychology: The Human Experience.

50. Overjustification Effect The effect of promising a reward for doing what someone already likes to do The reward may lessen and replace the person’s original, natural motivation, so that the behavior stops if the reward is eliminated

51. New Understandings of Operant Conditioning: The Role of Biology Module 16: Operant Conditioning

52. Biological Predisposition Research suggests some species are biologically predisposed to learn specific behaviors

53. The End