OPERANT CONDITIONING

DIFFERENT FROM CLASSICAL CLASSICAL: Experimenter presents UCS and CS and then observes the behavior CLASSICAL: Experimenter presents UCS and CS and then observes the behavior OPERANT: Participant / Animal must behave in a certain way to get a reward or avoid a punishment OPERANT: Participant / Animal must behave in a certain way to get a reward or avoid a punishment Def. – Learning in which reinforcement is contingent upon the subject’s behavior. Def. – Learning in which reinforcement is contingent upon the subject’s behavior.

B.F. SKINNER Psychologist most closely associated with operant conditioning Psychologist most closely associated with operant conditioning

SKINNER BOX

Figure 8.8 Cat in a puzzle box Myers: Psychology, Eighth Edition Copyright © 2007 by Worth Publishers Thorndike’s Puzzle Box Law of Effect: Behavior + Consequences = Learned Behavior

REINFORCEMENT REWARD / PUNISHMENT REWARD / PUNISHMENT POSITIVE REINFORCEMENT: POSITIVE REINFORCEMENT: Get a reward or receive something you like for doing the desired behavior Get a reward or receive something you like for doing the desired behavior Social approval, money, food Social approval, money, food NEGATIVE REINFORCEMENT: NEGATIVE REINFORCEMENT: Something unpleasant is taken away for doing desired behavior Something unpleasant is taken away for doing desired behavior Homework, chores, sales tax on tax free weekend Homework, chores, sales tax on tax free weekend

Big Bang Theory

REINFORCEMENT cont. PRIMARY REINFORCEMENT: PRIMARY REINFORCEMENT: satisfies a biological need such as hunger, thirst, or sleep, etc. satisfies a biological need such as hunger, thirst, or sleep, etc. SECONDARY REINFORCEMENT: SECONDARY REINFORCEMENT: one that has been paired with a primary re-inforcer through classical conditioning. one that has been paired with a primary re-inforcer through classical conditioning.

SHAPING Technique used to teach animals / people a more complicated task Technique used to teach animals / people a more complicated task The subject is rewarded for each response that is closer to the final desired behavior The subject is rewarded for each response that is closer to the final desired behavior Successive approximations Successive approximations

SCHEDULES OF REINFORCEMENT CONTINUOUS CONTINUOUS RATIO: RATIO: reinforcement is given after a certain NUMBER of responses. reinforcement is given after a certain NUMBER of responses. FIXED RATIO: reinforcement is given after the same number of responses each time FIXED RATIO: reinforcement is given after the same number of responses each time VARIABLE RATIO: reinforcement after varying number of responses. VARIABLE RATIO: reinforcement after varying number of responses.

SCHEDULES cont. INTERVAL: INTERVAL: reinforcement is given after a certain amount of TIME. reinforcement is given after a certain amount of TIME. FIXED INTERVAL: reinforcement is given after the same amount of time each time. FIXED INTERVAL: reinforcement is given after the same amount of time each time. VARIABLE INTERVAL: amount of time changes between reinforcements VARIABLE INTERVAL: amount of time changes between reinforcements

EXAMPLES Typist gets paid $2 per page Typist gets paid $2 per page Fixed ratio Fixed ratio Slot machines Slot machines Variable ratio Variable ratio Giving a quiz every Friday Giving a quiz every Friday Fixed interval Fixed interval

Which type of rft. is best for...?... introducing a new behavior?... introducing a new behavior?... maintaining a behavior for a long period of time?... maintaining a behavior for a long period of time?

CHAINING Learning simple skills, that when combined together enable the subject to perform more complex tasks. Learning simple skills, that when combined together enable the subject to perform more complex tasks. Examples: Examples: Reading, writing, math, sports, etc. Reading, writing, math, sports, etc. Dog Tricks

AVERSIVE CONTROL Using an unpleasant stimulus to influence behavior. Using an unpleasant stimulus to influence behavior. NEGATIVE REINFORCEMENT: NEGATIVE REINFORCEMENT: when an unpleasant stimulus is removed after a certain behavior. when an unpleasant stimulus is removed after a certain behavior. ESCAPE CONDITIONING: A person’s behavior causes an unpleasant event to stop ESCAPE CONDITIONING: A person’s behavior causes an unpleasant event to stop AVOIDANCE CONDITIONING: Training of an organism to withdraw from an unpleasant stimulus before it starts. AVOIDANCE CONDITIONING: Training of an organism to withdraw from an unpleasant stimulus before it starts. Cliff's Buzzer

PUNISHMENT An unpleasant consequence occurs and decreases the frequency of the behavior that produced it An unpleasant consequence occurs and decreases the frequency of the behavior that produced it

DISADVANTAGES OF PUNISHMENT Unwanted side effects: rage, fear, aggression (spanked children may become more aggressive) Unwanted side effects: rage, fear, aggression (spanked children may become more aggressive) Subjects learn to avoid the punisher Subjects learn to avoid the punisher Punishment may suppress rather than eliminate such behaviors Punishment may suppress rather than eliminate such behaviors Alone it does not teach what is acceptable behavior Alone it does not teach what is acceptable behavior

EXAMPLES Which schedule of reinforcement is being used? Which schedule of reinforcement is being used? Factory workers? Factory workers? Fixed interval Fixed interval Getting paid by the bale for hauling hay? Getting paid by the bale for hauling hay? Fixed ratio Fixed ratio Pop quizzes? Pop quizzes? Variable interval Variable interval

Homework from the teacher’s perspective Behavior desired from the student? Behavior desired from the student? Complete homework assignments Complete homework assignments Reinforcement being offered? Reinforcement being offered? grades grades Positive or negative? Positive or negative? Primary or secondary? Primary or secondary? Overworked / underpaid teacher doesn’t want to have to grade EVERY assignment Overworked / underpaid teacher doesn’t want to have to grade EVERY assignment Which schedule of reinforcement would be most beneficial for the teacher to use? Which schedule of reinforcement would be most beneficial for the teacher to use? Variable ratio Variable ratio

POKER CHIMPS Shaping was used to get chimps to perform tasks for food Shaping was used to get chimps to perform tasks for food Classical conditioning was then used to teach the chimps to associate poker chips with food. Classical conditioning was then used to teach the chimps to associate poker chips with food. Soon the chimps were performing tasks to get poker chips to exchange for food in the chip-o- mat Soon the chimps were performing tasks to get poker chips to exchange for food in the chip-o- mat Generalization and discrimination Generalization and discrimination