Operant Conditioning

Objective(s) What is operant conditioning and how does it differ from classical conditioning? What is operant conditioning and how does it differ from classical conditioning?

Conditioning Behaviors Classical (Respondent) – occurs as an automatic response to some stimulus Classical (Respondent) – occurs as an automatic response to some stimulus Operant – operates on the environment, producing consequences Operant – operates on the environment, producing consequences

4 Operant vs. Classical Conditioning Classical conditioning forms associations between stimuli (CS and US). Operant conditioning, on the other hand, forms an association between behaviors and the resulting events.

Operant Conditioning A type of learning in which behavior is strengthened if followed by a reinforcer or diminished if followed by a punisher. A type of learning in which behavior is strengthened if followed by a reinforcer or diminished if followed by a punisher.

Operant Conditioning Involves operant behavior, a behavior that operates on the environment, producing rewarding or punishing stimuli.

Operant Conditioning Response-Consequence

Response-Consequence

Conditioning Behaviors Thorndike ’ s Law of Effect Thorndike ’ s Law of Effect Operant chamber (Skinner Box) Operant chamber (Skinner Box) Shaping behaviors with reinforcers Shaping behaviors with reinforcers

Thorndike’s Law of Effect Responses to a situation that are followed by satisfaction are strengthenedResponses to a situation that are followed by satisfaction are strengthened Responses that are followed by discomfort are weakened.Responses that are followed by discomfort are weakened.

Thorndike’s Law of Effect

B.F. Skinner Behaviorist who believed psychs should focus on observable behavior that could be objectively measured and verified.Behaviorist who believed psychs should focus on observable behavior that could be objectively measured and verified.

14 Skinner’s Experiments Skinner’s experiments extend Thorndike’s thinking, especially his law of effect. This law states that rewarded behavior is likely to occur again.

15 Operant Chamber Using Thorndike's law of effect as a starting point, Skinner developed the Operant chamber, or the Skinner box, to study operant conditioning.

16 Operant Chamber The operant chamber, or Skinner box, comes with a bar or key that an animal manipulates to obtain a reinforcer like food or water. The bar or key is connected to devices that record the animal’s response.

17 Skinner’s Legacy Skinner argued that behaviors were shaped by external influences instead of inner thoughts and feelings. Critics argued that Skinner dehumanized people by neglecting their free will.

19Shaping Shaping is the operant conditioning procedure in which reinforcers guide behavior towards the desired target behavior.

Reinforcement Any consequence that strengthens behavior Any consequence that strengthens behavior Positive (presents a pleasurable stimulus such as praise, hug, food) Positive (presents a pleasurable stimulus such as praise, hug, food) Negative (removes aversive stimuli – NOT punishment) Negative (removes aversive stimuli – NOT punishment)

Positive Reinforcement

Negative Reinforcement

Ways to Increase Behavior Operant Conditioning Term Description Possible Examples Positive Reinforcement Add a desirable stimulus Getting a hug, a raise, praise, etc. Negative Reinforcement Remove an aversive stimulus Fastening a seatbelt to turn off beeping

Reinforcers Primary Primary Secondary Secondary Token economy Token economy

Primary Reinforcers A reinforcer that is naturally reinforcing for a given species. A reinforcer that is naturally reinforcing for a given species. Ex. food, water, and shelter Ex. food, water, and shelter

Secondary Reinforcers A reinforcer that gains its effectiveness by a learned association w/primary reinforcers. A reinforcer that gains its effectiveness by a learned association w/primary reinforcers. Ex. Money!!!! Ex. Money!!!!

Token Economy A theraputic method, based on operant condtioning, by which individuals are rewarded w/tokens that act as 2ndary reinforcers. The tokens can be redeemed for rewards & privileges. A theraputic method, based on operant condtioning, by which individuals are rewarded w/tokens that act as 2ndary reinforcers. The tokens can be redeemed for rewards & privileges. Ex. Elementary teachers Ex. Elementary teachers

28 1.Immediate Reinforcer: A reinforcer that occurs instantly after a behavior. 2.Delayed Reinforcer: A reinforcer that is delayed in time for a certain behavior. Immediate & Delayed Reinforcers

Schedules of Reinforcement Continuous Continuous Partial (intermittent) Partial (intermittent) 1. Fixed-ratio (FR) 1. Fixed-ratio (FR) 2. Variable-ratio (VR) 2. Variable-ratio (VR) 3. Fixed-interval (FI) 3. Fixed-interval (FI) 4. Variable-interval (VI) 4. Variable-interval (VI)

Ratio Schedules Ratio schedules are based upon the # of responses: Ratio schedules are based upon the # of responses: Fixed: reinforcement occurs after a predetermined set of responses Fixed: reinforcement occurs after a predetermined set of responses Variable: reinforcement is unpredictable b/c the ratio varies Variable: reinforcement is unpredictable b/c the ratio varies

Interval Schedules Interval schedules are based on responses made w/in a certain time period: Interval schedules are based on responses made w/in a certain time period: Fixed: reinforcement occurs after a predetermined time has elapsed Fixed: reinforcement occurs after a predetermined time has elapsed Variable: reinforcement occurs unpredicatbly since the time interval varies Variable: reinforcement occurs unpredicatbly since the time interval varies

Punishment An event that decreases the behavior it follows. An event that decreases the behavior it follows. Opposite of reinforcement Opposite of reinforcement

Punishment vs. Reinforcement Punishment decreases the chance of a behavior being repeated, reinforcement increases the chance. Punishment decreases the chance of a behavior being repeated, reinforcement increases the chance.

Punishment Positive: adding an aversive stimulus after the response Positive: adding an aversive stimulus after the response Negative: taking away a reinforcer after the response Negative: taking away a reinforcer after the response ***Makes a behavior less likely to happen, negative enforcement make a behavior more likely to happen.***

Types of Punishers TypeDescriptionExamples Positive Punishment Administer an aversive stimulus Spanking; a parking ticket Negative Punishment Withdraw a desirable stimulus Time-out from privileges; revoked driver ’ s license

37 Drawbacks of Punishment 1.Results in unwanted fear, hostility, and aggression. 2.Justifies pain to others. 3.Causes unwanted behaviors to reappear in its absence. 4.Causes aggression towards the agent. 5.Can produce learned helplessness. 6.Often produces a temporary change in behavior. 7.Conveys no information to the organism.

38 Effective Uses of Punishment 1.Punishment should be delivered immediately after the offensive behavior. 2.Punishment should be certain. 3.Punishment should be limited and sufficient so that it “fits the crime”. 4.Punishment should focus on the behavior, not the character, of the offender.

39 Learned Helplessness Martin SeligmanMartin Seligman The condition of a human or animal that has learned to behave helplessly, failing to respond even though there are opportunities for it to help itself by avoiding unpleasant circumstances or by gaining positive rewards.The condition of a human or animal that has learned to behave helplessly, failing to respond even though there are opportunities for it to help itself by avoiding unpleasant circumstances or by gaining positive rewards.

40 Applications of Operant Conditioning Skinner introduced the concept of teaching machines that shape learning in small steps and provide reinforcements for correct rewards. In School

41 Applications of Operant Conditioning Reinforcement principles can enhance athletic performance Reinforcement principles can enhance athletic performance.

42 Applications of Operant Conditioning Reinforcers affect productivity. Many companies now allow employees to share profits and participate in company ownership Reinforcers affect productivity. Many companies now allow employees to share profits and participate in company ownership.

43 Applications of Operant Conditioning In children, reinforcing good behavior increases the occurrence of these behaviors. Ignoring unwanted behavior decreases their occurrence.

Diana Baumrind Authoritarian Authoritarian Authoritative Authoritative Permissive Permissive Neglectful Neglectful Parenting Styles

Cognition & Op Cond. The limitations of Behaviorist theories of learning: The limitations of Behaviorist theories of learning: 1. Believe that classical & operant conditioning explain almost all learning. 2.Believe that the behaviorists underestimate the importance of cognitive processes.

Cognition & Op. Cond Latent learning Latent learning Cognitive map Cognitive map Insight Insight Intrinsic/Extrinsic Motivation Intrinsic/Extrinsic Motivation

Latent Learning Learning that is not outwardly used until the situation calls for it. Learning that is not outwardly used until the situation calls for it. Edward Tolman Edward Tolman Experiment: Rats running a maze for food & making a cognitive map Experiment: Rats running a maze for food & making a cognitive map

Insight Wolfgang Kohler Wolfgang Kohler Sultan the chimp getting a banana through trial and error Sultan the chimp getting a banana through trial and error

Overjustification Effect The effect of promising a reward for doing what one already likes to do and losing interest in it. The effect of promising a reward for doing what one already likes to do and losing interest in it. Intrinsic Intrinsic Extrinsic Extrinsic