1. More Extinction

2. Reinstatement of Conditioned Excitation
Recovery from extinction because of re-exposure to the US
CS – US, then CS only extinction, US re-exposed, CR returns
LaBar (2005) using fear conditioning in human subjects
Acquisition: CS blue square -- US loud noise pairings
Extinction: CS blue square only
Reinstatement:
One group gets US noise in Same context
other group had US noise in Different context
Test with CS blue square in original "Same" context
Reinstatement in the Same context produces some recovery of the fear conditioning
Figure 9.4

3. FIGURE 9.4
Fear conditioning in human participants as measured by increased skin conductance. All participants received acquisition followed by extinction, reinstatement USs, and tests of responding to the CS. The reinstatement USs were presented in either the same or a different context than the rest of the experiment. (Based on LaBar & Phelps, 2005.)
The Principles of Learning and Behavior, 7e by Michael Domjan
Copyright © 2015 Wadsworth Publishing, a division of Cengage Learning. All rights reserved.

4. Reinstatement of Conditioned Excitation
Conclusions
Shows that contextual conditioning facilitates the reinstatement effect
reinstatement US presentations given in the test context
serve to restore the excitatory properties of the contextual cues
enable those cues to be more effective in reactivating the memory of CS
The role of context appears to be to disambiguate the significance of a stimulus that has a mixed history of conditioning and excitation.
Context has little effect on stimuli that have a history of only conditioning.
A problem for maintaining behavior therapy
Someone with anxiety and fear of intimacy because of abuse as a child
After therapy the anxiety and fear are reduced
Fear and anxiety will return with another abusive event
Has also been used to study relapse of drug addiction

5. Resurgence of Conditioned Behavior
choice behavior and behavioral economics
individuals have opportunities to choose between responses
example of a child misbehaving
the parents ignore the behavior to extinguish it
parents also provide the child with a toy to replace the misbehavior
when the child becomes bored extinction of toy-playing behavior
the misbehavior will return
Resurgence
Reappearance of an extinguished response when another reinforced response is extinguished
Winterbauer & Bouton 2011
Procedure: Two levers in an operant chamber
Food reinforcement for pressing lever one
followed by extinction of lever one
food reinforcement for pressing lever two
followed by extinction of the lever two
When lever two responding was extinguished
activity on lever one return to high levels and then gradually extinguished
See Figure 9.5 which only shows lever one responding

6. FIGURE 9.5
Rate of responding on lever 1 (L1) during a test of resurgence. L1 was never reinforced (L1−) during the test session. In the middle of the session (indicated by the two vertical lines), responding on lever 2 was reinforced (L2+). During the remaining session neither L2 nor L1 were reinforced (L1−), L2−). Notice that responding on L1 reappeared (resurged) when extinction was started for L2. The rate of responding on L2 is not shown. (Based on Winterbauer & Bouton, 2011).
The Principles of Learning and Behavior, 7e by Michael Domjan
Copyright © 2015 Wadsworth Publishing, a division of Cengage Learning. All rights reserved.

7. Enhancing Extinction
Because extinction does not erase original learning use of extinction in behavior therapy is problematic
Using exposure therapy for insect phobia to reduce fear response
extinction is learning something new
when the insect is present it will not harm you
It is helpful to enhance this new learning so that it persists and generalizes to many contexts
Several suggestions for enhancing extinction
based on the research demonstrating spontaneous recovery, renewal, reinstatement and resurgence
Number and Spacing of Extinction Trials
Immediate Versus Delayed Extinction
Repetition of Extinction/Test Cycles
Conducting Extinction in Multiple Contexts
Presenting Extinction Reminder Cues

8. Number and Spacing of Extinction Trials
Increased number of extinction trials
Will produce greater extinction
There are practical limitation
Spacing of the trials
"massed" trials: extinction trials close together in time
Produces faster extinction
but less effect on spontaneous recovery
Spreading the trials out
Takes longer to get extinction
Better at reducing spontaneous recovery

9. Immediate Versus Delayed Extinction
When possible extinction training soon after acquisition
Memory consolidation requires some amount of time perhaps up to several hours
if extinction procedures can begin before the memory is fully consolidated it can reduce the amount of acquisition
However, immediate extinction does not seem to be effective in reducing spontaneous recovery or renewal on the next day
Extinction procedures 24 hours after the end of acquisition seem to be the most effective for reducing spontaneous recovery
this is of particular interest for acquisition of fear after a traumatic event
although this may be impractical
in most applications there is a long delay of weeks or years between acquisition and extinction
The time delay that would be the most effective for reducing spontaneous recovery or renewal effects is still unclear

10. Repetition of Extinction/Test Cycles
Repeated “cycles” of extinction trials
Each cycle is a number of extinction trials
Repeated cycles with rest in between
Rescorla 2004
CS noise --- US food cup conditioning
CS noise only extinction
8 trials of CS each day
Repeated 16 days
Amount of spontaneous recovery decreases with each cycle
Figure 9.6

11. FIGURE 9.6
Effects of repeated extinction sessions on the magnitude of spontaneous recovery. There are breaks in the line connecting the data points to indicate the breaks between the end of one extinction session and the start of the next. Notice that the degree of spontaneous recovery gets progressively smaller across successive sessions. (From Rescorla, Lear n. Mem : Copyright © 2004, by Cold Spring Harbor Laboratory Press.)
The Principles of Learning and Behavior, 7e by Michael Domjan
Copyright © 2015 Wadsworth Publishing, a division of Cengage Learning. All rights reserved.

12. Conducting Extinction in Multiple Contexts
Reducing Renewal
extinction is context sensitive so extinction in a new context does not transfer to the original context
try to do the extinction training in the same context as the original acquisition
do the extinction training in several different contexts so that it generalizes across many contexts
Although this may require a large number of extinction trials
Thomas Extinction of fear
Acquisition of fear CS no noise – US shock in context A
Extinction CS no noise in context B or in contexts B,C,D
Either 36 or 144 extinction trials
Tested in context A see figure 9.7
With 36 trials fear is still present in context A
With 144 trials and three context much less fear in context A

13. The Principles of Learning and Behavior, 7e by Michael Domjan
FIGURE 9.7
Extinction and renewal of fear in a conditioned suppression procedure, with lower scores indicating more suppression and hence more fear. Data are shown for the beginning (B) and the end (E) of the first and last extinction session as well as the renewal test. Groups differed only during the renewal test. Group NE did not receive extinction training. 1C indicates that extinction was conducted in one context. 3C indicates extinction in three different contexts. 36 Ext indicates that 36 extinction trials were conducted. 144 Ext indicates that 144 extinction trials were conducted (based on Thomas et al., 2009).
The Principles of Learning and Behavior, 7e by Michael Domjan
Copyright © 2015 Wadsworth Publishing, a division of Cengage Learning. All rights reserved.

14. Presenting Extinction Reminder Cues
Include distinctive cues during extinction training so that these same cues can be used as reminders later to help maintain extinction
Reducing spontaneous recovery Brooks 1999
using conditioned taste aversion CS taste followed by US illness
during extinction CS taste without the illness and the addition of a buzzer cue
test for spontaneous recovery
present CS taste and the buzzer
produces less spontaneous recovery
Reducing renewal
CS noise food cup conditioning in context A
extinction CS noise only in context B in addition to a flashing light cue
test for renewal in context A
when the flashing light is added to context of a there is less renewal

15. Compounding Extinction Stimuli
Use compound stimuli during the extinction training produces better extinction
usually two simple stimuli (noise/light) presented simultaneously
there are many naturally occurring compound stimuli
objects (spider) are perceived along multiple dimensions sometimes the dimensions are all in one sensory modality such as vision (shape, size color)
Rescorla (2006) using operant conditioning
Table 9.1
light noise and tone where all separately conditioned with lever pressing food training
Extinction training:
phase one: all the stimuli where presented separately without food
phase two: more extinction training either with light/noise compound or tone alone
Testing six days later to compare amount of spontaneous recovery for noise and tone
Figure 9.8
tone which was only present by itself during extinction showed more recovery then noise which was extinguished as a compound stimuli

16. The Principles of Learning and Behavior, 7e by Michael Domjan
Copyright © 2015 Wadsworth Publishing, a division of Cengage Learning. All rights reserved.

17. The Principles of Learning and Behavior, 7e by Michael Domjan
FIGURE 9.8
Discriminative lever pressing in the presence of a light (L) and two auditory cues (a tone and a noise stimulus counter-balanced as X and Y) at the end of a series of extinction trials with each stimulus presented by itself, during a compound extinction phase in which L was presented simultaneously with X, and during a test phase conducted six days later. (Based on Rescorla, 2006a, Figure 3, page 139).
The Principles of Learning and Behavior, 7e by Michael Domjan
Copyright © 2015 Wadsworth Publishing, a division of Cengage Learning. All rights reserved.

18. Priming Extinction to Update Memory for Reconsolidation
CS can be used as a reminder cue
just presentation of a CS only such as and noise will activate the memory of the original conditioning expectation of food
while the memory of acquisition is activated it can be modified by additional information
Monfils 2009
human fear conditioning procedure
red color square paired with mild shock
blue color square not followed by shock
Priming group:
on the next day a single reminder by presenting the Red Square again
followed by extinction trials either 10 minutes later or six hours later
No Priming group
just had extinction trials either 10 minutes later or six hours later
Priming followed by extinction 10 minutes later prevented spontaneous recovery see figure 9.10

19. FIGURE 9.10
Conditioned fear (as measured by skin conductance), during acquisition, extinction, and a test of spontaneous recovery, in human participants who received a priming exposure to the CS 10 minutes or 6 hours before extinction training or did not receive priming. (Based on Schiller et a., 2010).
The Principles of Learning and Behavior, 7e by Michael Domjan
Copyright © 2015 Wadsworth Publishing, a division of Cengage Learning. All rights reserved.

20. Treatment of Insect Phobia
The basic understanding of extinction from non-human animal research can be applied to treatment of phobias
see "Extending animal models of fear conditioning to humans"
Mike, a 14-year-old boy with insect phobia (entomophobia)
Fear stimuli: insects in general but crickets, spiders, and ladybugs in particular
academic performance as behavioral measurement
Assessment of phobia:
(1) Bugs: Put three live crickets in the center of the floor
(2) Say Bugs: ‘‘There are bugs somewhere in this room.’’
(3) Say No Bugs: ‘‘There are no bugs anywhere in this room.’’

21. Treatment of Insect Phobia
Graduated exposure; hierarchy of behavioral approach tasks see table 1,
Graduated exposure plus reinforcement identical to the exposure condition except that Mike earned points for each correct digit
Used an A-B-BC-A-BC design for assessment and treatment
Results: see figure 1
during assessment lowest rates of problem completion in the bugs condition compared to the "say no-bugs" condition or "say bugs" condition
not much improvement in exposure condition
some improvement with exposure plus reinforcement
relapse when put back into assessment condition
There are a number of other examples of using extinction to treat phobias see "Extinction in Human Fear Conditioning"