1. Version 0.1 (c) CELEST 20071 Associative Learning

2. Version 0.1 (c) CELEST 20072 Challenge Questions You are a psychologist treating a patient who is addicted to smoking. Explain how you would treat the patient’s addiction. You are a therapist who has a patient with a fear of spiders. Their spouse loves the outdoors and this fear interfering with their marriage. How would you treat this patient? You are a coach of a football team and your quarterback is throwing too many incomplete passes. Explain how you would use learning theory to help his game.

3. Version 0.1 (c) CELEST 20073 The Smoker’s Brain The smoker would care. Nicotine influences the levels of certain neurotransmitters. Nicotine can prevent the break down of dopamine, increasing its presence in brain neurons. This causes the pleasurable effects of smoking.

4. Version 0.1 (c) CELEST 20074 The Phobic’s Brain The amygdala is activated by a relatively harmless stimulus. This creates a fear response. In a patient with a phobia inhibition by the prefrontal cortex does not occur.

5. Version 0.1 (c) CELEST 20075 The Quarterback’s Brain The cerebellum coordinates and controls movement. Despite its small volume, it contains nearly half the cells in the entire brain. Cerebellar damage impairs the timing of one’s movements.

6. Version 0.1 (c) CELEST 20076 Outside of the Black Box Learning is something that can be observed without observing the brain directly. In fact, behavioral psychologists treat the nervous system as a “black box” and focus mainly on relationships among observable stimuli and behaviors.

7. Version 0.1 (c) CELEST 20077 ASSOCIATIVE LEARNING Classical conditioning: learning associations between objects. learning associations between objects. Operant conditioning: learning that, in a particular situation, a certain response leads to a certain outcome. There are two types of associative learning:

8. Version 0.1 (c) CELEST 20078 Classical Conditioning

9. Version 0.1 (c) CELEST 20079 Ivan Pavlov Classical Conditioning was discovered by the work of Ivan Pavlov. He was studying digestive physiology for which he won the Noble Prize.

10. Version 0.1 (c) CELEST 200710 CLASSICAL CONDITIONING An object or an event that you sense is referred to as a stimulus We distinguish two types of stimuli and responses: Unconditioned stimulus (US) A stimulus that naturally evokes a response or reflex called the Unconditioned Response (UR) Conditioned stimulus (CS) A stimulus that does not naturally evoke a response. However, it can acquire the ability to elicit the response, called the Conditioned Response (CR).

11. Version 0.1 (c) CELEST 200711 PAVLOV’S EXPERIMENT

12. Version 0.1 (c) CELEST 200712 Stimulus Generalization Stimulus Generalization occurs when animals respond more to stimuli that are similar to the original than to those which are different. Example: The dog in Pavlov’s experiment would also salivate to tones of similar frequencies to the original.

13. Version 0.1 (c) CELEST 200713 Stimulus Generalization Gone Wrong! In 1920, little Albert, an eleventh month old orphan, learned to fear a rabbit. Eventually all white fuzzy objects caused the same fear in little Albert even though they were not paired with the US (loud sound). and But if you present simultaneously many times, then Initially, the sound causes fear… But not the rabbit … the rabbit also causes fear!

14. Version 0.1 (c) CELEST 200714 Stimulus Discrimination Stimulus Discrimination occurs when animals are conditioned to respond to one specific CS and not others. Example: Only a tone of a specific frequency is followed by food. Other tone frequencies are presented without food. As a result, the dog only salivates after the tone of a specific frequency.

15. Version 0.1 (c) CELEST 200715 The Sequence of Events Acquisition: the gradual increase in the strength of a response that occurs with the pairing of a CS with a US. Extinction: occurs when the CS is presented without the US causing a decrease in the strength of the response.

16. Version 0.1 (c) CELEST 200716 Classical or Pavlovian Conditioning Strength of CR Time/Trials Acquisition (CS+UCS) Extinction (CS alone) Extinction (CS alone) Spontaneous recovery of CR Graph from Myers 6 th Ed.

17. Version 0.1 (c) CELEST 200717 Operant Conditioning

18. Version 0.1 (c) CELEST 200718 OPERANT CONDITIONING The frequency of a behavior is influenced by the presence or absence of a rewarding or aversive event after the expression of this behavior This theory is called Behaviorism B.F. Skinner developed the Skinner box to study this type of learning in pigeons. The pigeons learned to press levers to receive a reward!

19. Version 0.1 (c) CELEST 200719 Sequence of Events Acquisition: The animal’s response produces a reinforcer. Example: A rat presses a bar that produces food. The rat will begin to press the bar more frequently. Extinction: The animal’s response no longer produces a reinforcer. Example: A rat presses a bar but it no longer produces food. The rat will press the bar less frequently.

20. Version 0.1 (c) CELEST 200720 Schedules of Reinforcement

21. Version 0.1 (c) CELEST 200721 Examples of Schedules Fixed Ratio Schedule: A rat is given food for pressing a lever every 3 times. Fixed Interval Schedule: A rat is given food for pressing a lever after 1 minute has elapsed. Variable Ratio Schedule: A rat is given food for pressing a lever an average of 3 times. Variable Interval Schedule: A rat is given food for pressing a lever after an average of

22. Version 0.1 (c) CELEST 200722 Associative Learning ADAPTIVE TIMING: ADVANCED MODELING CLASSROOM PRESENTATION

23. Version 0.1 (c) CELEST 200723 WHAT NEEDS TO BE MODELED? AnatomyNeurophysiology A Complete Circuit!

24. Version 0.1 (c) CELEST 200724 EXPERIMENTAL PROTOCOL US: air puff Learning phase: for a selected number of trials, the sound is presented before the air puff (in delay or trace conditioning) Testing phase: the sound alone is presented to test for CR CS: sound UR, CR: nictitating membrane extension

25. Version 0.1 (c) CELEST 200725 TIMING IS EVERYTHING! The eye blink is a very transient response: must be made just prior to the air puff. If it is done too late, the eye is not protected when the air puff occurs. If it is done too early, the eye is not protected either since the blink ends too early!

26. Version 0.1 (c) CELEST 200726 EXPLAINING ADAPTIVE TIMING How does the brain learn to execute the right response at the right time? We need to consider the neural circuits involved in producing the eye blink response The critical structure is the cerebellum

27. Version 0.1 (c) CELEST 200727 THE BIG ISSUES The brain must have a way to keep track of time. It must have some kind of internal clock Learning may take place over many trials: learning occurs at a certain rate which can vary Both aspects can be studied through mathematical models

28. Version 0.1 (c) CELEST 200728 INTERNAL CLOCK IN THE CEREBELLUM Through a complex chemical process, some cells in the cerebellum can represent how much time has elapsed since a conditioned stimulus (CS) was presented The same cells can also learn to associate the unconditioned stimulus (US) with the CS Thus, these cells learn to time conditioned responses (CR)

29. Version 0.1 (c) CELEST 200729 ANATOMY OF A NEURON

30. Version 0.1 (c) CELEST 200730 CEREBELLAR CIRCUIT The circuitry involved in adaptive timing involves a several types of cells connected in very specific circuits The diagram illustrates that different circuits or pathways support specific sensory input (US, CS) and motor output (CR)

31. Version 0.1 (c) CELEST 200731 US PATHWAY The US signal due to the air puff to the eye travels in the pathway outlined in red First it is relayed to the inferior olivary cell Then it is communicated the Purkinje cell through climbing fibers

32. Version 0.1 (c) CELEST 200732 CS PATHWAY The CS signal due to the tone travels in the pathway outlined in green First it is relayed to the pontine nuclei Then it is sent to granule cells through mossy fibers Finally, it reaches Purkinje cells via parallel fibers

33. Version 0.1 (c) CELEST 200733 CR PATHWAY Purkinje cells influence cells in the interpositus nuclei, which directly control the expression of the CR through a series of projections ending at the facial nucleus The facial nucleus emits the appropriate motor response to cause the blink

34. Version 0.1 (c) CELEST 200734 The Central Circuitry Involved in Adaptive Timing

35. Version 0.1 (c) CELEST 200735 Required Parameters for the Cerebellar Model of Adaptive Timing of Eye Blinks

36. Version 0.1 (c) CELEST 200736 A NEURAL NETWORK MODEL OF ADAPTIVE TIMING: INQUIRY THROUGH SOFTWARE 1 Model 1: Simple user interface for virtual experiments (for less experienced students)

37. Version 0.1 (c) CELEST 200737 A NEURAL NETWORK MODEL OF ADAPTIVE TIMING: INQUIRY THROUGH SOFTWARE 1 Model 1: Simple user interface for virtual experiments (for less experienced students)

38. Version 0.1 (c) CELEST 200738 A NEURAL NETWORK MODEL OF ADAPTIVE TIMING: INQUIRY THROUGH SOFTWARE 2 Model 2: More complex interface for more experienced users

39. Version 0.1 (c) CELEST 200739 A NEURAL NETWORK MODEL OF ADAPTIVE TIMING: INQUIRY THROUGH SOFTWARE 3 Model 3: Most functionality for most experienced users