All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.

Slides:



Advertisements
Similar presentations
All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.
Advertisements

Chapter 9 Choosing the Right Research Design Chapter 9.
All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.
All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
Time-Domain Signals, Filtering, and the Overlap Problem
Experimental Design making causal inferences. Causal and Effect The IV precedes the DV in time The IV precedes the DV in time The IV and DV are correlated.
Pre-processing for EEG and MEG
All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 13 Experiments and Observational Studies.
The Event-Related Potential (ERP) Embedded in the EEG signal is the small electrical response due to specific events such as stimulus or task onsets, motor.
Validity, Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Validity, Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Experimental Design: Single factor designs Psych 231: Research Methods in Psychology.
Writing with APA style (cont.) & Experiment Basics: Variables Psych 231: Research Methods in Psychology.
How do you know it worked
Experimental Control & Design Psych 231: Research Methods in Psychology.
Research Design and Behavioral Analysis
Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Experimental Control & Design Psych 231: Research Methods in Psychology.
Some Notes on the Design and Analysis of Experiments.
Experiments and Observational Studies.  A study at a high school in California compared academic performance of music students with that of non-music.
All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.
Research Methods in Psychology
Copyright © 2010 Pearson Education, Inc. Chapter 13 Experiments and Observational Studies.
Experiments and Observational Studies. Observational Studies In an observational study, researchers don’t assign choices; they simply observe them. look.
Copyright © 2010 Pearson Education, Inc. Slide
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 13 Experiments and Observational Studies.
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
 Is there a comparison? ◦ Are the groups really comparable?  Are the differences being reported real? ◦ Are they worth reporting? ◦ How much confidence.
Slide 13-1 Copyright © 2004 Pearson Education, Inc.
Part III Gathering Data.
Research Methods in Psychology Descriptive Methods Naturalistic observation Intensive individual case study Surveys/questionnaires/interviews Correlational.
Functional Brain Signal Processing: EEG & fMRI Lesson 4
All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.2Experiments.
Experiments and Causal Inference ● We had brief discussion of the role of randomized experiments in estimating causal effects earlier on. Today we take.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.2Experiments.
The ERP Boot Camp Isolating Components with Difference Waves and
Experimental Psychology PSY 433
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.2Experiments.
Introduction Can you read the following paragraph? Can we derive meaning from words even if they are distorted by intermixing words with numbers? Perea,
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.2Experiments.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.2Experiments.
Producing Data: Experiments BPS - 5th Ed. Chapter 9 1.
CHAPTER 9: Producing Data Experiments ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
Signal Processing: EEG to ERP A Darren Parker Presentation.
All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.
All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.
Event-Related Potentials Chap2. Ten Simple Rules for Designing ERP Experiments (2/2) 임원진
All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.
DESIGN AND ANALYSIS OF EXPERIMENTS. DESIGN OF EXPERIMENTS Planning an experiment to obtain appropriate data and drawing inference out of the data with.
CHAPTER 4 Designing Studies
Examples of Experimental Design
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
Chapter 4: Designing Studies
Statistical Reasoning December 8, 2015 Chapter 6.2
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
Chapter 4: Designing Studies
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
Presentation transcript:

All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright notice is included, except as noted Permission must be obtained from the copyright holder(s) for any other use The ERP Boot Camp Design and Interpretation of ERP Experiments

Typical Design Problems Failure to isolate a specific ERP component Failure to isolate a specific ERP component -Measurement of one component is distorted by a different component -You think you’re measuring Component X, but you’re really measuring Component Y -Your latency difference is really caused by an amplitude difference (or vice versa) -Amplitude differences are due to differences in latency jitter, not differences in single-trial amplitudes -Offset of ERP from trial N-1 distorts baseline of trial N

Confounds and Side Effects Confound: You explicitly manipulate two things together Confound: You explicitly manipulate two things together -Target is “X” / p =.1; Standard is “Y” / p =.9 -“That can’t possibly be producing my effect…” Confounds that “don’t matter” in behavioral experiments often matter in ERP experiments Confounds that “don’t matter” in behavioral experiments often matter in ERP experiments -Form and timing of the stimuli Side effect: You manipulate one thing, but that one thing indirectly influences other things Side effect: You manipulate one thing, but that one thing indirectly influences other things -Condition A: SOA = 500 ms; Condition B: SOA = 1000 ms -Subjects are bored in Condition B -Overlap distorts waveforms in Condition A -Potentially infinite number of side effects

Confounds and Side Effects Side effects are sometimes impossible to avoid Side effects are sometimes impossible to avoid -Even true confounds may be hard to avoid -Example: ERPs to content vs. function words If you can’t eliminate them, show that they don’t actually produce the observed effect If you can’t eliminate them, show that they don’t actually produce the observed effect Example: Embedded words Example: Embedded words -BITE vs. PECK -Looking for early differences -Might be sensory differences between word classes -Solution: Test speakers of two different languages This is a lot of work This is a lot of work -But if the experiment is worth doing, it should be worth the effort to do it right (pride!!!)

Example Experiment Goal Goal -Examine P3 for easy and difficult discriminations Design Design -Oddball experiment with foveal stimuli at 1/sec -X on 20% of trials; O on 80% of trials -Press a button for X; no response for O -No target repetitions -Stimuli are bright or dim (different blocks) Analysis Analysis -P3 amplitude measured as baseline-to-peak voltage

Problems and Solutions Problem: Target and standards are physically different Problem: Target and standards are physically different -Different stimuli elicit different ERPs -Sensory responses can persist for hundreds of ms -Differential adaptation The Hillyard Principle- Always compare ERPs elicited by the same physical stimuli, varying only the psychological conditions The Hillyard Principle- Always compare ERPs elicited by the same physical stimuli, varying only the psychological conditions Solution: Use 5 characters; each is target in one of 5 trial blocks Solution: Use 5 characters; each is target in one of 5 trial blocks

Violations of Hillyard Principle Luck & Hillyard (1994)

Violations of Hillyard Principle Luck & Hillyard (1994)

Problems and Solutions Problem: Subjects make response to target, not to standards Problem: Subjects make response to target, not to standards -Motor activity contaminates P3 -Solution: Separate responses for target & standards Problem: Target always preceded by nontarget Problem: Target always preceded by nontarget -Nontarget baseline contaminated by overlap from previous P3 -Solution 1: Completely random sequence -Solution 2: During averaging, exclude nontargets preceded by targets

Overlap Jittering the SOA is equivalent to filtering out high frequencies from overlap Overlap is a problem primarily when it differs across conditions

Peak Amplitude and Noise Clean Waveform Waveform + Noise Problem: Peak amplitude biased by number of trials Problem: Peak amplitude biased by number of trials -Solution: Mean amplitude or select a random subset of nontargets

Problems and Solutions Problem: Brightness manipulation has side effect of changing sensory components Problem: Brightness manipulation has side effect of changing sensory components -Solution: Control experiment to show that brightness per se does not impact P3 amplitude Problem: Subjects may be in a different state of arousal during bright and dim blocks Problem: Subjects may be in a different state of arousal during bright and dim blocks -Solution: Mix brightness within blocks Problem: RTs will be different for bright & dim targets Problem: RTs will be different for bright & dim targets -Solution 1: Select sets of trials with equivalent RT distributions for averages -Solution 2: Estimate and remove motor potentials

More Rules Rule #6- Whenever possible, avoid physical stimulus confounds by using the same physical stimuli across different psychological conditions Rule #7- When physical stimulus confounds cannot be avoided, conduct control experiments to assess their plausibility Rule #8- Be cautious when comparing averaged ERPs that are based on different numbers of trials Rule #9- Be cautious when the presence or timing of motor responses differs between conditions Rule #10- Whenever possible, experimental conditions should be varied within rather than between trial blocks

Some General Advice ERP experiments are hard to design perfectly ERP experiments are hard to design perfectly You will constantly be frustrated by the need to balance the number of conditions with the number of trials per condition You will constantly be frustrated by the need to balance the number of conditions with the number of trials per condition Keep each experiment as simple as possible, and realize that you will probably need multiple experiments Keep each experiment as simple as possible, and realize that you will probably need multiple experiments - The additional experiments will provide your replications! In the end, this will save you time In the end, this will save you time Each experiment will teach you something that will allow you to do a better job with the next experiment Each experiment will teach you something that will allow you to do a better job with the next experiment Don’t try to do the last experiment first Don’t try to do the last experiment first “Context of Discovery” vs. “Context of Justification” “Context of Discovery” vs. “Context of Justification”