 Much of daily communication takes the form of story narratives.  Story comprehension and production depends on a logical sequence of cognitively-based.

Slides:



Advertisements
Similar presentations
Chapter 5 Measurement, Reliability and Validity.
Advertisements

What is a Good Test Validity: Does test measure what it is supposed to measure? Reliability: Are the results consistent? Objectivity: Can two or more.
General Information --- What is the purpose of the test? For what population is the designed? Is this population relevant to the people who will take your.
Examining the Relationship Between Confrontational Naming Tasks & Discourse Production in Aphasia Leila D. Luna & Gerasimos Fergadiotis Portland State.
Memory Span and Narrative Skills – Where’s the Connection? Line Engel Clasen, Kristine Jensen de López & Hanne Bruun Søndergaard Knudsen University of.
VALIDITY.
The Effects of Increased Cognitive Demands on the Written Discourse Ability of Young Adolescents Ashleigh Elaine Zumwalt Eastern Illinois University.
Chapter 13: Descriptive and Exploratory Research
TREATMENT OF WRITTEN DISCOURSE AFTER TRAUMATIC BRAIN INJURY IN ADOLESCENTS Cassie Fuller Eastern Illinois University Advisor: Dr. Brenda Wilson.
Chapter 7 Correlational Research Gay, Mills, and Airasian
Understanding Validity for Teachers
Quantitative Research
CORRELATIO NAL RESEARCH METHOD. The researcher wanted to determine if there is a significant relationship between the nursing personnel characteristics.
Review of three tests of children’s narrative ability [Poster presented at Narratives, Intervention, and Literacy conference, Paris, France, Sept. 2012]
Quantifying Data.
Multivariate Methods EPSY 5245 Michael C. Rodriguez.
Social Anxiety and Depression Comorbidity Influences on Positive Alcohol Expectancies Amy K. Bacon, Hilary G. Casner, & Lindsay S. Ham University of Arkansas.
Workshop on APA Style Morning Session II WSU College of Nursing October 24, 2008 Ellen Barton Linguistics/English WSU Director of Composition.
Formulating objectives, general and specific
Assessing Reading: Meeting Year 3 Expectations
Different Pathways To Offending and Violence: An Examination Of The Differences Among Youths With Varying Histories Of Contact With The Juvenile Justice.
What do Graduate Learners Say about Instructor and Learner Discourse in their First Online Course? By Dr. Peter Kiriakidis, PhD Abstract This study was.
Influence of Age and Executive Functions on Story Grammar Performance in Adults Michael S. Cannizzaro & Carl A. Coelho University of Connecticut, Storrs.
Jaw Pain: Characteristics and Prevalence in Fibromyalgia and other Rheumatic Disorders Robert S. Katz 1, Frederick Wolfe 2. 1 Rush University Med Center,
LECTURE 06B BEGINS HERE THIS IS WHERE MATERIAL FOR EXAM 3 BEGINS.
Analyzing Reliability and Validity in Outcomes Assessment (Part 1) Robert W. Lingard and Deborah K. van Alphen California State University, Northridge.
Standardization and Test Development Nisrin Alqatarneh MSc. Occupational therapy.
Introduction Neuropsychological Symptoms Scale The Neuropsychological Symptoms Scale (NSS; Dean, 2010) was designed for use in the clinical interview to.
Evaluating a Research Report
Miller Function & Participation Scales (M-FUN)
Consumer behavior studies1 CONSUMER BEHAVIOR STUDIES STATISTICAL ISSUES Ralph B. D’Agostino, Sr. Boston University Harvard Clinical Research Institute.
Reliability & Validity
Multiple Linear Regression. Purpose To analyze the relationship between a single dependent variable and several independent variables.
By: Amani Albraikan.  Pearson r  Spearman rho  Linearity  Range restrictions  Outliers  Beware of spurious correlations….take care in interpretation.
INTRODUCTION Early after injury, persons with mild traumatic brain injury (TBI) have been shown to experience physical, cognitive, and emotional difficulties.
Types of Validity Content Validity Criterion Validity Construct Validity Predictive Validity Concurrent Validity Convergent Validity Discriminant Validity.
META-ANALYSIS, RESEARCH SYNTHESES AND SYSTEMATIC REVIEWS © LOUIS COHEN, LAWRENCE MANION & KEITH MORRISON.
What do Graduate Learners Say About Instructor and Learner Discourse in Online Courses? By Dr. Peter Kiriakidis, PhD Abstract This study was grounded on.
Validity: Introduction. Reliability and Validity Reliability Low High Validity Low High.
Background Narratives are often the basis of daily conversational interactions. Compromised narrative skills negatively impact functional conversation.
Parent Guide to Using Lexile Scores Provided on the Georgia Milestones Individual Score Reports Using the Lexile Score to support the growth of your child’s.
PURPOSE To investigate concurrent validity for the SAM by examining relationships between the SAM indices and commonly measures of executive functioning.
Tristen Hastings & Wendy Wolfe Method For further information, contact the first author undergraduate, Tristen Hastings at
J UMPING AROUND AND LEAVING THINGS OUT : A PROFILE OF THE NARRATIVES ABILITIES OF CHILDREN WITH SPECIFIC LANGUAGE IMPAIRMENT M IRANDA, A., M C C ABE, A.,
Parental, Temperament, & Peer Influences on Disordered Eating Symptoms Kaija M. Muhich, Alyssa Collura, Jessica Hick and Jennifer J. Muehlenkamp Psychology.
+ Mortality. + Starter for 10…. In pairs write on a post it note: One statistic that we use to measure mortality On another post it note write down: A.
The Clinical Utility of the LANSE- A and LANSE-C Jennifer L. Harrison, M.A., Megan Pollock, M.A., Amy Mouanoutoua, M.A. Ashley Brimager, M.A., & Paul C.
© 2009 Pearson Prentice Hall, Salkind. Chapter 5 Measurement, Reliability and Validity.
Statistics & Evidence-Based Practice
Insights into Verbal Planning Total score of core propositions
Difference in Mls poured between the subject and the researcher
1University of Toledo, 2Memorial University
Factorial components of visual naming on the Boston Naming Test and the Multilingual Aphasia Examination are dimensionally congruent and demographically.
Bowden, Shores, & Mathias (2006): Failure to Replicate or Just Failure to Notice. Does Effort Still Account for More Variance in Neuropsychological Test.
FUNDING ACKNOWLEDGEMENT
Physical Activity Reductions in Male Veterans With Traumatic Brain Injury Karl F. Kozlowski 1,Greg Homish 1, Michelle Alt 2, Sarah Piwowarczyk 2, Kerry.
AN INTRODUCTION TO EDUCATIONAL RESEARCH.
Dwight Dickinson1, Evan Giangrande1, Daniel R. Weinberger2, Karen F
MMPI-2 Items by NEO-PI-R Facet Limitations & Future Directions
Differences in comprehension strategies for discourse understanding by native Chinese and Korean speakers learning Japanese Katsuo Tamaoka Graduate.
EDU 5818 DATA COLLECTION AND ANALYSIS
Introduction Results Conclusions Method
EPSY 5245 EPSY 5245 Michael C. Rodriguez
An Introduction to Correlational Research
Chapter 18: The Chi-Square Statistic
TEST FOR RANDOMNESS: THE RUNS TEST
EDU 5818 L08 DATA COLLECTION AND ANALYSIS
EDU 5818 DATA COLLECTION AND ANALYSIS
Interrater differences
The TOEFL Primary® Speaking Test Tasks
Presentation transcript:

 Much of daily communication takes the form of story narratives.  Story comprehension and production depends on a logical sequence of cognitively-based story structures (e.g., story grammar), which guide interpretations, expectations, and inferences about relationships between people and events in a story.  Indices of story grammar (e.g., number of total episodes, proportion of T-units within episodes) have been shown to be sensitive to brain injury, but story grammar may not completely characterize a “good” story narrative.  It is possible for an individual to have high story grammar scores, reflecting ability to organize semantic content, and still produce an incomplete story.  “Good” story narratives likely depend on both organization and content. INTRODUCTION DISCOURSE ANALYSIS PROCEDURE  Task: After viewing a picture story with no soundtrack, each participant was instructed to retell the story. Retellings were recorded and transcribed.  T-unit segmentation involved identification of each independent clause and its associated subordinate clauses for each transcript. Story grammar analysis (organization)  Story grammar was examined via episode structure. An episode consists of (a) an initiating event (IE) that prompts a character to formulate a goal-directed behavior, (b) an action (A), and (c) a direct consequence (DC) marking attainment or non-attainment of the goal.  The primary measure of story grammar was the proportion of T-units within episodic structure score (T-units within episodes/total T-units in retelling) combines information regarding both episodes (consisting of an initiating event, an attempt, & a direct consequence) and T-units. Story completeness measure  Inventory of key events and characters produced in each transcript of the normative sample was created.  Pooled into a matrix across all non-brain-injured controls, inventory items clustered into 7 distinct components.  Inclusion criterion for critical component:  80% of controls (range: 83% - 98%)  5 components found to be critical  Each narrative reviewed for presence of 5 critical components (1 point for each component).  Completeness score: total number of critical components in each story DATA ANALYSIS  Correlation coefficients were calculated for measures of story organization and story completeness. Quantifying Goodness of Story Narratives Karen Lê 1, Carl A. Coelho 1, Jennifer Mozeiko 1 and Jordan Grafman 2 1-University of Connecticut, Storrs, CT & 2-National Institute for Neurological Disorders and Stroke, Bethesda, MD  The present study investigated an additional measure of story narrative performance—story completeness.  The story completeness measure involves a tally of the critical story components mentioned by the storyteller.  It was hypothesized that by combining organizational (story grammar) and completeness measures, story goodness could be quantified. Figure 1. RESULTS Figure 3. Figure 5. Table 1: Participants Participants (N) Age Range in Years Years of Education Armed Forces Qualification Test Boston Naming Test Token Test Control (46) TBI (24)  All participants were native English-speaking males, who were Vietnam War veterans. All individuals with TBI survived penetrating head wounds during the Vietnam War. Quadrant 1  Organized  Incomplete Normative group: 2% Quadrant 2  Organized  Complete Normative group: 83% Quadrant 3  Disorganized  Incomplete Normative group: 9% Quadrant 4  Disorganized  Complete Normative group: 7% DISCUSSION  When measures of story organization and completeness are combined, story goodness can be quantified.  The combined measure proved to be sensitive in that it classified the story narratives of control subjects into 4 distinct subgroups of story goodness.  There is potential utility for analyzing narratives using the combined measure in clinical populations and lesion analyses. A moderate correlation between the story organization and story completeness measures was noted (.531, p =.01), suggesting the indices are not entirely measuring the same things. Figure 2. Performance across the two measures is plotted in quadrants. Quadrant boundaries were set at 1SD below the mean (dashed lines) for each measure:.49 for story organization (story grammar) and 3.34 for story completeness.  Quadrant 1 was defined by scores of >.49 for story organization and ≤ 3.34 for story completeness.  Quadrant 2 was defined by scores of >.49 for story organization and > 3.34 for story completeness.  Quadrant 3 was defined by scores of ≤.49 for story organization and ≤ 3.34 for story completeness.  Quadrant 4 was defined by scores of ≤.49 for story organization and > 3.34 for story completeness. PURPOSE METHODS Figure 4. Contact: Figure 5.