The Process The Results The Repository of Assessment Documents (ROAD) Project Sample Characteristics (“All” refers to all students enrolled in ENGL 1551) Spring 2011 Fall 2011 ROAD sampleAll VariableNMeanMean NMeanMean Age High school GPA YSU GPA Hours Completed ACT English Score Spring 2011 Fall 2011 ROAD sampleAll EthnicityFreq.PercentPercent Freq.PercentPercent Other Black White GenderFreq.PercentPercent Freq.PercentPercent Female Male Logistic Regression Results P Values for Statistically Significant Variables by Item, Fall and Spring 2011 Rubric Item Age(-)0.006(-)0.007 Age Squared(+)0.01(+)0.007 White(+)0.07(-)0.06 Male ACT English(+)0.001(+)<.0001(+)0.01(+)<.0001(+)<.0001(+)<.0001(+)<.0001 The signs of the coefficients are shown in parentheses Frequency Distributions and Means of Rubric Scores, Fall and Spring 2011 Score Rubric Item01234Mean Context of and Purpose for Writing Content Development Writing Conventions Sources and Evidence Control of Syntax and Mechanics Student's position (perspective, thesis/hypothesis) Conclusions All students taking ENGL 1551 (Writing 2) are asked to upload their final assignment to the repository. Starting Spring 2012 students in upper-division courses will also upload writing samples. Approximately 400 writing samples were randomly selected from the documents uploaded in the spring and fall of Using a seven-item rubric developed by YSU faculty, instructors hired and trained through the YSU Writing Center score the writing samples. Five of the items are used to evaluate the quality of the writing, two of the items evaluate whether the writing sample demonstrates critical thinking. Since the scores are stored in Banner, it is possible to analyze the relationship between the scores and different student characteristics. With the exception of ethnicity, the characteristics of the ROAD samples are very similar to the characteristics of all students enrolled in ENGL Students who take ENGL 1551 in the spring tend to have slightly higher grade point averages and higher scores on the English section of the ACT exam than the students who took the course in the fall. The graph on the left is a histogram for the rubric items students scored lowest and the one in which they did the best. The graph on the right shows the relationship between the rubric scores for the writing samples and the students’ scores on the English section of the ACT exam. For all seven rubric items, logistic regression analysis found a statistically significant relationship between the rubric scores and student scores on the English section of the ACT exam. A score of 0 meant there was no evidence of the characteristic associated with that rubric item. For example, a score of 0 would be given for the “Sources and Evidence” item if no source or evidence was used to support the statements made in the writing sample. A score of 4 meant that the writing sample represented exceptional senior-level work.