Presentation on theme: "David Eubanks Director of Planning, Assessment, and Information Services Coker College Hartsville, South Carolina Assessing The Elephant."— Presentation transcript:
David Eubanks Director of Planning, Assessment, and Information Services Coker College Hartsville, South Carolina Assessing The Elephant
The Goal The College's goal is to graduate students with the ability to think analytically and creatively, and to write and speak effectively.
The Unmoved Mover [I]t is imperative […] to avoid narrow definitions of student learning or excessively standardized measures of student achievement.
The Unmoved Mover Collegiate learning is complex, and the evidence used to investigate it must be similarly authentic and contextual.
The Unmoved Mover But to pass the test of public credibility […] the evidence of student learning outcomes used in the accreditation process must be rigorous, reliable, and understandable. All CHEA quotes are from:
The question “Can Stanislav write effectively?” should be answered in language that is rigorous, reliable, and understandable.
“…the meaning of a word is its usage in the language…” -Wittgenstein language
Context and perspective
Power of dialogue Example: If we want to distinguish between 128 possibilities (where n = 7), Monologue requires 127 questions; Dialogue requires 7.
Complexity vs. reliability
Example: arithmetic = 18 ? This can be assessed with high reliability and high validity because it’s algorithmic.
Example: Turing Test The Turing Test for Machine Intelligence: If a computer, on the basis of its written replies to questions, could not be distinguished from a human respondent, then ‘fair play’ would oblige one to say that it must be ‘thinking’. -Quoted from Alan Turing: The Enigma, by Andrew Hodges
Assessment as a Tire gauge We can all agree that the tire pressure is about 30 psi.
Assessment as telescope You don’t know what you’ll discover when you build the telescope, but we can create language to describe it.
Just The Facs, ma’am The Faculty Assessment of Core Skills (FACS) Mission-based (effective writing, etc.) Rubrics in course syllabi Evaluation of authentic evidence each term Aggregation of results into group perception
features Uses authentic data in context Uses full perceptive ability of experts Fosters dialogue among students, faculty Creates a “Wittgensteinlich” language Has high prima fascia validity Has measurable reliability Is “low stakes”, reducing rater bias
data 11,770 responses 1743 of 2054 traditional students (85%) Correlation with grades =.64
Inter-rater Reliability Probability of matching ratings between two raters for same student and skill:
THE matthew effect
Student/Advisor Report Student has 104 Credits (about seven semesters) Comparison group averages: 1.9, 1.8, 1.8, 1.9, respectively.