A Practical Approach to Pre & Post Testing Probing for learning outcomes while avoiding the pitfalls Annie Donahue UNHM Library October 23, 2003

Background - Getting Started n UNH Preparing Future Faculty Program Grad Classroom Research and Assessment Methods UNH Preparing Future Faculty Program n Outcome - Focus on learning not teaching n Resource - Classroom Assessment Techniques by Angelo & Cross

n CHARACTARISTICS –Learner-centered –Teacher directed –Mutually beneficial –Formative –Context-specific –Ongoing feedback loop –Rooted in good teaching practice Classroom Assessment Techniques

Background Knowledge Probe n University Of New Hampshire - Manchester n Southern Illinois University - Edwarsdville Southern Illinois University - Edwarsdville n George Mason University George Mason University n Portland State University Portland State University n University of Missouri - Rolla University of Missouri - Rolla n University of Nothern Iowa /background.htm University of Nothern Iowa

Building the Pre/Post Test n Know your teaching objectives and test to those objectives n Determine the type of questions to ask -open- ended - short answer - multiple choice - true/false n Provide clear instruction n Consider how much time will be available to administer the instrument n Plan how you will use the information learned n Expect this instrument to evolve with use - plan to adapt it for future use

Administering the Pre/Post Test n Faculty collaboration is essential n Timing of delivery can affect results n Explain the purpose of the instrument n Key characteristics - anonymous and ungraded n Provide feedback - close the loop

Integrating Assessment Findings n Determine strengths and weaknesses n Examine your teaching style and consider adaptations n Focus on changes you can make n Incorporate at least one change in the next offering n Continue to assess - it is an ongoing enterprise

Resources to Get You Started n Carter, Elizabeth W. “Doing the Best You Can with What You Have:” Lessons Learned from Outcomes Assessment. The Journal of Academic Librarianship. Vol. 28 (1), Jan-Mar 2002, pp n Barclay, Donald. “Evaluating Library Instruction: Doing the Best You Can with What You Have.” RQ. Vol. 33 (2), Winter 1993, pp n Project Sails - Project Sails n ACRL Standards & Guidelines - nd_Guidelines/Standards_and_Guidelines.htm ACRL Standards & Guidelines

Wrap-up, Questions & Comments n “The value of outcomes assessment is that it improves the thing being evaluated. It demands a commitment of time, effort, and resources. It requires collaboration with faculty in other departments. It can be as simple or elaborate as resources allow. To be meaningful, though, assessment must collect hard data, and librarians must use that data to evaluate their programs and make changes necessary to improve those programs. Outcomes assessment is an ongoing process. One need not wait for the perfect opportunity, the perfect instrument, or the perfect time. A modest study that is well designed and collects hard data can provide valuable information. One can learn from each experience and refine and improve assessment procedures with each effort, doing the best you can with what you have.” Elizabeth W. Carter - Daniel Library, The Citadel.