Using the ETS Criterion Online Writing System to Enhance and Assess Learner-Centered Writing Proficiency Robert Ussery, Assistant Vice Chancellor for Academic Affairs Robert Ussery, Assistant Vice Chancellor for Academic Affairs North Carolina A&T State University North Carolina A&T State University The Redesign Alliance Conference The Redesign Alliance Conference Orlando, Florida Orlando, Florida March 18, 2008 March 18, 2008

CRITERION A web-based service developed by Educational Testing Service to: A web-based service developed by Educational Testing Service to:  Evaluate writing skills  Provide instant score reporting and diagnostic feedback to:  Both students and instructors

Benefits - for Students Improve writing skills Empower the learner Work independently at own pace Access 24/7 from any computer Get immediate detailed feedback Enhance communication with instructor

Benefits - for Instructors Adds value to instructional activities Saves time by providing an efficient tool to: administer class assignments administer class assignments grade essays grade essays comment on student work comment on student work review student portfolios review student portfolios concentrate on course content concentrate on course content

Access to CRITERION Student access is browser-based

Instructor access is browser-based I

NCA&T OBJECTIVES Provide online writing evaluation system Deploy as a learning tool Campus-wide Campus-wide Across the curriculum Across the curriculum Enhance writing proficiency

SCOPE Freshman student orientation Freshman student orientation New faculty orientation New faculty orientation Faculty training Faculty training 45% of enrollment subscribed in % of enrollment subscribed in % of enrollment subscribed % of enrollment subscribed st Year English Placement – st Year English Placement –

SCOPE Cont’d Writing labs Writing labs Center for Academic Excellence Center for Academic Excellence Various disciplines Various disciplines Graduate level Graduate level

How We Use Criterion at NCAT Remediation and basic skills classes Remediation and basic skills classes Assessment Assessment Online writing courses Online writing courses Practice for high-stakes writing Practice for high-stakes writing Writing across the curriculum Writing across the curriculum

EXPERIENCE AND RESULTS Compared final grades in freshman English sections Fall 2005 Compared final grades in freshman English sections Fall 2005 Group 1: Criterion assignments required Group 1: Criterion assignments required Group 2: No Criterion assignments Group 2: No Criterion assignments Group 1 mean was significantly higher Group 1 mean was significantly higher

Implications Enhanced Student Learning Outcomes Enhanced Student Learning Outcomes Beneficial Impact on Retention Beneficial Impact on Retention Very Cost Effective Very Cost Effective

WHERE TO FROM HERE Rigorous learning outcomes assessment Rigorous learning outcomes assessment Explore proficiency requirement Explore proficiency requirement  English  University studies  Other disciplines

Thank you for attending NCA&T Support Site