Information Literacy Assessment: What Works, What Doesn’t, and the San Jose State University Experience CARL 2006 Conference Presented by Toby Matoush.

Slides:

Advertisements

Similar presentations

Planning Collaborative Spaces in Libraries

Advertisements

Institutional Readiness Questionnaire Bonnie Luterbach, Raymond Guy, Kathleen Matheos Funding for this study was provided by HRSDC and CNIE.

Assessing Intentional Learning: A Teagle Foundation Project Wendy Kolmar, Drew University.

3 Developmental Math Courses Basic Math, Elementary Algebra, Intermediate Algebra 6 College Level Math Courses College Algebra, Statistics, Finite Math.

Tammy Muhs-University of Central Florida

The University of Scranton Using Workflow to Streamline Campus Processes Bill Burke Director of Financial Aid The University of Scranton.

How did we get Here and Where are We? Outcomes Assessment at Carteret Community College.

The Continuous Improvement Classroom Day

The Continuous Improvement Classroom

© S.J. Coles 2006 Usability WS, NeSC Jan 06 Experiences in deploying a useable Grid-enabled service for the National Crystallography Service Simon J. Coles.

Forging Faculty Librarian Collaborations in Information Literacy Savannah State University October 1, 2010 Georgia Conference on IL.

Research performance in undergraduates receiving face to face versus online library instruction: A Citation Analysis Sarah Clark and Susan Chinburg Rogers.

First-Year Graduate Student Survey INTRODUCTION As part of the Graduate Schools recruitment and retention efforts, a graduate student survey was developed.

Culture of Assessment NCLB Outcomes-based assessment Accountability.

Introduction Update Virginias Brain Injury Action Plan Define brain injury service options, terms Solicit feedback on core services Identify local service.

2007 Fall Convocation. 2 WASC Accreditation Reaffirmation

S. J. Schaeffer, III, EdD Advanced Learning Center Fall 2013.

If They Build It, Will They Come? Implementing Students Conceptions of an Ideal Library Home Page Joan Stein, Carnegie Mellon University Nathan Browne,

Improving Practitioner Assessment Participation Decisions for English Language Learners with Disabilities Laurene Christensen, Ph.D. Linda Goldstone, M.S.

AP Statistics Mr. Deem (858) ext 4267

SLS 1503 Information Literacy Assessment Study ILIS Presentation.

USING THE CLA TO INFORM CAMPUS PLANNING Anne L. Hafner Campus WASC Faculty Coordinator Winter 2008.

E-Portfolios for Student Veterans: A Collaborative and Multidisciplinary Approach Within the Library SUNYLA 2014 Krista Gruber, Co-Principal Investigator.

1 Your Quality Enhancement Plan (QEP) Associate Professor Sarah Thomason & Karen Brunner, Asst. VP for Institutional Effectiveness & Research August 29,

Understanding our First Years Three studies and a comparison.

2008 Library Assessment Conference, Seattle, WA Using iSkills to measure instructional efficacy: One example from the University of Central Florida Penny.

Weber State University Meeting the Challenges of Library Instruction in Core Writing Courses Carol Hansen Professor and Instruction Services Librarian.

Measuring the Impact of Service-Learning on Student Retention and Civic Skills Matthew Roy, Ph.D. Assistant Vice Chancellor for Civic Engagement University.

Putting Assessment in its Place Creating and Implementing a Campus-Wide Information Literacy Rubric

Assessment of information literacy skills circle at Higher Education Institutions in South Africa is it a reality or not? Presented by Gerda Ehlers University.

Information Literacy for a Freshman Engineering Studies Course Larry Schmidt Science/Engineering Librarian Charles W. Dolan H. T. Person Professor Department.

Diana Chan, HKUST Enhancing Learning Experiences in Higher Education: International Conference 2 -3 December 2010.

Master Online Teacher Competencies eLearning Conference 2007 Virgil E. Varvel Jr.

Library Instruction for All: Exploring Ways to Accommodate All Learning Styles in and out of the Classroom Vivienne Piroli Reference/Instruction Librarian.

Eportfolio, General Education, & Undergraduate Learning Goals An ePortfolio and Learning Goal Matrix Case Study.

An Overview of the Higher Education ICT Literacy Assessment Ilene Rockman Gordon Smith California State University Irvin R. Katz Educational Testing Service.

Where Technology and Information Literacy Meet: Interactive Web-based Tutorials for Lifelong Learning October 2, 2005 LITA National Forum Pamela Jackson.

Understanding our First Years Two studies and a comparison.

Information Literacy Tutorial for the First Time in College Student St. Philip’s College LRC San Antonio, Texas Dr. Adele S. Dendy, Dean of Learning Resources.

The Harold Schiffman Music Library Team 4 Needs Assessment David Covert, Mia Jordan, Rachel Koury, Lara Patterson, Savannah Whitaker.

Seven Hills Elementary Futures Under Construction

The Development of a Pre- and Post-Test for Assessing First-Year Library Instruction, Delivered Using Blackboard Randall Bowman Reference/Instruction Librarian.

1 Self-regulated Learning Strategies and Achievement in an Introduction to Information Systems Course Catherine, S. C. (2002). Self- regulated learning.

TELPAS, STAAR-ALT & Other Online Testing Presented by: Nancy Webster, Galena Park ISD & Tracy McDaniel, Spring ISD.

Enterprise Resource Planning A/Prof.Dr.Supot Nitsuwat.

ICT Assessment, the Librarian’s View Eileen Stec, Instruction & Outreach Librarian, Rutgers University April 18, 2007.

Plagiarism Instruction Online: Using an Interactive Information Literacy Tutorial to Assess Students’ Understanding of Academic Integrity Pamela A. Jackson.

Wartburg College What do First-Year Students Know About Information Literacy and When Do They Know It? IA/ACRL Panel, April 21, 2006.

Plagiarism: The Crime of Intellectual Kidnapping: An Interactive Information Competence Tutorial at San Jose State University Pamela A. Jackson Reference/Instruction.

Mapping Through the Maze Status of Information Literacy on WeTALC Campuses.

ICT Literacy: Assessing Readiness for E-learning Gordon W. Smith, PhD California State University MERLOT 2006 Ottawa.

L1-S1Introduction 2003 SJSU -- CmpE Advanced Object-Oriented Analysis & Design Dr. M.E. Fayad, Professor Computer Engineering Department, Room #283I College.

Spring 2013 Student Opinion Survey (SOS) Take it Seriously… YOUR OPINION COUNTS!!!

King Library’s Online Information Literacy Tutorials Pamela Jackson Reference/Instruction Librarian San José State University Library March 15, am.

International Student Information Competence A San José State University Survey Pamela Jackson San José State University.

Online Information Competence Tutorials: Influencing Change in Traditional Library Classrooms Pamela Jackson San José State University Library MERLOT International.

Re-Visioning the Future of University Libraries and Archives through LIBQUAL+ Cynthia Akers Associate Professor and Assessment Coordinator ESU Libraries.

Comparing Senior And Sophomore Knowledge and Confidence Concerning Academic Advising Anecdotal evidence suggested that a discrepancy existed between what.

VSA & Assessment of Learning Outcomes Sally Frazee, Temple University Criss Gilbert, University of Minnesota-Twin Cities Susan Morgan – Appalachian State.

Assessing Information Literacy with SAILS Juliet Rumble Reference & Instruction Librarian Auburn University.

Mark Vargas, Library Director Anne Buchanan, Assistant Librarian Saint Xavier University Library Building and Strengthening Upper Level Research Skills.

Ma Lei Hsieh Instruction Librarian Rider University Patricia H. Dawson Science Librarian Rider University VALE User.

AAC&U VALUE Project: Minnesota Collaborative Demonstration Year 2 ( ) Demonstration Year 3 ( ) 1.

1 Designing the HyFlex World Dr. Brian Beatty Instructional Technologies San Francisco State University AECT 2006.

NAEP What is it? What can I do with it? Kate Beattie MN NAEP State Coordinator MN Dept of Education This session will describe what the National Assessment.

How do you use library instruction?. Library Instruction That Improves Self-Efficacy and Academic Achievement 2016 Innovations Conference, Chicago, Illinois.

Competency-Based Assessments & Course Development with QM as Guide

Building and Strengthening Upper Level

SUNY Oneonta’s CLA Results:

Presentation transcript:

Information Literacy Assessment: What Works, What Doesn’t, and the San Jose State University Experience CARL 2006 Conference Presented by Toby Matoush SJSU Library

Abstract This poster session will detail the San Jose State University experience using two national information literacy assessment tests currently being developed: the ETS Information and Communication Technology Literacy (ICT) Test and the Standardized Assessment of Information Literacy Skills (SAILS) Test.

Standardized Assessment of Information Literacy Test Tests information literacy concepts based on ACRL information literacy objectives 50 Multiple-choice questions; no tasks Available both online and in print (monitored or unmonitored testing environment) Tests cognitive but not performative skills

ETS Information & Communication Technology Literacy (ICT) Test Tests both information literacy & information technology (computer skills) Scenario-based questions; 15 tasks Available online only in highly monitored testing center Tests not only cognitive skills but also performative

Test Similarities Based on ACRL information literacy objectives Tests skill sets Available online Can be used to determine student research ability and research skills which need work

Test Differences Cost: ETS ICT is $18.75-$25 (may increase) per test; SAILS is $2,000 per semester Testing environment: ICT is highly monitored only; SAILS can be monitored or unmonitored Test length: ETS ICT is 90 minutes; SAILS is 25 minutes Scoring: ETS ICT automatic scoring based on sub-proficiences; SAILS scoring using Winsteps software administered by Kent State faculty/IT

The SJSU Experience: SAILS Participated in all 3 phases; tested approx students per phase ( ) Test can be taken both from home or in a monitored library classroom SJSU is not using test scores Unable to add questions to test (demographics, library); may change in 2006

The SJSU Experience: ETS ICT Test Participated in beta-testing Spring 2005 and 2006; tested 115 (05) and 650 students (06) Test must be taken in highly monitored environment with proctors Campus assessment project; scores will be used in WASC & GE assessment Ability to add any additional questions

What SJSU Learned: What Works Faculty recruitment and testing classes Campus buy-in; SJSU received a grant for ETS ICT testing for Spring 2006 Faculty recruitment using faculty; Library was assisted in recruitment by faculty University culture of assessment; SJSU has new GE information literacy objectives

What SJSU Learned: What Doesn’t Work Student recruitment via phone or Student testing without incentives (extra credit) Random sampling (most statistically accurate) versus testing classes of interested professors Testing without faculty and campus buy-in

SAILS Challenges Difficult to recruit without campus buy-in Score reports difficult to read Validity and usability of test is questionable: Test reveals little variability between test groups (freshman vs. seniors, etc.) Testing only really works if campus uses it for assessment Faculty will usually only assign if students can take from home

ETS ICT Challenges Little flexibility with test times, testing environment, methodology Schedules testing during busiest time of semester (first 2 months) Test scores available only online Highly proprietary about test material Test is extremely time-consuming to administer