1. From Micro to Macro: Correlating Instruction with Student Learning & Success through Local and National Initiatives Zoltán Szentkirályi, Director of Assessment Hollie Gardner, User Experience Librarian Central University Libraries Southern Methodist University North Texas Library Assessment Group Spring Meeting 2015 March 20, 2015

2. GWLA Learning Outcomes Conference & Workshop November 13-15, 2013 at UNLV, Las Vegas 33 GWLA member universities, each encouraged to send a team of three people to discuss SLO’s. SMU Team:  “Manager in Charge of Library Instruction Program” Elizabeth Killingsworth  “Assessment Representative” Zoltán Szentkirályi  “Instruction Librarian” Hollie Gardner Student Outcomes Research

3. GWLA Greater Western Library Alliance Arizona State University Baylor University Brigham Young University Colorado State University Iowa State University Library Kansas State University Oklahoma State University Oregon State University Rice University Southern Illinois University Southern Methodist University Texas A&M University Texas Tech University University of Arizona University of Arkansas University of Colorado at Boulder University of Hawai'i at Mānoa Student Outcomes Research University of Houston University of Illinois at Chicago University of Kansas University of Missouri University of Nevada, Las Vegas University of New Mexico University of Oklahoma University of Oregon University of Southern California The University of Texas at Austin University of Utah University of Washington University of Wyoming Utah State University Washington State University Washington University in St. Louis The Greater Western Library Alliance (GWLA) is a consortium of 33 research libraries located in the central and western United States.

4. GWLA Student Learning Task Force Initial Charge Established Spring 2011 Goals for the GWLA Student Learning Task Force:  To investigate and share local evaluation/assessment practices and evidence obtained, across GWLA institutions  To create a research question and identify ways to assess students, using all GWLA universities as a possible sample population Student Outcomes Research

5. GWLA Student Learning Task Force First Phase of the Charge  To investigate and share local evaluation/assessment practices and evidence obtained, across GWLA institutions 2011 – 2014 Report Compiled and Submitted Student Outcomes Research

6. GWLA Student Learning Task Force Second Phase of the Charge  To investigate and share local evaluation/assessment practices and evidence obtained, across GWLA institutions  To create a research question and identify ways to assess students, using all GWLA universities as a possible sample population Spring 2014 - Call For Participants for Research Project Student Outcomes Research

7. GWLA Libraries Impact on Student Learning Task Force Research Project started in 2014 Melissa Bowles-Terry Head of Educational Initiatives, UNLV Libraries Chair of Student Learning Outcomes Task Force Patty Iannuzzi, Dean of UNLV Libraries, Dean Liaison Joni Blake, Executive Director GWLA, GWLA Liaison 32 Task Force Members from 20 Participating Institutions Student Outcomes Research

8. GWLA Student Learning Research Project Roster of Participating Institutions & Representatives Student Outcomes Research GWLA Student Learning Taskforce

9. Timeline for Research Project Student Outcomes Research May 2014 - Task Force starts meeting every 2 weeks Research Design subgroup – prepare research design Grants subgroup – seek & prepare grant applications Fall 2014 – Institutions begin tracking Library Instruction activity, per the specifications of the Research Design Spring 2015 – each participating institution work with their Institutional Research office to make sure they can get student data, and submit IRB application for the study

10. GWLA Student Learning Taskforce Timeline for Research Project Student Outcomes Research Fall 2015 – Spring 2016 Merge Library Instruction Data w/ Institutional Data for all 20 participating institutions, data cleaning, analysis and report of first year results Leverage first year results to secure grant and continue research project as longitudinal study over the next 4-6 years Fall 2015 – Request Institutional Data, e.g. student grades & retention, per the specifications of the Research Design

11. Research Design Two-Tiered Approach Library Instruction Variables - (teaching methods)  Logs of instruction sessions  Librarian contribution to design  Methods and characteristics Institutional Variables - (student success)  Student Demographics  Courses, Credit Hours, Grades  GPA and Retention Student Outcomes Research GWLA Student Learning Taskforce

12. Library Instruction Variables Student Outcomes Research GWLA Student Learning Taskforce

13. Library Instruction Variables Student Outcomes Research GWLA Student Learning Taskforce

14. Library Instruction Variables 2 Student Outcomes Research GWLA Student Learning Taskforce

15. Library Instruction Variables 2 Student Outcomes Research GWLA Student Learning Taskforce

16. Student Outcomes Research GWLA Student Learning Taskforce Institutional Variables

17. Library Instruction: Course-Sections taught Teaching Method Used First Year, First Time Students Student Grades by Course-Section Student Retention after the first year All student & library data de-identified in order to obtain IRB approval Data Merged by Course-Section Student Outcomes Research GWLA Student Learning Taskforce

18. Sample Library Instruction Data Collection Form Student Outcomes Research GWLA Student Learning Taskforce

19. Sample Library Instruction Data Student Outcomes Research GWLA Student Learning Taskforce

20. Massive Dataset of all first year students across 20 institutions Planned Analysis  Stratified Control Samples  Instruction vs. No Instruction: Effect?  Instruction Methods: Effects? Likely analysis will consist of hierarchical model, taking into account groupings of similar institutions, similar student groups Student Outcomes Research GWLA Student Learning Taskforce

21. Control Group matched on key demographics: First Year Students With Instruction vs. No Instruction Student Outcomes Research GWLA Student Learning Taskforce Students with Library Instruction Students without Library Instruction

22. Effect of Specific Teaching Methods Student Outcomes Research GWLA Student Learning Taskforce Students with Instruction Method A Students with Instruction Method B Students with Instruction Method C

23. Primary Investigator has been named: Dr. Jade Winn Asst. Dean of Instruction, Assessment & Engagement University of Southern California IRB approval obtained at USC, UNLV, ASU GWLA member university deans & directors recently approved funding to hire data analyst Southern Methodist University will play a key role in data analysis and secure storage of data for all 20 participating institutions Student Outcomes Research GWLA Student Learning Task Force Research Project – progress made in 2015

24. Questions? Thank you! Student Outcomes Research GWLA Student Learning Taskforce