Presentation is loading. Please wait.

Presentation is loading. Please wait.

Reducing digestible tidbits from meaty stock: Satisfying varied tastes with an attractive instructional assessment menu Erika Bennett, Jennie Simning,

Similar presentations


Presentation on theme: "Reducing digestible tidbits from meaty stock: Satisfying varied tastes with an attractive instructional assessment menu Erika Bennett, Jennie Simning,"— Presentation transcript:

1 Reducing digestible tidbits from meaty stock: Satisfying varied tastes with an attractive instructional assessment menu Erika Bennett, Jennie Simning, & Kim Staley Capella University Library LOEX 2011

2 How are you turning your data into persuasion? 1) The Hoarder

3 How are you turning your data into persuasion? 2) The Philosopher

4 Meanwhile we have hungry people waiting...

5 How are you turning your data into persuasion? 3) Data informs your Actions You pose questions that data can answer You gather You analyze statistically You propose actions You carry out and test the actions Everybody knows what important measures you collect and why.

6 So this session is for you if… You collect streams of data that never see the light of day. There is data you wish you had quickly at hand. You struggle reconciling decision-makers’ demands with instructional best practices.

7 Objectives 1.Prepping the Menu: Who is our audience and what are trying to give them? 2.Equipment: Why scorecards and dashboards? 3.From the Pantry: What do we have already? 4.Preparing the meal: Gathering measures & metrics and creating scorecards and dashboards. 5.Plating and Garnish: Using technology for attractive dashboard displays & infographics.

8 About Us Capella is a regionally accredited online university 39,900+ students Avg. age is 39 Instruction Librarian Team In-house library, 2007

9

10 Business Education

11 Prepping Our Menu

12 The Big Trends In IL assessment – Moving toward larger scale value assessments In business assessment – Balanced assessments of business performance Significant parallels!

13 Similar development cycles IL Assessment (ILIAC) 1.Review learning goals 2.Identify learning outcomes 3.Create learning activities 4.Enact learning activities 5.Gather data 6.Interpret & analyze data 7.Communicate data, enact decisions, & seek improvement Balanced Scorecards 1.Identify perspectives & strategic themes 2.Identify objectives & causal links 3.Create metrics & measures 4.Develop targets & goals 5.Gather data 6.Interpret & analyze data 7.Communicate data, enact decisions, & seek improvement

14 Equipment

15 Assessment Tools Scorecards Dashboards Often confused…

16 Scorecards

17 What are Scorecards? -Tool for managing performance -Report card on the organization’s performance. -Key objectives -Measures & Metrics -Goals or targets

18 Scorecard example From Dagan, 2007

19 Scorecard example best-practices/request-fulfillment-management.html

20 Scorecard example

21 Dashboards

22 What are Dashboards? -Tool for monitoring performance -Summarize scorecard data -Snap-shot view of most important metrics. -Often graphical, like gauges on the dashboard of your car.

23 Dashboard example

24

25 Beyond the Stereotype Proactive tools Flexible tools

26 From the Pantry

27

28

29 Shared Responsibility Narrow “Old world” Library Instruction 1.Focusing a Topic 2.Sources: Background 3.Searching the Catalog 4.Search Terms 5.Searching Periodicals 6.ID-ing Reference Sources 7.Citation & References 8.Library Classification 9.Etc.

30 Shared Responsibility Contemporary IL Instruction 1.Determine Info Need 2.Research Methods 3.Scholarly Communications 4.Information Technology 5.Evaluating Info Sources 6.ID-ing Reference Sources 7.Economic, political, legal and cultural contexts 8.Evaluating info content 9.Etc.

31 Our Data Network

32 Strategy Alignment

33 Strategy Map A clear illustration of long-term strategy

34 Strategy Map A clear illustration of long-term strategy

35 Strategy Mapping

36 Classic Perspectives: 1.Customer 2.Financial 3.Internal Processes 4.Learning & Growth Strategy Mapping

37 Our Perspectives : 1.Learner 2.Financial 3.Internal Processes 4.Learning & Growth Strategy Mapping

38 Our Perspectives: 1.Learner 2.National Standards 3.Internal Processes 4.Learning & Growth Strategy Mapping

39 Our Perspectives: 1.Learner 2.National Standards 3.Internal Processes 4.Learning & Growth Strategy Mapping

40 Our Perspectives: 1.Learner 2.National Standards 3.Internal Stakeholders 4.Learning & Growth Our Strategy Map

41 Learner National Internal Growth Perspectives

42 Our Strategy Map Learner National Internal Growth Strategic Themes

43 Memorable and motivational names of 3-5 words. Defensible with good execution.

44 Our Strategy Map Learner National Internal Growth Lifelong Learning Program Integration Great Teaching Assessment as Learning

45 Strategic Themes Perspectives Initiatives

46

47 WE

48 Preparing the Meal: Scorecards & Metrics

49 Instruction Strategic Scorecard Key Performance Indicators (KPIs) Targets and Benchmarks SWAG approach

50 From: Academic Scorecard Example

51 Metric Review Questions What action will I take if I see significant change in this metric?  flatlines and spikes Will that action control the process in the way needed? Will measuring this metric change the behavior and action (learning) as I want?

52 Raw Data

53 Dealing with the Raw Data Our Solution: Operational Scorecards with Dashboard components

54 Ramekins of Data Built a relevant 2011 sheet for each category/ venue: – Webinars – Self-directed Tutorials – LibGuides – First Course Experience – Collaboratives – Residencies

55

56

57

58 Plating & Garnish

59 Executive Dashboards – Revisit definition/tips/sam ples?

60 Dashboard example

61

62 Analytical Add-ons Bissant SparkMaker BonaVista Microcharts

63 Columns Minipies Bullet Graphs Add-ons

64 Sparklines Scatter Plots Whiskers Add-ons

65 What if, for YOU… EXCEL EXCELLENCE

66 Plating & Garnish New Technologies – Cloud/Freeware options Bittle: Reporting and dashboards Bittle Style Scope free edition: Dashboards Style Scope free edition Active Dashboard: Dashboards Active Dashboard – Infographics for specific situations Creately: Diagrams and collaboration Creately Stat Planet: Interactive maps and graphs Stat Planet Tufte’s VUE: Visual Understanding Environment Tufte’s VUE

67 content/uploads/2011/04/staggering_education_infographic1.jpg

68 Wrap Up/Q&A

69 Bibliography from Handout Balanced Scorecards for Libraries & Higher Education: Matthews, J. R. (2008). Scorecards for results: A guide for developing a library balanced scorecard. Westport, Conn: Libraries Unlimited. Lyddon, J., & McComb, B. (2008). Strategic reporting tool: Balanced scorecards in higher education. Journal of Applied Research in the Community College, 15(2), 163. Retrieved from Bielavitz, T. (2010). The balanced scorecard: A systemic model for evaluation and assessment of learning outcomes? Evidence Based Library & Information Practice, 5(2), Retrieved from Lyddon, J., & McComb, B. (2008). Strategic reporting tool: Balanced scorecards in higher education. Journal of Applied Research in the Community College, 15(2), 163. Retrieved from

70 Bibliography from Handout Scorecards and Dashboards: Person, R. (2009). Balanced scorecards and operational dashboards with Microsoft Excel. Indianapolis, IN: Wiley. Dagan, B. (2007). Dashboards and scorecards aid in performance management and monitoring. Natural Gas & Electricity, 24(2), Retrieved from Hursman, A. (2010). Diagnosis: Dashboredom. Information Management, 20(6), Retrieved from Schiff, C. (2008). Three things you should know about dashboards. DM Review, 18(6), Retrieved from Butler, L. M. (2007). Warning lights. Connection: The Journal of the New England Board of Higher Education, 21(5), 31. Retrieved from

71 Bibliography from Handout Information Literacy Assessment: Gilchrist, D., & Zald, A. (2008). Instruction & program design through assessment. In C. N. Cox, & E. B. Lindsay (Eds.), Information Literacy Instruction Handbook (pp ). Chicago: Association of College and Research Libraries. Oakleaf, M. (2009). The information literacy instruction assessment cycle: A guide for increasing student learning and improving librarian instructional skills. Journal of Documentation, 65(4), doi: / doi: / Oakleaf, M. (2011). Are they learning? Are we? Learning outcomes and the academic library. Library Quarterly, 81(1), Retrieved from Oakleaf, M., & Kaske, N. (2009). Guiding questions for assessing information literacy in higher education. Portal: Libraries and the Academy, 9(2), Retrieved from doi: /pla Poll, R., & Payne, P. (2006). Impact measures for libraries and information services. Library Hi Tech, 24(4), doi: / Oakleaf, M. (2009). Writing Information Literacy Assessment Plans: A guide to best practice. Communications in Information Literacy, 3(2), Retrieved from Orcutt, D. (Ed.). (2010). Library data: Empowering practice and persuasion. Santa Barbara, CA: Libraries Unlimited. Thompson, G. B. (2002). Information literacy accreditation mandates: What they mean for faculty and librarians. Library Trends, 51(2), 218. Retrieved from

72 Bibliography from Handout Free Infographic creation software: Infographic software links compiled by Melodie Brewer: Creately: Tableau: Hohli: Stat Planet: Visual Understanding Environment (VUE): Free statistical software: List of links: Many Eyes: 958.ibm.com/software/data/cognos/manyeyes/http://www- 958.ibm.com/software/data/cognos/manyeyes/

73 Additional Capella program-focused Pubs & Presentations Staley, K., Brothen, E. & Bennett, E. ACRL Virtual – 2011; “When Nontraditional is the Norm: Shifting the Instruction Paradigm for Adult Students.” Link 1 & Link 2.Link 1 Link 2 Bennett, E. & Brothen, E (2010). Citation Analyses as a Prioritization Tool for Instruction Program Development. Journal of Library Administration. 50(5/6).Journal of Library Administration. Bennett, E., & Simning, J. (2010). Embedded Librarians and Reference Traffic: A Quantitative Analysis. Journal of Library Administration. 50(5/6). Sollien, J., Pohlman, J. & Waitz, E. ACRL 2009 “Challenges for Distance Students and Distance Librarians: Taking Advantage of the Online Environment” Link 2.ACRL 2009 Link 2 ARLD Day 2009 “Reference Data in Action: Explore the Possibilities.” ARLD Day 2009 Brothen, E., Berg, S., & Bennett, E. (2009). Maximizing the value of reference data: A case study. In D. Orcutt (Ed.), Library data: Empowering practice and persuasion (Chapter 11). Santa Barbara, CA: Libraries Unlimited. Veal, R., & Bennett, E. (2009). The virtual library liaison: A case study at an online university. Journal of Library Administration, 49(1/2), Bennett, E. (July 2008). eLearning: Libraries increasingly help steer the ship. Elsevier’s Library’s Connect Newsletter: v6(3).eLearning: Libraries increasingly help steer the ship. Elsevier’s Library’s Connect Newsletter


Download ppt "Reducing digestible tidbits from meaty stock: Satisfying varied tastes with an attractive instructional assessment menu Erika Bennett, Jennie Simning,"

Similar presentations


Ads by Google