Presentation is loading. Please wait.

Presentation is loading. Please wait.

MINES for Libraries™ Presented by Martha Kyrillidou Director of the ARL Statistics and Service.

Published byGriffin Wade Modified over 8 years ago

Similar presentations

Presentation on theme: "MINES for Libraries™ Presented by Martha Kyrillidou Director of the ARL Statistics and Service."— Presentation transcript:

1 http://www.arl.org/stats http://www.minesforlibraries.org MINES for Libraries™ Presented by Martha Kyrillidou Director of the ARL Statistics and Service Quality Programs Association of Research Libraries at Rutgers University Library June 1 2007 New Brunswick, NJ www.arl.org/stats/

2 http://www.arl.org/stats http://www.minesforlibraries.org ARL Overall

3 http://www.arl.org/stats http://www.minesforlibraries.org Libraries Remain a Credible Resource in 21 st Century 98% agree with statement, “My … library contains information from credible and known sources.” Note. Digital Library Federation and Council on Library and Information Resources. (2002). Dimensions and Use of the Scholarly Information Environment.

4 http://www.arl.org/stats http://www.minesforlibraries.org Changing Behaviors Only 15.7% agreed with the statement “The Internet has not changed the way I use the library.” Note. Digital Library Federation and Council on Library and Information Resources. (2002). Dimensions and Use of the Scholarly Information Environment.

5 http://www.arl.org/stats http://www.minesforlibraries.org ARL Toolkit… StatsQUAL+™ –ARL Statistics –LibQUAL+® –E-Metrics –DigiQUAL+™ –MINES for Libraries™

6 http://www.arl.org/stats http://www.minesforlibraries.org What is MINES? Action research –Historically rooted in indirect cost studies –Set of recommendations for research design –Set of recommendations for web survey presentation –Set of recommendations for information architecture in libraries –Plan for continual assessment of networked electronic resources –An opportunity to benchmark across libraries

7 http://www.arl.org/stats http://www.minesforlibraries.org MINES for Libraries TM MINES is a transaction-based research methodology consisting of a web-based survey form and a random moments sampling plan MINES typically measures who is using electronic resources, where users are located at the time of use, and their purpose of use in the least obtrusive way MINES was adopted by the Association of Research Libraries (ARL) as part of the “New Measures” toolkit in May, 2003. MINES is different from other electronic resource usage measures that quantify total usage (e.g., Project COUNTER, E- Metrics) or measure how well a library makes electronic resources accessible (LibQUAL+™).

8 http://www.arl.org/stats http://www.minesforlibraries.org Questions Addressed By MINES for Libraries™ for the OCUL Scholars Portal How extensively do sponsored researchers use OCUL’s Scholars Portal? How much usage is for non-funded research, instruction/education, student research papers, and course work? Are researchers more likely to use the Scholars Portal from inside or outside the library? What about other classifications of users? Are there differences in Scholars Portal based on the user’s location (e.g., in the library; on-campus, but not in the library; or off-campus)? Could MINES, combined with usage counts, provide an infrastructure to make Scholars Portal usage studies routine, robust, and easily integrated into OCUL’s administrative decision-making process for assessing networked electronic resources?

9 http://www.arl.org/stats http://www.minesforlibraries.org MINES for Libraries TM Survey Form Five Questions and a Comment Box

10 http://www.arl.org/stats http://www.minesforlibraries.org Methodological considerations Experience with the MINES Survey Terry Plum Assistant Dean Simmons GSLIS Rutgers University June 1, 2007

11 http://www.arl.org/stats http://www.minesforlibraries.org Issues with web surveys Research design –Coverage error Unequal access to the Internet Internet users are different than non-users –Response rate Response representativeness –Random sampling and inference –Non-respondents Data security

12 http://www.arl.org/stats http://www.minesforlibraries.org MINES strategy A representative sampling plan, including sample size, is determined at the outset. Typically, there are 48 hours of surveying over 12 months at a medical library and 24 hours a year at a main library. Random moment/web-based surveys are employed at each site. Participation is usually mandatory, negating non- respondent bias, and is based on actual use in real-time. –IRB waiver or approval Libraries with database-to-web gateways or proxy re- writers offer a comprehensive networking solution for surveying all networked services users during survey periods.

13 http://www.arl.org/stats http://www.minesforlibraries.org MINES strategy Placement –Point of use –Not remembered, predicted or critical incident Usage rather than user –What about multiple usages –Time out ? –Cookie or other mechanism with auto-population or more recently counting invisibly with a time out. Distinguish patron association with libraries. –For example, medical library v. main library. –But what if the resources are purchased across campus for all. Then how to get patron affiliation?

14 http://www.arl.org/stats http://www.minesforlibraries.org Web Survey Design Guidelines Web survey design guidelines that MINES followed: –Presentation Simple text for different browsers – no graphics –Different browsers render web pages differently Few questions per screen or simply few questions Easy to navigate Short and plain No scrolling Clear and encouraging error or warning messages Every question answered in a similar way - consistent –Radio buttons, drop downs ADA compliant Introduction page or paragraph Easy to read –Must see definitions of sponsored research. Can present questions in response to answers – for example if sponsored research was chosen, could present another survey

15 http://www.arl.org/stats http://www.minesforlibraries.org Quality Checks Target population is the population frame – surveyed the patrons who were supposed to be surveyed - except in libraries with outstanding open digital collections. Check usage against IP. In this case, big numbers may not be good. May be seeing the survey too often. Alter order of questions and answers, particularly sponsored and instruction. Spot check IP against self-identified location Spot check undergraduates choosing sponsored research – measurement error Check self-identified grant information against actual grants Content validity – discussed with librarians and pre-tested. Turn-aways – number who elected not to fill out the survey Library information architecture -- Gateway v. HTML pages – there is a substantial difference in results.

16 http://www.arl.org/stats http://www.minesforlibraries.org

17 http://www.arl.org/stats http://www.minesforlibraries.org Documenting the Purpose and Use of Electronic Resources: Experience with the MINES Survey Brinley Franklin Vice Provost for University Libraries University of Connecticut Rutgers University June 1, 2007

18 http://www.arl.org/stats http://www.minesforlibraries.org “It is useless to tell the acquisitions librarian that half the monographs ordered will never be used, unless we can specify which 50% to avoid buying.” (Galvin and Kent, 1977)

19 http://www.arl.org/stats http://www.minesforlibraries.org Reliance on Vendor Statistics Vendor statistics, while more reliable than in the past, are still maturing.

20 http://www.arl.org/stats http://www.minesforlibraries.org Measuring Digital Content Use The most popular current method of measuring usage of electronic resources by libraries is not through web- based usage surveys, but through vendor supplied data of library patron usage or transaction usage. Web-based usage surveys are increasingly relevant in the collection of usage data to make collection development and service decisions, to document evidence of usage by certain patron populations, and to collect and analyze performance outputs. Brinley Franklin and Terry Plum, “Successful Web Survey Methodologies for Measuring the Impact of Networked Electronic Services (MINES for Libraries TM )” IFLA Journal 32 (1) March, 2006

21 http://www.arl.org/stats http://www.minesforlibraries.org A web-based transactional survey that collects data on users’ demographics and their purpose of use. It is administered in real time over the course of at least a year using a random moments sampling plan. MINES for Libraries TM has been administered at 40 North American universities in the last four years. More than 100,000 North American networked services users have been surveyed using a standard protocol.

22 http://www.arl.org/stats http://www.minesforlibraries.org

23 http://www.arl.org/stats http://www.minesforlibraries.org Library User Survey Patron Status

24 http://www.arl.org/stats http://www.minesforlibraries.org Library User Survey Affiliation

25 http://www.arl.org/stats http://www.minesforlibraries.org Library User Survey Location

26 http://www.arl.org/stats http://www.minesforlibraries.org Library User Survey Purpose

27 http://www.arl.org/stats http://www.minesforlibraries.org Sample Survey Data File Generated Other UConnInstruction/Education/Departmental (Non-Funded) Researchhttp://newfirstsearch.oclc.org/done=referer;dbname=WorldCat;autho=100122319;FSIP12:36:5012/3/2004Off CampusUConn Faculty12.101.104.84 Family StudiesInstruction/Education/Departmental (Non-Funded) Researchhttp://www.jstor.org/cgi-bin/jstor/gensearch12:37:4312/3/2004Off CampusUConn Undergraduate Student12.101.104.84Non-UConnOther Activitieshttp://homerweb.lib.uconn.edu/cgi- bin/Pwebrecon.cgi?DB=local&PAGE=First13:08:4112/3/2004Off CampusNon-UConn12.18.36.40 Non-UConnInstruction/Education/Departmental (Non-Funded) Researchhttp://magic.lib.uconn.edu/index_real.html13:31:2912/3/2004Off CampusNon-UConn12.76.131.246 Non-UConnOther Activitieshttp://magic.lib.uconn.edu/index_real.html12:11:0612/3/2004Off CampusNon-UConn130.132.86.156Agriculture & Natural ResourcesInstruction/Education/Departmental (Non-Funded) Researchhttp://magic.lib.uconn.edu/index_real.html12:33:5712/3/2004 Off CampusNon-UConn131.128.89.54EducationInstruction/Education/Departmental (Non-Funded) Researchhttp://www.euromonitor.com/womdas/12:57:4412/3/2004 Off CampusNon-UConn134.241.135.70Non-UConnInstruction/Education/Departmental (Non-Funded) Researchhttp://homerweb.lib.uconn.edu/cgi-bin/Pwebrecon.cgi?DB=local&PAGE=First13:28:5212/3/2004 Off CampusNon-UConn134.74.42.82Business AdministrationOther Activitieshttp://homerweb.lib.uconn.edu/cgi- bin/Pwebrecon.cgi?DB=local&PAGE=First12:56:4612/3/2004In the LibraryUConn Faculty137.99.1.122 Liberal Arts & SciencesOther Activitieshttp://www.siam.org/journals/simax/simax.htm12:52:1712/3/2004On Campus - StorrsUConn Graduate Student137.99.1.122 EngineeringInstruction/Education/Departmental (Non-Funded) Researchhttp://homerweb.lib.uconn.edu/cgi- bin/Pwebrecon.cgi?DB=local&PAGE=First12:04:3112/3/2004On Campus - StorrsUConn Graduate Student137.99.1.219 Business AdministrationInstruction/Education/Departmental (Non-Funded) Researchhttp://proquest.umi.com/pqdweb?RQT=31812:16:3312/3/2004On Campus - StorrsUConn Graduate Student137.99.100.105 Business AdministrationInstruction/Education/Departmental (Non-Funded) Researchhttp://www.jstor.org/journals/07322399.html12:16:5212/3/2004On Campus - StorrsUConn Graduate Student137.99.100.105 Business AdministrationInstruction/Education/Departmental (Non-Funded) Researchhttp://homerweb.lib.uconn.edu/cgi- bin/Pwebrecon.cgi?DB=local&PAGE=First12:29:5312/3/2004On Campus - StorrsUConn Graduate Student137.99.100.175 Business AdministrationInstruction/Education/Departmental (Non-Funded) Researchhttp://homerweb.lib.uconn.edu/cgi- bin/Pwebrecon.cgi?DB=local&PAGE=First12:48:4112/3/2004On Campus - StorrsUConn Graduate Student137.99.100.175 Business AdministrationInstruction/Education/Departmental (Non-Funded) Researchhttp://proquest.umi.com/login?COPT=SU5UPTAmVkVSPTImREJTPTE3MjErMysxNkJD&clientId=4899612:04:2312/3/2004On Campus - StorrsUConn Graduate Student137.99.100.175

28 http://www.arl.org/stats http://www.minesforlibraries.org Demographics by Location of User U.S. Main Libraries On Campus, Not in the Library n = 6,391 Inside the Library n = 9,172 Off-Campus n = 4,953 MINES for Libraries™

29 http://www.arl.org/stats http://www.minesforlibraries.org Off-Campus n = 9,163 Demographics by Location of User Ontario Council of University Libraries Inside the Library n = 4,047 On Campus, Not in the Library n = 7,090

30 http://www.arl.org/stats http://www.minesforlibraries.org Purpose of Use Are users engaged in coursework, funded (or unfunded) research, public service, patient care, or other activities?

31 http://www.arl.org/stats http://www.minesforlibraries.org Purpose of Use By Location U.S. Main Campus Libraries 2003 – 2005 *72% of sponsored research usage of electronic resources occurred outside the library; 83% took place on campus. On-Campus, Not in the Library n = 9,460 In the Library n = 9,733 Off-Campus n = 7,790 Overall Use n = 26,983 66 %

32 http://www.arl.org/stats http://www.minesforlibraries.org OCUL Scholars Portal Users Purpose of Use In a sample of 20,300 electronic resources uses at OCUL libraries, there were four uses outside the library for each use in the library.

33 http://www.arl.org/stats http://www.minesforlibraries.org Questions? Learn more about LibQUAL +TM, DigiQUAL TM, & MINES for Libraries TM at: www.statsqual.org

34 http://www.arl.org/stats http://www.minesforlibraries.org Analysis Web deliverables: –Crosstabulations in html for all OCUL data –Interactive crosstabs for all OCUL and institutions Print deliverables: –summary tables for OCUL –summary tables for each institution –Final report

35 http://www.arl.org/stats http://www.minesforlibraries.org

36 http://www.arl.org/stats http://www.minesforlibraries.org OCUL Scholars Portal Usage Affiliation

37 http://www.arl.org/stats http://www.minesforlibraries.org

38 http://www.arl.org/stats http://www.minesforlibraries.org

39 http://www.arl.org/stats http://www.minesforlibraries.org

40 http://www.arl.org/stats http://www.minesforlibraries.org Affiliation by Purpose of Use Purpose of Use AffiliationCoursework Other Activities Other Research Patient CareSponsoredTeachingTotal Applied Sciences24.0%7.6%17.7%0.6%46.3%3.7%100.0% Business34.8%7.6%30.0%0.9%10.8%16.0%100.0% Education40.9%5.4%17.1%0.8%11.8%24.0%100.0% Environmental Studies43.5%2.5%24.0%0.3%23.3%6.3%100.0% Fine Arts56.3%6.9%20.6%1.3%5.6%9.4%100.0% Humanities51.5%10.8%21.0%0.5%9.5%6.7%100.0% Law67.5%6.8%12.8%0.9%2.6%9.4%100.0% Medical Health29.7%5.5%18.4%8.6%32.0%5.7%100.0% Other51.9%22.8%10.9%2.1%7.4%5.0%100.0% Sciences44.6%9.7%11.1%0.4%31.8%2.4%100.0% Social Sciences62.6%4.5%14.4%0.7%13.6%4.2%100.0% Total42.0%7.5%16.2%2.4%26.2%5.6%100.0%

41 http://www.arl.org/stats http://www.minesforlibraries.org User Status by Purpose of Use Purpose of Use User StatusCoursework Other Activities Other Research Patient CareSponsoredTeachingTotal Faculty1.5%4.7%21.2%4.4%42.6%25.6%100.0% Graduate Professional19.5%3.9%25.5%2.5%45.4%3.2%100.0% Library Staff23.5%24.1%13.1%16.5%17.7%5.2%100.0% Other6.0%35.2%20.8%8.7%26.8%2.5%100.0% Staff3.5%9.5%20.6%2.1%51.6%12.7%100.0% Undergraduate75.8%7.8%7.7%0.9%5.9%1.9%100.0% Total42.0%7.5%16.2%2.4%26.2%5.6%100.0%

42 http://www.arl.org/stats http://www.minesforlibraries.org Location by Purpose of Use Purpose of Use LocationCoursework Other Activities Other Research Patient CareSponsoredTeachingTotal Library52.8%14.9%10.8%1.2%12.3%7.9%100.0% Off-campus47.2%7.0%17.3%4.1%19.9%4.6%100.0% On-campus29.2%4.0%17.9%0.9%42.2%5.7%100.0% Total42.0%7.5%16.2%2.4%26.2%5.6%100.0%

43 http://www.arl.org/stats http://www.minesforlibraries.org Reason for Use Reason for Use (n=20293)FrequencyReason for Use (n=20293)Percent Important Journal10219Important Journal50.4% Recommended Colleague2436Recommended Colleague12.0% Reference/Citation6090Reference/Citation30.0% Recommended Librarian620Recommended Librarian3.1% Course Reading925Course Reading4.6% Other4388Other21.6%

44 http://www.arl.org/stats http://www.minesforlibraries.org

45 http://www.arl.org/stats http://www.minesforlibraries.org

46 http://www.arl.org/stats http://www.minesforlibraries.org

47 http://www.arl.org/stats http://www.minesforlibraries.org Library Assessment Conference August 4-6, 2008 Seattle, WA, USA

Download ppt "MINES for Libraries™ Presented by Martha Kyrillidou Director of the ARL Statistics and Service."

Similar presentations

Usage statistics in context - panel discussion on understanding usage, measuring success Peter Shepherd Project Director COUNTER AAP/PSP 9 February 2005.

Usage statistics in context - panel discussion on understanding usage, measuring success Peter Shepherd Project Director COUNTER AAP/PSP 9 February 2005.
Under New Management : Developing a Library Assessment Program at a Small Public University Library Assessment Conference: Building Effective, Sustainable,

Under New Management : Developing a Library Assessment Program at a Small Public University Library Assessment Conference: Building Effective, Sustainable,
Marketing Library Poster Services via a USB Flash Drive Catherine Soehner, Associate Dean for Research and Learning Services, J. Willard Marriott Library,

Marketing Library Poster Services via a USB Flash Drive Catherine Soehner, Associate Dean for Research and Learning Services, J. Willard Marriott Library,
Measuring the Impact of Networked Electronic Resources: Developing an Assessment Infrastructure for Libraries, State, and Other Types of Consortia Presented.

Measuring the Impact of Networked Electronic Resources: Developing an Assessment Infrastructure for Libraries, State, and Other Types of Consortia Presented.
CMU has been said to be the “most wired campus in the US” for two years in a row. What kind of impact does such a infrastructure has on the daily academic.

CMU has been said to be the “most wired campus in the US” for two years in a row. What kind of impact does such a infrastructure has on the daily academic.
The COUNTER Code of Practice for Books and Reference Works Peter Shepherd Project Director COUNTER UKSG E-Books Seminar, 9 November 2005.

The COUNTER Code of Practice for Books and Reference Works Peter Shepherd Project Director COUNTER UKSG E-Books Seminar, 9 November 2005.
Brinley Franklin Vice Provost, University of Connecticut Libraries MINES for Libraries Measuring the Impact of Networked Electronic Services (MINES): The.

Brinley Franklin Vice Provost, University of Connecticut Libraries MINES for Libraries Measuring the Impact of Networked Electronic Services (MINES): The.
Learning Community II Survey Spring 2007 Analysis by Intisar Hibschweiler (Core Director) and Mimi Steadman (Director of Institutional Assessment)

Learning Community II Survey Spring 2007 Analysis by Intisar Hibschweiler (Core Director) and Mimi Steadman (Director of Institutional Assessment)
Ontario University Library Consortia Activity Ontario University Library Consortia Activity Gwendolyn Ebbett Dean of the Library University of Windsor.

Ontario University Library Consortia Activity Ontario University Library Consortia Activity Gwendolyn Ebbett Dean of the Library University of Windsor.
Www.digiqual.org DigiQUAL™ Regrounding LibQUAL+® for the Digital Library Environment: An Analysis of the DigiQUAL® Data Presented at 9 th Northumbria by.

DigiQUAL™ Regrounding LibQUAL+® for the Digital Library Environment: An Analysis of the DigiQUAL® Data Presented at 9 th Northumbria by.
How Assessment Will Inform Our Future 1. Administration of on-going user surveys and focus groups to enhance reference services 2. Analysis of LibStats.

How Assessment Will Inform Our Future 1. Administration of on-going user surveys and focus groups to enhance reference services 2. Analysis of LibStats.
What do they think of us? Rutgers University Libraries Brand Assessment Study VALE Assessment Fair 2014 Rose Barbalace Christine.

What do they think of us? Rutgers University Libraries Brand Assessment Study VALE Assessment Fair 2014 Rose Barbalace Christine.
Copyright Shanna Smith & Tom Bohman (2003). This work is the intellectual property of the authors. Permission is granted for this material to be shared.

Copyright Shanna Smith & Tom Bohman (2003). This work is the intellectual property of the authors. Permission is granted for this material to be shared.
Presented by Beverly Choltco-Devlin Reference and Electronic Resources Consultant Mid-York Library System September 25, 2009 REVVED UP FOR REFERENCE CONFERENCE.

Presented by Beverly Choltco-Devlin Reference and Electronic Resources Consultant Mid-York Library System September 25, 2009 REVVED UP FOR REFERENCE CONFERENCE.
LibQUAL+ Process Overview Introduction to LibQUAL+ Workshop University of Westminster, London 21st January 2008 Selena Killick Association of Research.

LibQUAL+ Process Overview Introduction to LibQUAL+ Workshop University of Westminster, London 21st January 2008 Selena Killick Association of Research.
Health Center Library Overview Evelyn Morgen, Director March 2007.

Health Center Library Overview Evelyn Morgen, Director March 2007.
Academic Research Library Support of Sponsored Research in the United States Brinley Franklin Vice Provost University of Connecticut Libraries Qualitative.

Academic Research Library Support of Sponsored Research in the United States Brinley Franklin Vice Provost University of Connecticut Libraries Qualitative.
Measuring the Impact of Networked Electronic Services: Developing Assessment Infrastructure for Libraries, State, and Other Types of Consortia Presented.

Measuring the Impact of Networked Electronic Services: Developing Assessment Infrastructure for Libraries, State, and Other Types of Consortia Presented.
Reaffirmation of Accreditation: Institutional Effectiveness Southern Association of Colleges and Schools February 2008 Stephen F. Austin State University.

Reaffirmation of Accreditation: Institutional Effectiveness Southern Association of Colleges and Schools February 2008 Stephen F. Austin State University.
E-book Resources for HINARI Users (Advanced Course Module 7)

E-book Resources for HINARI Users (Advanced Course Module 7)

Similar presentations

Ads by Google