counts? What Assessing the Value of Non-Text Resources Stephanie Krueger, Associate Director of Library Relations, ARTstor Tammy S. Sugarman Associate University Librarian, Georgia State University Santiago Calatrava Milwaukee Museum of Art Quadracci Pavilion; detail of central atrium space with lake visible through windows completed 2001 700 N. Museum Drive, Milwaukee, WI 117,000 sq. ft. City, August 1, 2006 | Title | 1

Agenda Non-text multimedia usage at Georgia State Resource provider perspectives: COUNTER & Example of ARTstor Proposals for a way forward Chicago: City Reference: proposed development of the City Center Chicago (Ill.) Architecture:Site--United States: Illinois--A.D Reference cities harbors City, August 1, 2006 | Title | 2

The GSU Perspective Collect Interpret/Analyze Apply Santiago Calatrava Milwaukee Museum of Art Quadracci Pavilion; detail of central atrium space with lake visible through windows completed 2001 700 N. Museum Drive, Milwaukee, WI 117,000 sq. ft. City, August 1, 2006 | Title | 3

The GSU Perspective Due date stamp; Reshelving hashmarks Circulation data from OPAC E-journal statistics requests E-journal statistics downloaded COUNTER: journals, ebooks Non-text resources? In IRs, image databases, audio databases Single-point-access valuable, however, interesting to note that institutions are still delivering content to users in multiple systems. We’ll cover this in a bit more detail later on. ARTstor usage significantly higher for those with hosted collections. When ARTstor use increases, collection administrators can focus on creating more specialized content that is complimentary to what exists in ARTstor. Robust end user tools for making active use of images is important, and we’ve heard from many that one of the reasons they like hosting is because ARTstor’s feature set is simple yet comprehensive enough for use in teaching Integration important: Advance search, sorting, browsing Ability to customize for local content also important: Image download size, Terms and conditions click-through Remote hosting valuable: No additional software to install, configure or maintain

Why? Maximize limited resources Higher ed climate of accountability User education, marketing Single-point-access valuable, however, interesting to note that institutions are still delivering content to users in multiple systems. We’ll cover this in a bit more detail later on. ARTstor usage significantly higher for those with hosted collections. When ARTstor use increases, collection administrators can focus on creating more specialized content that is complimentary to what exists in ARTstor. Robust end user tools for making active use of images is important, and we’ve heard from many that one of the reasons they like hosting is because ARTstor’s feature set is simple yet comprehensive enough for use in teaching Integration important: Advance search, sorting, browsing Ability to customize for local content also important: Image download size, Terms and conditions click-through Remote hosting valuable: No additional software to install, configure or maintain

The challenges of adhering to COUNTER reports The missing metric Different terminology New types of use Measuring use beyond the measurable environment Chicago: City Reference: proposed development of the City Center Chicago (Ill.) Architecture:Site--United States: Illinois--A.D Reference cities harbors City, August 1, 2006 | Title | 6

Required COUNTER reports for Release 3 of COUNTER code of practice for Journals and Databases Journal Report 1: Number of Successful Full-Text Article Requests by Month and Journal Journal Report 2: Turnaways by Month and Journal Journal Report 5: Number of Full Text Article Requests by Year and Journal Database Report 1: Total Searches and Sessions by Month and Database Database Report 2: Turnaways by Month and Database We collection administrators need more efficient means of updating their collection to truly meet faculty needs, however, the enormous variability that exists at the local level in several key areas impacts our ability to build tools that are broadly useful. Source systems: cataloging Metadata: schemas, flat/relational, cataloging practices (controlled values), character sets Collection growth rate: volume of images to be added or changes to be made Local infrastructure: bandwidth, availability of hardware, software, degree of tech-savvy or access to technical resources, number of people involved in the process (some have 1-person operations, others have distributed teams consisting of multiple people working on different tasks such as scanning, cataloging, loading into software) We’re going to explore these challenges further with respect to tools development, so let’s take a closer look at the data we’ve gathered in these areas.

Non-Text Resources do not have Full-Text Articles (or Journals!) Journal Report 1: Number of Successful Full-Text Article Requests by Month and Journal Journal Report 2: Turnaways by Month and Journal Journal Report 5: Number of Full Text Article Requests by Year and Journal Database Report 1: Total Searches and Sessions by Month and Database Database Report 2: Turnaways by Month and Database We collection administrators need more efficient means of updating their collection to truly meet faculty needs, however, the enormous variability that exists at the local level in several key areas impacts our ability to build tools that are broadly useful. Source systems: cataloging Metadata: schemas, flat/relational, cataloging practices (controlled values), character sets Collection growth rate: volume of images to be added or changes to be made Local infrastructure: bandwidth, availability of hardware, software, degree of tech-savvy or access to technical resources, number of people involved in the process (some have 1-person operations, others have distributed teams consisting of multiple people working on different tasks such as scanning, cataloging, loading into software) We’re going to explore these challenges further with respect to tools development, so let’s take a closer look at the data we’ve gathered in these areas.

The only COUNTER-compliant type of use for non-text resources: Search Database Report 1: Total Searches and Session by Month and Database We collection administrators need more efficient means of updating their collection to truly meet faculty needs, however, the enormous variability that exists at the local level in several key areas impacts our ability to build tools that are broadly useful. Source systems: cataloging Metadata: schemas, flat/relational, cataloging practices (controlled values), character sets Collection growth rate: volume of images to be added or changes to be made Local infrastructure: bandwidth, availability of hardware, software, degree of tech-savvy or access to technical resources, number of people involved in the process (some have 1-person operations, others have distributed teams consisting of multiple people working on different tasks such as scanning, cataloging, loading into software) We’re going to explore these challenges further with respect to tools development, so let’s take a closer look at the data we’ve gathered in these areas.

…but the majority of ARTstor’s use comes from Image Requests, not Search We collection administrators need more efficient means of updating their collection to truly meet faculty needs, however, the enormous variability that exists at the local level in several key areas impacts our ability to build tools that are broadly useful. Source systems: cataloging Metadata: schemas, flat/relational, cataloging practices (controlled values), character sets Collection growth rate: volume of images to be added or changes to be made Local infrastructure: bandwidth, availability of hardware, software, degree of tech-savvy or access to technical resources, number of people involved in the process (some have 1-person operations, others have distributed teams consisting of multiple people working on different tasks such as scanning, cataloging, loading into software) We’re going to explore these challenges further with respect to tools development, so let’s take a closer look at the data we’ve gathered in these areas.

The Missing Metric: Non-Text Full-Content Unit Request For non-text media Images, Audio, Video Full-Content Unit Non-Text Equivalent of Full Text Article Request View, Download, Print, E-Mail…and Stream? Jefferson, Thomas, 1743-1826. Hopkins, Alden. University of Virginia. Garden behind Pavilion V 1898. Charlottesville, Virginia. City, August 1, 2006 | Title | 11

Different Terminology What about Optional Journal Report 3? We collection administrators need more efficient means of updating their collection to truly meet faculty needs, however, the enormous variability that exists at the local level in several key areas impacts our ability to build tools that are broadly useful. Source systems: cataloging Metadata: schemas, flat/relational, cataloging practices (controlled values), character sets Collection growth rate: volume of images to be added or changes to be made Local infrastructure: bandwidth, availability of hardware, software, degree of tech-savvy or access to technical resources, number of people involved in the process (some have 1-person operations, others have distributed teams consisting of multiple people working on different tasks such as scanning, cataloging, loading into software) We’re going to explore these challenges further with respect to tools development, so let’s take a closer look at the data we’ve gathered in these areas.

Issues with Journal Report 3 It’s optional Organized by Journal and Publisher Requires ISSN numbers “Page Type”? Definition of non-textual resource: “Non-textual material that is published in an online journal, book, or other publication that is associated with a full text article, encyclopedia entry or other textual material” We collection administrators need more efficient means of updating their collection to truly meet faculty needs, however, the enormous variability that exists at the local level in several key areas impacts our ability to build tools that are broadly useful. Source systems: cataloging Metadata: schemas, flat/relational, cataloging practices (controlled values), character sets Collection growth rate: volume of images to be added or changes to be made Local infrastructure: bandwidth, availability of hardware, software, degree of tech-savvy or access to technical resources, number of people involved in the process (some have 1-person operations, others have distributed teams consisting of multiple people working on different tasks such as scanning, cataloging, loading into software) We’re going to explore these challenges further with respect to tools development, so let’s take a closer look at the data we’ve gathered in these areas.

The Bottom Line The e-journal, text- based world uses different metrics and terminology and has different frameworks that need to be modified for fully non-text resources Jefferson, Thomas, 1743-1826. Hopkins, Alden. University of Virginia. Garden behind Pavilion V 1898. Charlottesville, Virginia. City, August 1, 2006 | Title | 14

Measuring new types of use We collection administrators need more efficient means of updating their collection to truly meet faculty needs, however, the enormous variability that exists at the local level in several key areas impacts our ability to build tools that are broadly useful. Source systems: cataloging Metadata: schemas, flat/relational, cataloging practices (controlled values), character sets Collection growth rate: volume of images to be added or changes to be made Local infrastructure: bandwidth, availability of hardware, software, degree of tech-savvy or access to technical resources, number of people involved in the process (some have 1-person operations, others have distributed teams consisting of multiple people working on different tasks such as scanning, cataloging, loading into software) We’re going to explore these challenges further with respect to tools development, so let’s take a closer look at the data we’ve gathered in these areas.

Rich online environments support new types of use We collection administrators need more efficient means of updating their collection to truly meet faculty needs, however, the enormous variability that exists at the local level in several key areas impacts our ability to build tools that are broadly useful. Source systems: cataloging Metadata: schemas, flat/relational, cataloging practices (controlled values), character sets Collection growth rate: volume of images to be added or changes to be made Local infrastructure: bandwidth, availability of hardware, software, degree of tech-savvy or access to technical resources, number of people involved in the process (some have 1-person operations, others have distributed teams consisting of multiple people working on different tasks such as scanning, cataloging, loading into software) We’re going to explore these challenges further with respect to tools development, so let’s take a closer look at the data we’ve gathered in these areas.

Measuring Use beyond the measurable environment 82% of faculty use ARTstor for instruction in the classroom 72% use PowerPoint to display images during lectures Jefferson, Thomas, 1743-1826. Hopkins, Alden. University of Virginia. Garden behind Pavilion V 1898. Charlottesville, Virginia. City, August 1, 2006 | Title | 17

Case Study in Faculty Use: Which activities are tracked Activity Tracked in ARTstor usage? 1. Search, view and download images Yes 2. Arrange images in PowerPoint presentation No 3. Give lecture using PowerPoint presentation 4. Load PowerPoint presentation to Blackboard for student study 5. Use the same PowerPoint lecture the following semester We collection administrators need more efficient means of updating their collection to truly meet faculty needs, however, the enormous variability that exists at the local level in several key areas impacts our ability to build tools that are broadly useful. Source systems: cataloging Metadata: schemas, flat/relational, cataloging practices (controlled values), character sets Collection growth rate: volume of images to be added or changes to be made Local infrastructure: bandwidth, availability of hardware, software, degree of tech-savvy or access to technical resources, number of people involved in the process (some have 1-person operations, others have distributed teams consisting of multiple people working on different tasks such as scanning, cataloging, loading into software) We’re going to explore these challenges further with respect to tools development, so let’s take a closer look at the data we’ve gathered in these areas.

So what is to be done? Chicago: City Reference: proposed development of the City Center Chicago (Ill.) Architecture:Site--United States: Illinois--A.D Reference cities harbors City, August 1, 2006 | Title | 19

New Standards, and Education Develop New COUNTER standards for non-text resources Work with other non-text resource providers (image, audio and video) Work with COUNTER Raise awareness, encourage dialogue about appropriate role of usage data Chicago: City Reference: proposed development of the City Center Chicago (Ill.) Architecture:Site--United States: Illinois--A.D Reference cities harbors City, August 1, 2006 | Title | 20

What a non-text resource COUNTER report might look like 1.a: Collection Report 1 (Equivalent to Journal Report 1) Collection Report 1 Number of successful non-text full content unit requests by month and collection <Criteria> Date Run: yyyy-mm-dd Content Provider Platform Jan-09 Feb-09 Mar-09 YTD Total Total for all collections Platform Z 600 1023 1035 2658 Collection AA Provider X 300 400 234 934 Collection BB 200 500 567 1267 Collection CC Provider Y 100 123 457 We collection administrators need more efficient means of updating their collection to truly meet faculty needs, however, the enormous variability that exists at the local level in several key areas impacts our ability to build tools that are broadly useful. Source systems: cataloging Metadata: schemas, flat/relational, cataloging practices (controlled values), character sets Collection growth rate: volume of images to be added or changes to be made Local infrastructure: bandwidth, availability of hardware, software, degree of tech-savvy or access to technical resources, number of people involved in the process (some have 1-person operations, others have distributed teams consisting of multiple people working on different tasks such as scanning, cataloging, loading into software) We’re going to explore these challenges further with respect to tools development, so let’s take a closer look at the data we’ve gathered in these areas.

Discussion Chicago: City Reference: proposed development of the City Center Chicago (Ill.) Architecture:Site--United States: Illinois--A.D Reference cities harbors City, August 1, 2006 | Title | 22