VT’s University Libraries Assessing Technology-based Projects for Faculty Evaluations Some Survey Results and comparisons with ARL Academic Libraries

Technology-based Projects include Publication of articles in ejournals Development of Web-based materials e.g., Web pages, tutorials, digitization Development of video/audio tapes Development of computer software e.g., CD-ROMs

74% of library faculty responded to the survey 28 of 38 library faculty on LIBFAC –Every category represented: administration (including heads, directors), CLs, Collection Management, DLA, ILL, Instruction, Reference, Technical Services –Tenured (59%), non-tenured (33%), and not on tenure track (7%) –60% ≤ 10 years, 40% ≥ 11 years

Q1. 68% of the library faculty have developed tech- based projects in the last 3 years that they considered appropriate for evaluation purposes. Q2. 93% of the library faculty felt they had been encouraged to develop tech- based projects.

Q3. Do librarians feel that they are supported in their development of tech-based projects? Yes: Equipment, software, training provided. No: Support is lacking for time to development.

Q4. Why create technology-based projects?

Q5. Technology-based projects librarians developed in last 3 years appropriate for evaluation

Q5. Other types of technology-based projects for evaluations (comments) Team-taught, online course Timelines Oral history interviews Database design: input, testing, etc.

Q6 and Q7 Within the past 3 years has there been an increase in the number of tech-based projects Q6....on which you collaborated? Q7....that you initiated?

Q6. Within the past 3 years, has there been an increase in the number of tech-based projects on which you collaborated?

Q8. The merit of a tech-based project may be assessed through its quality, relevance, or contribution to the profession. Indicate which materials you might evaluate.

Q8. Other materials to evaluate when deciding on the merit of a tech-based project Benefit to general public Usefulness to me or its users Meets one of more needs of its target audience 41%: decreases staff hours required since using technology VT: usefulness ARL: awards

Q9. Criteria used to determine merit

Q9. Other criteria that should be used to determine merit of tech-based projects Enhances distance learning initiatives Operations run better; more more efficiently Usefulness Contribution to the University Serves the needs of the end-user

Q10. Should P&CA Guidelines specifically address tech-based projects?

Q10. Should P&CA Guidelines specifically address tech-based projects? Yes. Clarification about types of materials and how they will be evaluated. Reminder that content and quality of the project is key, not the format. So that it is clearly understood that such projects are worthy of recognition. To make sure that everyone knows achievement in this domain is valued.

Q10. Should P&CA Guidelines specifically address tech-based projects? No. Acceptable projects should be defined by these guidelines Treat like other projects: does it serve a real need? Any innovative project should be considered Tell when and when not to include Web pages in dossier

Q11. Do tech-based projects deserve more credibility?

If yes, what would give them more credibility? –Creativity, accuracy, relevance, originality –Standardize procedures and documentation –Financial recognition in annual salary –Motivate people who could do more If they deserve less, why? –Technology is a process not a “product” –Technology is a tool. The real determining factor is: has it met a need and is it helping those in its target audience?

Q12. Will tech-based projects ever be sufficient evidence of scholarship?