1. I-WIRE Evaluation Pete Dalton and Jo Alcock Evidence Base, Birmingham City University

2. Evaluation methods Findings: - Achievements of I-WIRE - Challenges faced - Lessons learned - Looking forward Summary Overview

3. Review of project documents: - Progress reports and newsletters - Minutes of meetings - Lessons log and feedback - Project website and blog Interviews with PMG: - May 2010 - February 2011 Evaluation methods

4. Achievements

5. Submission and metadata workflow to minimise staff effort and simplify deposit I have no doubt that the project will achieve its aims of delivering an automated, easy to use, deposit tool

6. Integrated Manage My Publications portlet within Cardiff University intranet A major achievement was getting the portlet integrated; the portal is externally facing but shows a different display depending on your login

7. Well managed project with pragmatic decisions to move work forward There has been clarity of information, we were kept up-to-date, issues were dealt with effectively, and actions were done

8. Effective communication Communication has been excellent throughout…Communication (within the project team and wider) has included email, meetings, blog, internal newsletter articles, inclusion in annual report

9. Development based on detailed user requirements I-WIRE Project… produced a comprehensive list of user requirements (I-WIRE Requirements). These include the easy reuse of bibliographic data by researchers and the ongoing collection of usage or impact metrics Russell, R. and Day, M. (2010) Institutional Repository Interaction with Research Users: A Review of Current Practice. New Review of Academic Librarianship (Vol 16, supp. 1, pp. 116-131)

10. Development of new knowledge for PMG which can be passed to colleagues...better understanding of repositories and an understanding of how repositories can help increase citations (through open access publishing in the repository)

11. Challenges

12. Reduced timescale due to recruitment

13. Technical challenges (software not fit for purpose)

14. Workflows for Schools currently using local systems

15. Issues around researcher’s understanding of copyright and publisher’s open access policies

16. Lessons learned

17. Success factors Senior management support Good project management and communication Agile approach and pragmatic solutions Fixed timescales and deadlines Representation of appropriate stakeholders Driven by user requirements Dedicated resource for project appropriate for needs Appropriate technical and management skills Access to key stakeholders for promotion Focus on most appropriate technology

18. Looking forward

19. Institutional deposit mandate From University management there should be a mandate to deposit research into the repository

20. Advocacy we are competing with a number of different priorities within the University and at the moment this may not be a high priority for researchers

21. Integration with existing workflows and systems...further investment from the University is needed in order to provide enhancement/support, integration with other systems, and embedding into Schools... further investment from the University is needed in order to provide enhancement/support, integration with other systems, and embedding into Schools

22. Back end support for deposit...the back end will need reorganising of staff workloads within the team to support the quality checking. This is high profile within the University so we absolutely have to get it right

23. Ongoing maintenance and support for the system Ongoing support for the software - there is no plan for the future support of the software and it is vulnerable to software updates to any of the related technologies or changes to any of the technologies used within the Schools

24. Summary Project addressed many challenges, achieved what it set out to do Next steps crucial in coordinating technical, policy, and change issues

25. Evidence Base Research and Evaluation Services Birmingham City University http://www.ebase.bcu.ac.uk http://www.ebase.bcu.ac.uk Pete Daltonpete.dalton@bcu.ac.ukpete.dalton@bcu.ac.uk Jo Alcock jo.alcock@bcu.ac.ukjo.alcock@bcu.ac.uk Thank You

26. Slide 4 -http://www.flickr.com/photos/navalhistory/5332830881http://www.flickr.com/photos/navalhistory/5332830881 Slide 5 - http://www.flickr.com/photos/917press/1752968660http://www.flickr.com/photos/917press/1752968660 Slide 7 - http://www.flickr.com/photos/dominik99/1403329318http://www.flickr.com/photos/dominik99/1403329318 Slide 8 - http://www.flickr.com/photos/crystaljingsr/3915516040http://www.flickr.com/photos/crystaljingsr/3915516040 Slide 9 - http://www.flickr.com/photos/silent_e/141839973http://www.flickr.com/photos/silent_e/141839973 Slide 10 - http://www.flickr.com/photos/bearpark/3128651636/http://www.flickr.com/photos/bearpark/3128651636/ Slide 11 - http://www.flickr.com/photos/wwarby/4782854680http://www.flickr.com/photos/wwarby/4782854680 Slide 12 - http://www.flickr.com/photos/stevegrosbois/3362637206http://www.flickr.com/photos/stevegrosbois/3362637206 Slide 13 - http://www.flickr.com/photos/mikebaird/4342842582http://www.flickr.com/photos/mikebaird/4342842582 Slide 14 - http://www.flickr.com/photos/vees/999594439http://www.flickr.com/photos/vees/999594439 Slide 15 - http://www.flickr.com/photos/biblioteekje/3992172265http://www.flickr.com/photos/biblioteekje/3992172265 Slide 16 - http://www.flickr.com/photos/stuartpilbrow/2938100285http://www.flickr.com/photos/stuartpilbrow/2938100285 Slide 18 - http://www.flickr.com/photos/eschipul/5154596724http://www.flickr.com/photos/eschipul/5154596724 Slide 19 - http://www.flickr.com/photos/60588258@N00/3293465641http://www.flickr.com/photos/60588258@N00/3293465641 Slide 20 - http://www.flickr.com/photos/looking4poetry/253074522http://www.flickr.com/photos/looking4poetry/253074522 Slide 21 - http://www.flickr.com/photos/rosipaw/4643095630http://www.flickr.com/photos/rosipaw/4643095630 Slide 22 - http://www.flickr.com/photos/adesigna/4090782772http://www.flickr.com/photos/adesigna/4090782772 Slide 23 - http://www.flickr.com/photos/orudge/4280028131http://www.flickr.com/photos/orudge/4280028131 Slide 24 - http://www.flickr.com/photos/usarmyafrica/3716694098http://www.flickr.com/photos/usarmyafrica/3716694098 Slide 24 - http://www.flickr.com/photos/jetsetwilly/3937047768http://www.flickr.com/photos/jetsetwilly/3937047768 Image references All images