1. 1 NumericNumeric Developing a statistical framework for measuring the digitisation of Europe’s cultural heritage  Numeric  Phillip Ramsdale The study was conducted for the European Commission by the Chartered Institute of Public Finance and Accountancy

2. 2 NumericNumeric Numeric WHY? Long-term goals better identify the total European digitisation effort and progress; stimulate further digitisation by demonstrating the current progress; better inform stakeholders that have an interest or direct involvement in digitisation policies and funding.

3. 3 NumericNumeric Study objectives Statistics were intended to develop indicators for: digitisation costs, investments and funding sources; volume and growth of digitised resources, related to the analogue collections held by institutions; the characteristics of digitised outputs, including their formats and user access.

4. 4 NumericNumeric Study phasing

5. 5 NumericNumeric Cultural heritage: A jumble of definitions! Culture / Creative Industry x "part of" NACE 1.1ISIC 3.1NAICS 2002 EUUNNorth America Video, film and photography of which: Photography 22.32 x 92.10 92.72 x 74.87 x 74.81 x 2230 x 9211 9212 9249 x 7499 x 7494 334612 x 5121 56131 x 7114 x 54192 Music and the visual and performing arts Sound recording and music publishing Visual and Performing arts (including Festivals) 22.14 22.31 x 92.31 92.32 92.34 x 92.72 x 2213 2230 x 7499 x 9214 9219 x 9249 x 5122 334612 x 7111 7114 x 7115 x 7113 7114 x 56131 x Radio and TV (Broadcasting)92.20 92.72 x9213 9249 x515 516 x 5175 56131 x Libraries (includes archives)92.5923151912 Museums92.5 x9232 x71211 Historic and heritage sites92.5 x9232 x71212 Other heritage institutions92.59233 x71219

6. 6 NumericNumeric What objects are digitised? Collective memory of print: books, journals, newspapers, for example Images held by any institution Museum objects Archival documents Audio-visual materials, such as films and broadcasts Granularity becomes coarser as the classification is summarised.

7. 7 NumericNumeric The “Design”  Since no primary data existed for all domains, it was necessary to collect data directly from individual institutions.  Identify the appropriate institutions from which to collect the data.  Use a “Standard” questionnaire so that consistent definitions could be followed in each country.

8. 8 NumericNumeric The Method – put simply Identify those institutions holding collections that represent the significant part of the nation’s potential digital heritage. Survey a sample of these. Use the survey results to infer the overall scale of digitisation activity and expenditure to all other relevant institutions.

9. 9 NumericNumeric The “Process”  Establish the number of institutions in each country. (All types / domains)  Identify the “Relevant” institutions.  Draw a representative sample.  Introduce the survey questionnaire.  Chase the response.  Check the responders’ data.  Scrutinise the survey results.  Review and refine method for the future.

10. 10 NumericNumeric The “National” approaches provided for translations of the questionnaire into: Czech Dutch English Estonian French German Hungarian Latvian Lithuanian Polish Portuguese Romanian Slovenian Spanish

11. 11 NumericNumeric Designing the “TARGET” ALL INSTITUTIONS RELEVANT INSTITUTIONS SAMPLE Archives, Broadcasters, Film Institutes, Museums, Libraries, Heritage Agencies Digitisation of collections will significantly enhance access to the country's cultural heritage 1,539 > ¼ of relevant

12. 12 NumericNumeric The “Relevant” institution  “Institutions possessing collections that would be of significant value to the digitised heritage of the nation”.  At what point does “Significant” become “Insignificant”?  The guidance spelt out some examples, but assumed National Co-ordinators would be better placed to decide.

13. 13 NumericNumeric Response aligned with distribution of institutions

14. 14 NumericNumeric Interpretation Weighting – flexing the results to eliminate bias arising from the pattern of response. Summary statistics – choosing the appropriate measure to describe all institutions that are so diverse in their purpose.

15. 15 NumericNumeric Choice of statistical measures Example of cost distribution for digitising text combining images on the same page

16. 16 NumericNumeric % with on-line catalogues Range of error for 90% confidence Survey errors All

17. 17 NumericNumeric Sources of data

18. 18 NumericNumeric A few words word about quality More than X% of responders reported on: 90% institutional staff; possession of digitisation plans. 80% digitisation staff; on-line catalogues; undertakers of digitisation; access policies to digitised materials. 70% institutional budget; sources of funding for digitisation; progress towards digitisation.

19. 19 NumericNumeric A few more words about quality More than X% of responders reported on: 60% digitisation budget; availability of digitised material on the internet. Less than X% of responders reported on: 40% number of users accessing digitised materials.

20. 20 NumericNumeric Statistics summarised cover: budgets staff time formal plans funding sources contractors progress formats unit costs access policies internet availability cost of plans  analysis by type of institution, and  type of materials held in collections

21. 21 NumericNumeric Problem definitions User access to digitised materials Archive records Museum digitisation (catalogues / materials ) Newspapers Monuments

22. 22 NumericNumeric “Relevant” institutions Archives – Government documentation / records offices. Museums – Collections of national importance. Libraries – National, University founded before 1900, Public libraries acting as the main reference centre for regions containing at least 5% of population. i.e. Wider than CENL. Audio-visual - Members of ACE / FIAF and National Broadcaster. Significant others! ? ?

23. 23 NumericNumeric Summary issues (1) Clarify the definition of Relevant institutions Encourage universal approaches to measuring the analogue collections Develop incentives to respond to surveys Concentrate the questionnaire on “hard facts”, and... Streamline the questionnaire

24. 24 NumericNumeric The “measures” – 7 Questions Inputs 1.Cost in previous 12 months 2.Staff devoted to digitisation projects 3.Cost of planned digitisation 12/+ months Outputs 1.Digitised pages / hours / etc last year 2.Same assumed in plans Outcomes 1.On/off-line user visits in previous 12 months 2.Proportion of such visits that were “Free”

25. 25 NumericNumeric Summary issues (2) National planning returns to encourage the collection of data Provide a checklist of digitisation processes Review definitions Respect the considerable differences between domains, but consistently cover them all

26. 26 NumericNumeric Summary: Main points Short questionnaire for high-level national summaries – Benchmarking for more specific investigations. Address the definition of “Relevant” institutions. Review the use of the statistics on a regular basis.