Australian Society of Archivists Victorian Branch Seminar Accessibility over time – the retention, use and re-use of information in the digital age Thursday 21 August 2008, pm Outcomes from the Clever Recordkeeping Metadata Project Joanne Evans and the CRKM Research team

2 Outline Metadata Recordkeeping metadata Clever Recordkeeping Metadata Project Outcomes –Service oriented architectures and implications for recordkeeping –Developing and implementing recordkeeping metadata standards

3 Maturing understanding of metadata From ‘data about data’ to:- Data are any and all complex data entities from observations, experiments, simulations, models, and higher order assemblies, along with the associated documentation needed to describe and interpret the data. Metadata are a subset of data, and are data about data. Metadata summarize data content, context, structure, interrelationships, and provenance (information on history and origins). They add relevance and purpose to data, and enable the identification of similar data in different data collections. National Science Foundation, Cyberinfrastructure Vision for 21st Century Discovery, March

4 Defining metadata Metadata –structured data/information that describes an object in order to facilitate its understanding, management and use. Characteristics –Metadata is recursive –Metadata may be intrinsic –Metadata may be extrinsic –Metadata is dynamic –Metadata is complex –Metadata may apply at various layers of granularity, aggregation and abstraction –Purpose of metadata determines the attributes of the object that are described –Metadata may be different and similar across metadata communities

5 Defining metadata (continued) Metadata communities –Resource Discovery, Recordkeeping, Geospatial, Digital Rights, Preservation, Document Management, Data management, etc. Metadata creation processes –Describing, Titling, Identifying, Annotating, Labelling, Cataloguing, Classifying, Categorising, Relating, Audit trailing, Tagging, etc. Creation and management challenges –Expense –Resource intensive –Quality assurance

6 Recordkeeping Metadata Standardised information that identifies, authenticates, describes, manages and makes accessible, through time and space, documents created in the context of social and business activity. –Traditionally some of this metadata has been captured in records systems and some in archival control systems and finding aids. And some of it has been present in the physical form, ordering, juxtaposition and location of records. Increasingly recordkeeping metadata is also captured in workflow, document management and knowledge management systems, and it is essential to make what was before evident in the physicality of the record explicit in metadata. Source: Records Continuum Research Group, SPIRT Recordkeeping Metadata Project Glossary,

7 Clever Recordkeeping Metadata Project ARC Linkage Project mid Chief Investigator Professor Sue McKemmish, Monash University Partner Investigators Professor Anne Gilliland-Swetland, UCLA Mr Adrian Cunningham, National Archives of Australia Industry Partners and Collaborators National Archives of Australia State Records Authority of New South Wales Australia Society of Archivists, Committee on Descriptive Standards

8 Challenges for electronic recordkeeping Manual descriptive processes unsustainable –cannot keep up with exponential increases in volumes of records created in the course of business and social activities –cannot be applied at lower levels of granularity inherent to digital medium –cannot keep up with transformations in way people work and communicate brought about by digital and network technologies

9 Metadata systems approach Bearman, Archivaria, 1993 –develop tools and methods ‘to acquire descriptions of individual records, files and record-keeping systems directly from the self-documenting features of electronic records systems.’ Hedstrom, Archivaria, 1993 –‘In the electronic era, the descriptive paradigm will shift from the practice of augmenting scarce descriptive information to one of selecting from an abundance of metadata, which could form a complete audit trail of all actions taken to create, update and modify a record, and all of its uses. Automated systems have the capacity to capture and record far more descriptive information than was technically possible or economically feasible with manual systems.’

10

11 Services model Consumer Registry Finds service Service Descriptions Points to description Service Describes service Locate service Exchange messages Source: Based on diagram from

12 Service oriented architectures (SOA) Recordkeeping Services

13 Recordkeeping in SOA Metadata Broker

14 Metadata Broker as cluster of web services Translation Service Web Service Layer Registry Service Web Service Layer AGEMS Request to translate AGEMS to RKMSCA AGEMS – RKMSCA Crosswalk Service Web Service Layer Metadata Broker Client Request the AGEMS – RKMSCA crosswalk RKMSCA

15 Are we ready for service orientation? Design for recordkeeping Design for recordkeeping metadata Design for interoperability

16 To participate in SOA … Overcome paper thinking and dominance of paper paradigm

17 To participate in SOA … Move beyond static resource discovery metadata models

18 To participate in SOA … Standards for machine rather than human processability Abstract Representation Conceptual Model Metadata/Data Standard Metadata/Data Standard Metadata/Data Standard Version 1 Encoding 1 Version 2Version n Encoding 2Encoding n Version 1Version 2Version n Registry Objects Transport and Exchange Recordkeeping Metadata Standards

19 Standards and interoperability Standards compliance does not guarantee interoperability –Recordkeeping metadata standards are just a part of an infrastructure for interoperability  Balance between standardisation activities for best current practice versus standardisation activities to deliver better next generation practices

20 Desktop Applications Business Systems Web Management System Implementing recordkeeping metadata Records Management Application Archival Management Application Subject Portals Community Archives Archival Gateways Schema Crosswalk Schema Records Management Application Archival Management Application Subject Portals Community Archives Web Management Systems Archival Gateways and Desktop Applications Metadata Broker Business Information Systems Metadata Broker

21 Innovate to service oriented future Recordkeeping Services

22 For more information see the Clever Recordkeeping Metadata Project Website research/groups/rcrg/crkmhttp:// research/groups/rcrg/crkm