CRIS extensions to CERIF for research outcomes and impact (MICE) Richard Gartner Centre for e-Research King’s College London

“ a structured and systematic methodology for encoding information on the impact of research activities” A follow-up to Readiness for REF (R4R)

Survey of existing literature to draw up basic taxonomy of impact indicators and measures impact indicators: broader, essentially semantic, concepts which indicate that some impact has been achieved:- 'improved patient care', 'improved public services' and 'improved public awareness' impact measures: measurable factors which provide evidence for whether an impact has occurred:- ''audience figures', 'increased revenue' and 'website hits'.

Plus: REF Impact Pilots ENQUIRE Project Final Report Impact case studies at KCL PURE activities model

Link table cfImpactIndicatorId cfImpactMeasureId cfCountIinteger cfValueFloatingPoint cfValueJudgmentalNumeric cfCountIintegerChange cfValueFloatingPointChange cfValueJudgmentalNumericChange CfValueJudgmentalText cfStartDate cfEndDate Impact indicator table cfImpactIndicatorId Impact indicator language table cfImpactIndicatorId cfText Impact measure table cfImpactMeasureId Impact measure language table cfImpactMeasureId cfText

OrgUnit Project Person Publ. etc. Link tables cfOrgUnitId etc. cfImpactMeasureId cfClassId cfClassSchemeId cfStartDate cfEndDate cfOrgUnitId etc. cfImpactIndicatorId cfClassId cfClassSchemeId cfStartDate cfEndDate Link table cfImpactIndicatorId cfImpactMeasureId cfCountIinteger cfValueFloatingPoint cfValueJudgmentalNumeric cfCountIintegerChange cfValueFloatingPointChange cfValueJudgmentalNumericChange CfValueJudgmentalText cfStartDate cfEndDate Impact indicator table cfImpactIndicatorId Impact indicator language table cfImpactIndicatorId cfText Impact measure table cfImpactMeasureId Impact measure language table cfImpactMeasureId cfText

92838 mice-im-0001 impact-creation impact-roles T00:00:00-00: T00:00:00-00:00

OrgUnit Project Person Publ. etc. Link tables cfOrgUnitId etc. cfImpactMeasureId cfClassId cfClassSchemeId cfStartDate cfEndDate cfOrgUnitId etc. cfImpactIndicatorId cfClassId cfClassSchemeId cfStartDate cfEndDate Link tables cfOrgUnitId etc. cfImpactMeasureId cfClassId cfClassSchemeId cfStartDate cfEndDate cfOrgUnitId etc. cfImpactIndicatorId cfClassId cfClassSchemeId cfStartDate cfEndDate OrgUnit Project Person Publ. etc. Link table cfImpactIndicatorId cfImpactMeasureId cfCountIinteger cfValueFloatingPoint cfValueJudgmentalNumeric cfCountIintegerChange cfValueFloatingPointChange cfValueJudgmentalNumericChange CfValueJudgmentalText cfStartDate cfEndDate Impact indicator table cfImpactIndicatorId Impact indicator language table cfImpactIndicatorId cfText Impact measure table cfImpactMeasureId Impact measure language table cfImpactMeasureId cfText

Evaluation St. Andrews and Atira mapped taxonomy to PURE data model Conclusions CRIS systems need to be extended with a new content type: Outcome, which can be related to related to e.g. Research Outputs; Journals; Conferences and Esteems Outcomes need timestamps as they change all the time A strong need for a standardisation process in the area before these measures should be implemented in a larger scale in a CRIS system

Evaluation Goldsmiths studies Goldsmiths Based on discussions with the Research Office and in-depth analysis of 10 Goldsmiths Impact Case studies, mainly in humanities but also psychology, anthropology and sociology Quantitative measures number of research outputs such as articles, books, performances number of media appearances and reviews number of citations numbers relating to audience or readership percentage change in behaviour, condition etc. grant value. Impact indicators of most relevance cultural enrichment social inclusion and cohesion enriched appreciation of culture media attention improved public awareness collaboration with cultural bodies. Recommendations Less emphasis on quantitative measures Numbers need contextual information Possibly call measures 'evidence'

Evaluation Goldsmiths studies Survey of 19 institutions in UK 36% collect data of type recorded in MICE impact measures:- 50% Textually-expressed measures of impact category 15% Percentage and numeric factors Concerns Appropriateness of using numbers to measure impact Local collection of the data in a standard format More information and guidance in relation to measuring impact

@KingsCeRch Centre for e-Research (CeRch) at King's College London